194df613de
not using 'location' as defaultfacetfield - since we removed it being
...
default.
9 years ago
d3b9349b6f
simplification / speedup of GenerationMemoryStrategy
9 years ago
f5a9948860
do not store subfield *_coordinate
9 years ago
fca353e5eb
set startuptype of most solr handlers to lazy
9 years ago
4a905ec134
fix to not let the AccessTracker-Log grow to much, but have enough data
...
to monitor.
(+gitignore-correction)
9 years ago
209f502f09
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
20e18d79f8
harmonize document title for archive parsers
9 years ago
d481653202
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
112ae013f4
update bzip and bzip parser process,
...
to return one document for the file with combined parser results of the
containing file and registers it with supplied url and mime of the archive.
9 years ago
e76a90837b
update zip and tar parser process,
...
to return one document for the file with combined parser results of the
containing files.
9 years ago
bc610e5382
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
8532565c7d
optimize order of parsers to try
...
- start with a parser matching the remote supplied mime
9 years ago
681889ae64
use current tar library for untar files
...
- remove old source copy
9 years ago
5d71fc70e3
fix tarParser early exit on looping content
...
- adjust check of data available according to doc
- return null on no recognized content (to not exit TextParser next parser try)
- use commons.compress directly
9 years ago
2fcf6f104c
fix bzipParser recognition
...
- Bzip2Inputstream checks magic byte itself to identify bz2 (leave it in input)
- try to suppy fitting mime for parsing bz2 content
9 years ago
a60b1fb6c2
differentiate api call getLocalPort() from getConfigInt()
9 years ago
02afba730e
fix detection of https port changed after set in System Admin
9 years ago
11f3666660
increase use of pre.defined CATCHALL_QUERY string
9 years ago
a58ee49307
Optimize internal imagequery focus on using content_type to select images
...
(in favor of url file extension)
9 years ago
b61f91f0d4
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
81f53fc83a
upd readme.mediawiki min java version 1.7
9 years ago
d223cf0ae4
adjust MediaWiki importer geo coordinate calculation
...
- allow lat/long 0.xxx
- south / west assignment
include test class
9 years ago
7e2723a894
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
2b775d5be6
fix typo in WikiCode coordinate calculation
9 years ago
a2dcf64039
fix IndexImportMediawiki_p servlet's refresh header
...
add url parameter to make sure no parameter are included in refresh url
which could cause unwanted restart of import job
see http://mantis.tokeek.de/view.php?id=591 comments
9 years ago
bbe9df2bb3
fix MediawikiImporter for bz2 dump
...
skip reading bz2 file magicbyte to identify bz2 format as inputstream reset would be required. Common compress reads and checks the magicbytes internally and throws ioexception if wrong, making preread obsolete.
9 years ago
c6687dd560
fix a system.out to log.fine
...
in bmpParser
9 years ago
c720b4c249
remove override of dynamicField coordinate_p in solr schema
...
(coordinate_p is not a mandatory field as such doesn't need to be declared as schema.field)
9 years ago
e53c6bbd51
fix init of peer flags
...
(remove hiding of ssl flag)
9 years ago
301ba6131a
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
ac034db8bc
Merge branch 'master' of https://github.com/luccioman/yacy_search_server
...
# Conflicts:
# htroot/js/highslide/highslide.js
# source/net/yacy/document/ImageParser.java
9 years ago
8da20718aa
Created a class to test ViewImage rendering against multiple image
...
files.
9 years ago
ec04d27473
Corrected APNG test suite link name.
9 years ago
cbb84ba073
Detailed javadoc.
9 years ago
70111876d2
Filled ViewImageTest.html with all remaining IANA image file formats.
...
Added some links to test suites and specifications.
9 years ago
bfccb8db1c
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
826f14f37f
fix unnececary set null of peer flags, causing reread
...
remove obsolete version flags
9 years ago
a156fd65d0
Patch to manage render or load errors is still needed after highlight.js
...
version upgrade.
Updated patch for better behavior consistency between browsers.
9 years ago
cdbafe340e
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
37e28e0dd3
- Keep aspect ratio of images rendered directly by browser such as gif
...
and svg.
- Corrected quadratic rendering of landscape images with height smaller
than maxHeight
9 years ago
571609c208
upd javascript img viewerto highslide 4.1.13
9 years ago
e2d00585e2
Display full size preview using ViewImage Servlet.
9 years ago
74b0283d57
Added image preview error management.
9 years ago
5902ce032e
Corrected NullPointerException case when ImageIO reader is not found for
...
image format.
9 years ago
f0b5bc93a3
remove obsolete yacy.init entry "secureHttps"
...
not used anywhere
9 years ago
c4fa6d7bf5
upd to icu4j-56_1
9 years ago
5445f38070
upd to jetty 9.2.13.v20150730
9 years ago
6ca02ad577
upd httpclient-4.5.1, httpmime-4.5.1, httpcore-4.4.3, commons-compress-1.10
9 years ago
c6495a5b62
add a log entry on parsing ajax crawling scheme snapshot
...
(prev. commit 9252e36aeb
9 years ago
9252e36aeb
implement ajax crawling scheme for ajax sites which adhere to the proposed use of hash-bangs to provide html content
...
see freshly deprecated https://developers.google.com/webmasters/ajax-crawling/
Implementation improves parsing of the homepage (ajax page) which uses metatag "fragment" in header and parses supplied html snapshot instead of mostly empty ajax/scripted page.
Implementation supports also hash-bang urls (url with anchor starting with ! like ...path#!hashfragment) but our crawler filters it
(use of hash-bang is controversly discussed and proposal is deprecated, makes no sense to adjust the crawler, but as long as it is used by some sites the minor change/improvement in htmlparser is good for some time).
Quick - how does it work
- if metatag fragment with content "!" is found
- htmlparser tries to get content of htmls snapshot (using a different url)
- htmlparser returns 2 documents (original url and snapshot content - but using same original url)
- after parsing result documents are joined (and stored to index containing content also from snapshot page... as the original ajax page contains typically no parseable html content)
9 years ago
sixcooler