a44cc774d0
Merge branch 'master' of github.com:yacy/yacy_search_server
10 years ago
41c9215174
Merge branch 'master' of https://github.com/yacy/yacy_search_server
10 years ago
7a64bebb86
init Recrawl job chunk size to max crawl loader during job start, to use some system preferences
...
and allow injection of recrawl urls before queue is empty
During recrawl the balancer hangs on the very last urls often on hosts with huge delay time,
by allowing injection earlier progress is more balanced. Max number of injected crawl urls by recrawl job is 2 * max loader.
10 years ago
e7dab60ebd
Merge branch 'master' of https://github.com/yacy/yacy_search_server
10 years ago
d6522fa4a2
Integrated haraldk/TwelveMonkeys library to first add TIF image format
...
support.
10 years ago
e093fb228d
Created a generic ViewImage performance render test.
10 years ago
9244694e64
Merge branch 'master' of git@github.com:yacy/yacy_search_server.git
10 years ago
151ccd50a9
fix for image size field values (must be multi-valued)
10 years ago
3ad564e2e4
Created a ViewImage rendering performance measurement test.
10 years ago
62e07a26a0
Refactoring : split into sub-functions to make it understanding and
...
performance measurement easier.
10 years ago
b3f044072e
Updated table headers and SVG file url for case sensitive OS.
10 years ago
ff963cbe23
Merge branch 'master' of https://github.com/yacy/yacy_search_server
10 years ago
c9937973e3
unescape MultiProtocolURL getAttributes() return values.
...
use getAttributes() to get query parameters as clear text (w/o url encoding)
use getSearchpartMap() to get in internal format (url encoded)
fix for http://mantis.tokeek.de/view.php?id=606
10 years ago
6695e5cdd3
Merge branch 'master' of https://github.com/yacy/yacy_search_server
10 years ago
10b0eb106f
fix link target on iframe list in CrawlProfileEditor
10 years ago
78e8c6f3e5
refactor special handling (static override) of SUPPORTED_EXTENSIONS/MIME_TYPES
...
not used for genericImageParser
10 years ago
d54c5d310a
add links with image extension not automatically to image links.
...
With the wide spread use e.g. of Wikimedia the url file extension of links with image extension often point to html.
10 years ago
f5746b5490
Added ico and bmp sample pictures
10 years ago
baede48161
Added JPEG 2000 and FITS samples
10 years ago
7c9d80c5d0
Added image formats and informations for each format.
10 years ago
0431be8d6c
Merge branch 'master' of https://github.com/yacy/yacy_search_server
10 years ago
073ef730af
Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
10 years ago
5744342fec
handle image preview for url w empty file extension
...
fix of commit 688f7b2a5c
10 years ago
82dd004260
Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
10 years ago
851e8f6c8a
check jpeg file signature in genericImageParser
...
to fail early without further object allocation if source is not a jpeg.
10 years ago
fb75fea446
use recrawljob w/o sort results by date
...
This is a workaround for existing index (not fully reindexed) since intro of schema with docvalues
to prevent solr exception causing recrawljob to fail with
org.apache.solr.core.SolrCore java.lang.IllegalStateException: unexpected docvalues type NONE for field 'load_date_dt' (expected=NUMERIC). Use UninvertingReader or index with docvalues.
10 years ago
3cbf86f295
Merge branch 'master' of git@github.com:yacy/yacy_search_server.git
10 years ago
23f6294a2d
removed unused import
10 years ago
43c27aa550
upd to solr/lucene 5.3.1
10 years ago
fd5a1dc297
upd to poi-3.13
10 years ago
839d710105
Merge branch 'master' of https://github.com/yacy/yacy_search_server
10 years ago
0ae9297ca5
Created a html test page to check ViewImage rendering with different
...
file formats.
10 years ago
136e8f6fbd
Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
10 years ago
688f7b2a5c
allow/display svg images in image results previews
...
svg is not supported by awt but by most browser. Image content is delivered as received (without size adjustment)
10 years ago
d5330391de
remove some unused var allocation in parser
10 years ago
3d7dd9d3aa
follow-up to latest commit: also flush the search cache if all crawls
...
had been terminated.
10 years ago
225200194a
every time a crawl is started, the user expects a different search
...
result behaviour. This requires that the search cache is flushed for
each crawl start. TODO: this should also be done if a crawl is
terminated.
10 years ago
c737ff235d
in case that the include_string contains several entries including
...
1-char tokens and also more-than-1-char tokens, then remove the 1-char
tokens to prevent that we are to strict. This will make it possible to
be a bit more fuzzy in the search where it is appropriate.
10 years ago
8e555d79a3
add also 1-character tokens to the token list because that could be also
...
searched for. A full-string search for a filename may fail if those
1-char tokens are omitted
10 years ago
1091e25f4c
Merge branch 'master' of https://github.com/yacy/yacy_search_server
10 years ago
eb7989b17b
Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
10 years ago
7c82cd4415
add a end condition to svgParser for wrong content
...
(if parser choosen just by file extension)
10 years ago
82f4f221e9
Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
10 years ago
9c2cd7e87b
Merge branch 'master' of https://github.com/yacy/yacy_search_server
10 years ago
b92d81b073
remove double caching of inputstream in ViewImage
10 years ago
c7c5e2dff9
fix old/obsolete solr dependency to stax
...
delete obsolete jar
10 years ago
beed1c417e
Add report profile with OWASP Dependency-Check to maven pom
10 years ago
356d4d1301
remove rdfParser from init (current function identical with genericParser)
10 years ago
c647d899e3
add svgParser to parse metadate from svg images
...
Reads document level included title and description and skips the graphic content to save bandwidth.
svg metadata element is not interpreted
- remove rdfParser from init (current function identical with genericParser)
10 years ago
bad34804fe
optimize parseInt for <img> tag attribute parsing
...
Performance better as using Numberformat.parse or parseInt(substring())
10 years ago
Michael Peter Christen