97039049e4
fix in key enumeration methods for cases where the enumeration is done
...
in reverse order.
11 years ago
7e1b0b6712
fix for wildcard patch in search queries
11 years ago
0a879c98e7
added new 'firstSeen' database table and necessary data structures which
...
hold a date for each URL to record when a url was first seen. This is
then used to overwrite the modification date for urls upon recrawl in
case that the first-seen date is before the latest document date. This
behaviour is necessary due to the common behaviour of content management
systems which attach always the current date to all documents. Using the
firstSeen database it is possible to approximate a real first document
creation date in case that the crawler starts frequently for the same
domain. As a result the search results ordered by date have a much
better quality and the usage of YaCy as search agent for latest news has
a better quality.
11 years ago
421ee64f33
another fix to ordering of table indexes; fixes also network stats
...
graphics
11 years ago
1db476c67e
fix for bad table iteration
11 years ago
e4316e2d74
skip creation of local var in proxyhandler.storetocache
11 years ago
9c6e3a6b1c
fix assertation-failure in version-string for Solr-4.10.2 by changing
...
the assert - hope that is ok
+ add forgotten NB-Projekt-changes
11 years ago
725b206fb4
update to solr-/lucene-4.10.2
11 years ago
5c97ecb30f
fix of bad query generation for search facets
11 years ago
95d87f00b3
fix for bad query generation in doublecheck in postprocessing
11 years ago
72c2bc5189
fix for search in case where local peer has no local seed address in
...
portal mode
11 years ago
5be352da99
Merge branch 'master' of git@gitorious.org:yacy/rc1.git
11 years ago
0fcd8097a3
removed unused options from BusyThreads
11 years ago
fe8b1d137d
emergency bugfix for 100% CPU in image drawing
11 years ago
92007e5d2d
more enhancements to posprocessing speed
11 years ago
9a7fe9e0d1
fix for bad timing computation in postprocessing
11 years ago
bd16119a00
another fix for postprocessing (the query for "" on numeric field did
...
not work in external solr)
11 years ago
327e83bfe7
more fixes in postprocessing: partitioning of the complete queue to
...
enable smaller queries
11 years ago
2bc6199408
more concurrency for postprocessing
11 years ago
a83cf26c38
more fixes and enhancements to postprocessing
11 years ago
71758f0d62
enhanced postprocessing by usage of a field-list generation to prevent
...
lazy initialization of the documents. This is useful because the
documents must be read completely anyway.
11 years ago
7856fbdbe8
fix for npe (in rare cases)
11 years ago
8a2b569d7c
fix for literal computation
11 years ago
856da2712b
Merge branch 'master' of git@gitorious.org:yacy/rc1.git
11 years ago
ca9cd7b58a
more IPv6 fixes
11 years ago
b4585e9546
added new index size history image in /Status.html page
11 years ago
167c5a51f0
IPv6 fix
11 years ago
fe537679de
fix for exact_signature_unique_b, exact_signature_copycount_i,
...
fuzzy_signature_unique_b and fuzzy_signature_copycount_i: apply same
criteria for 'valid document' as for title and description uniqueness
test.
11 years ago
eb9d2705d2
fix for ConnectionInfo.cleanup of server-connections
11 years ago
2e5214eb21
added field postprocessing.partialUpdate to settings which can be used
...
to switch on or off partial updates. Both options should cause the same
result. Default is on.
11 years ago
11074d8d24
fix for a ssl bug that appear only in java 7.
...
The bug was reported in
http://forum.yacy-websuche.de/viewtopic.php?f=23&t=5407&p=30956#p30956
a solution was described in
http://teknosrc.com/javax-net-ssl-sslprotocolexception-handshake-alert-unrecognized_name-solved/
which worked for this example given in the yacy forum
11 years ago
e96490e3a1
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
77662e08e1
concurrently initialize the error cache; extended also the cache by
...
factor 10 up to 1000 entries. This error cache is only used to catch up
paused crawls between shutdown+startup
11 years ago
d8fcc4a2f5
added a timeout on Jetty connectors
11 years ago
0f0b60404b
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
72561926aa
do not overwrite yacy.conf in case of an exception
...
may be a fix for http://mantis.tokeek.de/view.php?id=180
11 years ago
07c5b57953
removed warnings
11 years ago
fa2ad101ec
enhanced graphics computation (avoiding long string parsing for colours)
11 years ago
ef813cec91
added proper copyright notice to OSM tiles presented at the search
...
result page
11 years ago
fca11701f0
better profiling of solr queries
11 years ago
2e09da9832
npe fix
11 years ago
d80418f1b1
added partial updates to solr during postprocessing: during
...
postprocessing the solr documents are now not completely retrieved.
instead, only fiels, needed for the postprocessing are extracted. When
Solr document are written, this is done using partial updates.
This increases postprocessing speed by about 50% for embedded Solr
configurations. For external Solr configurations the enhancement should
be much higher because the postprocessing with remote Solr is very slow.
When doing partial updates to a remote Solr, this method should perform
much better than before, it is expected that this is even much higher
than the increase with local Solr.
11 years ago
b1cfbc4a04
added new solr field url_paths_count_i which can be used to enhance the
...
index browser and maybe also for ranking; possibly also for
SEO-with-YaCy applications.
11 years ago
e69883d5ab
fix-fix for
...
30d4402cd1
11 years ago
30d4402cd1
fixed location search
11 years ago
6983dff334
explain crawl denial when not switched to intranet mode
11 years ago
f818f84adb
more ipv6 fixes
11 years ago
afd5bd5f5f
slightly enhanced Network table computation by using a lazy initialized
...
bitfield for peer flags
11 years ago
2c2b50e65d
refactoring (class name should start with uppercase letter)
11 years ago
bc275dca07
added network history graph image /NetworkHistory.png which can show
...
many different statistics about the history of the peer.
11 years ago
Michael Peter Christen