Michael Peter Christen
78eac85161
better calibration of caches and queue maximum sizes
11 years ago
Michael Peter Christen
c8af19bd37
removed unnecessary check which causes a NPE when searching with empty
...
search string
11 years ago
Michael Peter Christen
e3c2f09de9
- reduce computation in case that specific postprocessing fields are not
...
selected
- de-select citation rank computation
11 years ago
Michael Peter Christen
cfa08024c7
removed optimization bevore postprocessing because that may cause a
...
time-out which will cause that postprocessing fails.
11 years ago
Michael Peter Christen
6f3a923691
fixed urlmask which was not able to combine several constraints
11 years ago
Michael Peter Christen
9a27bf6e82
removed filter computation in Protocol class for remote searches because
...
that is already done in the QueryParams class
11 years ago
Michael Peter Christen
f1b5db2c45
- performance graph does not shop peer ping in memory monitor any more
...
- after a forced GC, the PerformanceMemory view switches to automatic
update by default
11 years ago
Michael Peter Christen
a125904a1c
fixed a NPE in surrogat processing
11 years ago
Michael Peter Christen
0db8e34625
enhanced webgraph processing
11 years ago
sixcooler
2c2ebb0d92
tried some hardening in order not letting any Solr-Searchers open
11 years ago
Michael Peter Christen
a16534cb0a
tried to fix timeout and connection-lost problems when using an outside
...
solr.
11 years ago
Michael Peter Christen
c3dcbdc8d5
try to recover from an OOM during citation index reading and fail-over
...
to second solr core in case of unrecoverable OOM.
11 years ago
Michael Peter Christen
9932c441c8
fixed a problem with Date fields parsing Solr results if a remote Solr
...
is attached.
11 years ago
sixcooler
94db054aff
memory-leak-fix: the DocListSearcher fires an query in its constructor
...
and it is highly recommend to close every SolrRequest.
Every Request, which is not closed leaves a Searcher with its Chaches an
can not be garbage-collectet.
11 years ago
Michael Peter Christen
ae55d69ef6
include/exclude size NPE fix (recently added)
11 years ago
Michael Peter Christen
2c39b65409
fixes for searches containing stopwords. The fix was done using a
...
reconstruction of the search word set access method to protect that
words are deleted from the sets from the outside of the QueryGoal class.
11 years ago
Michael Peter Christen
5592ea57f0
hack to remove compiler warnings about deprecated classes. It would be
...
better to remove the deprecated usage but to do this the Solr core must
adopt the latest apache http core changes as well .. this is not our
fault.
11 years ago
orbiter
037cd0a57c
using the BinaryResponseWriter which is supported within the YaCy solr
...
servlet since YaCy 1.63. This is much more performant for the client
than using the XMLResponseWriter because parsing of XML data is very CPU
intensive. Older YaCy peers are still requested using the
XMLResponseWriter but the majority of YaCy peers already respond with
the binary writer. This makes remote searches much faster and less CPU
intensive.
11 years ago
orbiter
61409788eb
less word hash computations (removing some overhead because of MD5
...
calcs) using the clear word in a normalized form.
11 years ago
reger
f23471c471
add check to prevent index entries containing url_file_ext_s with ";jsession=xyz"
...
note: check could be implemented in MultiProtocolURL (but at this time didn't oversee possible implication)
11 years ago
reger
8da75a4b0c
fix contentType definition for Solr html responswriter
...
from xml to html
(hint: value is currently not used, but is in SolrServlet)
11 years ago
Michael Peter Christen
ccf2f4e43b
refactoring of seed attributes (introduced more constants)
11 years ago
Michael Peter Christen
1f0bfa8fec
added test to Base64Order (runs successfully!)
11 years ago
orbiter
b7f1e5af51
added new servlet which generates the same file as the principal peers
...
upload to a bootstrap position
you can call it either with
http://localhost:8090/yacy/seedlist.html
or to generate json (or jsonp) with
http://localhost:8090/yacy/seedlist.json
http://localhost:8090/yacy/seedlist.json?callback=seedlist
11 years ago
orbiter
3e552550d1
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
c2d720cdaf
purge a lucene cache - possible memory leak fix
11 years ago
reger
e4f49fb175
for searchresults with empty title use filename as title
...
- to not store a title in index which isn't extracted from source
the title is empty check only added to ResultEntry class
11 years ago
orbiter
ff86cb683f
fixed some XSS bugs reported by Marius from http://ctf365.com/
11 years ago
orbiter
da33ee0d77
extended also timeout fr webgraph postprocessing
11 years ago
orbiter
74f9e40747
extended timeout during postprocessing of 30 minutes.
11 years ago
orbiter
19a051bec8
more monitoring for postprocessing and enhanced layout in Crawler
...
monitor page
11 years ago
Michael Peter Christen
9cf9727685
fix for wrong counter
11 years ago
Michael Peter Christen
fceac8cffd
more monitoring for postprocessing
11 years ago
Michael Peter Christen
6842783761
fixed and enhanced postprocessing
11 years ago
Michael Peter Christen
219d5934a4
fixed termination bug in Solr Connector
11 years ago
Michael Peter Christen
bf1bdd52a6
prevent requesting of 0-facets (which actually exist)
11 years ago
Michael Peter Christen
9d5895f643
enhanced and fixed postprocessing
11 years ago
Michael Peter Christen
f86fe90eda
enhanced mass storage speed to remote solr servers
11 years ago
Michael Peter Christen
6ed9821209
fixed several problems in solr connectors
11 years ago
Michael Peter Christen
191fd3d7e7
added an optimization option to HandleSet mass data storage structure
11 years ago
Michael Peter Christen
94b565ea0d
fixed keepalive min value
11 years ago
Michael Peter Christen
24a052ecb9
removed debug code for existsByIds
11 years ago
Michael Peter Christen
087df05e24
added option to Config_Network_p.html to enable remote search while
...
DHT-Receive is switched off.
11 years ago
Michael Peter Christen
1a4a69c226
set more logger to 'final static'
11 years ago
Michael Peter Christen
c60947360d
logger should be static
11 years ago
Michael Peter Christen
69b8d61c47
fix for search requests in GSA interface which contain 'funny'
...
characters (like ':' etc.)
11 years ago
orbiter
b085cb522b
replaced old existsByIds for embedded Solr with obviously much faster
...
new selection method (including stil existing debug code to test that
this is in fact better)
11 years ago
orbiter
4234b0ed6c
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
909bbb49d8
added (partly commented) test code for url rewrite methods .. to be
...
completed
11 years ago
Michael Peter Christen
899e7e92b0
added debug code
11 years ago