4de3fefdb5
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
7e346e1d79
using stringbuilder in query construction
11 years ago
69829fc417
update Netbeans GUI build classpath
11 years ago
2702d9e56b
- added a SolrQueryResponse2SolrDocumentList method which is able to
...
work around the unfolding process in Solr's BinaryResponseWriter.
This was a huge performance bottleneck in the embedded solr connector
and the problem is actually on Solr side, but we have now a workaround.
- This made it possible to abstract a high-performance index access
method which is implemented as method getDocumentListByParams. That
method is also implemented in the SolrServerConnector and provides a
very efficient access to a solr index if the index is embedded.
- a popular use of the document list retrieval is a result count which
can now also make use of the new method, via getDocumentCountByParams.
- enhanced the Error cache which now does not store error documents
within the ram cache if the document is also written to solr. When
documents are retrieved from the cache, they are partly read from the
ram cache and if not existent there, from the Solr index.
11 years ago
74466d731a
use pre-compiled patterns in ymark
11 years ago
34633044b4
made pattern computation static
11 years ago
ef7ddbc933
added date parser caches to prevent re-calculation of costly date
...
parsing
11 years ago
552ef9f18e
fix for bad ErrorCache.exists test (bug from latest commit)
11 years ago
09412ea3a4
counting search requests in solr interface
11 years ago
303f5694ba
avoid usage of existsByQuery. If a document can be loaded by the ID
...
before testing other fields from the existsByQuery request, then a
document cache fills and queries after that one can be avoided.
11 years ago
67e7dc0cc6
added more properties to seedlist servlet
11 years ago
79771c60c0
IPv6 fixes
11 years ago
4e3375d983
next development version
11 years ago
f722e450b3
changed start parameters which caused deadlocks in mac and windows
...
versions
11 years ago
ddc7a24853
intermediate release 1.66
11 years ago
78eac85161
better calibration of caches and queue maximum sizes
11 years ago
da380343c2
perform greedy learning heuristic only if load < 1.0
11 years ago
81926c055d
fixed bug with image search in yacyinteractive
11 years ago
edda0699e4
changed default timeout for port scanner
11 years ago
c8af19bd37
removed unnecessary check which causes a NPE when searching with empty
...
search string
11 years ago
e3c2f09de9
- reduce computation in case that specific postprocessing fields are not
...
selected
- de-select citation rank computation
11 years ago
cfa08024c7
removed optimization bevore postprocessing because that may cause a
...
time-out which will cause that postprocessing fails.
11 years ago
6f3a923691
fixed urlmask which was not able to combine several constraints
11 years ago
9a27bf6e82
removed filter computation in Protocol class for remote searches because
...
that is already done in the QueryParams class
11 years ago
f1b5db2c45
- performance graph does not shop peer ping in memory monitor any more
...
- after a forced GC, the PerformanceMemory view switches to automatic
update by default
11 years ago
a125904a1c
fixed a NPE in surrogat processing
11 years ago
0db8e34625
enhanced webgraph processing
11 years ago
9d8b32c63a
fixed a division by zero
11 years ago
957f6297fb
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
b49e90d2e9
remove reference to solrServlet from YaCy servlet select
...
- reference is not used
- solrServlet is used in Jetty branch and adjustments there conflict with unused solrServlet here.
11 years ago
38e1e3a707
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
2c2ebb0d92
tried some hardening in order not letting any Solr-Searchers open
11 years ago
cca79d12ef
setting of some default values to make an client development start easy
...
using the description at
http://www.yacy-websuche.de/wiki/index.php/Dev:APIhello
11 years ago
a16534cb0a
tried to fix timeout and connection-lost problems when using an outside
...
solr.
11 years ago
c3dcbdc8d5
try to recover from an OOM during citation index reading and fail-over
...
to second solr core in case of unrecoverable OOM.
11 years ago
9932c441c8
fixed a problem with Date fields parsing Solr results if a remote Solr
...
is attached.
11 years ago
94db054aff
memory-leak-fix: the DocListSearcher fires an query in its constructor
...
and it is highly recommend to close every SolrRequest.
Every Request, which is not closed leaves a Searcher with its Chaches an
can not be garbage-collectet.
11 years ago
ae55d69ef6
include/exclude size NPE fix (recently added)
11 years ago
3d4b5e66ce
disallow remote robots to crawl the HostBrowser servlet
11 years ago
234ca720f5
only admins should be able to force a commit
11 years ago
2c39b65409
fixes for searches containing stopwords. The fix was done using a
...
reconstruction of the search word set access method to protect that
words are deleted from the sets from the outside of the QueryGoal class.
11 years ago
5592ea57f0
hack to remove compiler warnings about deprecated classes. It would be
...
better to remove the deprecated usage but to do this the Solr core must
adopt the latest apache http core changes as well .. this is not our
fault.
11 years ago
037cd0a57c
using the BinaryResponseWriter which is supported within the YaCy solr
...
servlet since YaCy 1.63. This is much more performant for the client
than using the XMLResponseWriter because parsing of XML data is very CPU
intensive. Older YaCy peers are still requested using the
XMLResponseWriter but the majority of YaCy peers already respond with
the binary writer. This makes remote searches much faster and less CPU
intensive.
11 years ago
61409788eb
less word hash computations (removing some overhead because of MD5
...
calcs) using the clear word in a normalized form.
11 years ago
f23471c471
add check to prevent index entries containing url_file_ext_s with ";jsession=xyz"
...
note: check could be implemented in MultiProtocolURL (but at this time didn't oversee possible implication)
11 years ago
8da75a4b0c
fix contentType definition for Solr html responswriter
...
from xml to html
(hint: value is currently not used, but is in SolrServlet)
11 years ago
caa20d63d9
fixed seedlist (hash was missing)
11 years ago
ccf2f4e43b
refactoring of seed attributes (introduced more constants)
11 years ago
1f0bfa8fec
added test to Base64Order (runs successfully!)
11 years ago
c927b428d3
fixed json
11 years ago
orbiter