orbiter
f3ac923a7e
ftp client shall be able to open non-anonymous ftp servers if login
...
details are given
11 years ago
Michael Peter Christen
ee17bd0b69
added option to attach remote solr servers in read-only mode
11 years ago
Michael Peter Christen
82c0525e71
wrong logger fix
11 years ago
Michael Peter Christen
20b48f894f
refactoring: moving all servlets to the same package (the solr servlet
...
is currently actually a filter which should be changed somehow)
11 years ago
Michael Peter Christen
b461a27abb
fixed the SolrServlet
11 years ago
Michael Peter Christen
7603e879dc
Merge branch 'master' into HEAD
...
Conflicts:
.classpath
source/net/yacy/cora/federate/solr/SolrServlet.java
11 years ago
Michael Peter Christen
25250405f1
solr servlet preparation for join with jetty branch
11 years ago
Michael Peter Christen
57f0f71ac6
added patch to allow binary response writer
11 years ago
orbiter
4de3fefdb5
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
7e346e1d79
using stringbuilder in query construction
11 years ago
reger
c84c313fe1
Merge origin/master into jetty
11 years ago
Michael Peter Christen
2702d9e56b
- added a SolrQueryResponse2SolrDocumentList method which is able to
...
work around the unfolding process in Solr's BinaryResponseWriter.
This was a huge performance bottleneck in the embedded solr connector
and the problem is actually on Solr side, but we have now a workaround.
- This made it possible to abstract a high-performance index access
method which is implemented as method getDocumentListByParams. That
method is also implemented in the SolrServerConnector and provides a
very efficient access to a solr index if the index is embedded.
- a popular use of the document list retrieval is a result count which
can now also make use of the new method, via getDocumentCountByParams.
- enhanced the Error cache which now does not store error documents
within the ram cache if the document is also written to solr. When
documents are retrieved from the cache, they are partly read from the
ram cache and if not existent there, from the Solr index.
11 years ago
Michael Peter Christen
34633044b4
made pattern computation static
11 years ago
Michael Peter Christen
ef7ddbc933
added date parser caches to prevent re-calculation of costly date
...
parsing
11 years ago
Michael Peter Christen
303f5694ba
avoid usage of existsByQuery. If a document can be loaded by the ID
...
before testing other fields from the existsByQuery request, then a
document cache fills and queries after that one can be avoided.
11 years ago
Michael Peter Christen
79771c60c0
IPv6 fixes
11 years ago
reger
92d9c56f9f
Merge origin/master into jetty
11 years ago
Michael Peter Christen
0db8e34625
enhanced webgraph processing
11 years ago
reger
effea4bca0
Merge origin/master into jetty
...
Conflicts:
source/net/yacy/cora/federate/solr/SolrServlet.java
11 years ago
sixcooler
2c2ebb0d92
tried some hardening in order not letting any Solr-Searchers open
11 years ago
Michael Peter Christen
a16534cb0a
tried to fix timeout and connection-lost problems when using an outside
...
solr.
11 years ago
Michael Peter Christen
9932c441c8
fixed a problem with Date fields parsing Solr results if a remote Solr
...
is attached.
11 years ago
sixcooler
94db054aff
memory-leak-fix: the DocListSearcher fires an query in its constructor
...
and it is highly recommend to close every SolrRequest.
Every Request, which is not closed leaves a Searcher with its Chaches an
can not be garbage-collectet.
11 years ago
reger
26bb1e37b7
implement core selection in SolrServlet
...
- making initcore() obsolete
11 years ago
Michael Peter Christen
5592ea57f0
hack to remove compiler warnings about deprecated classes. It would be
...
better to remove the deprecated usage but to do this the Solr core must
adopt the latest apache http core changes as well .. this is not our
fault.
11 years ago
orbiter
037cd0a57c
using the BinaryResponseWriter which is supported within the YaCy solr
...
servlet since YaCy 1.63. This is much more performant for the client
than using the XMLResponseWriter because parsing of XML data is very CPU
intensive. Older YaCy peers are still requested using the
XMLResponseWriter but the majority of YaCy peers already respond with
the binary writer. This makes remote searches much faster and less CPU
intensive.
11 years ago
reger
5c4a3d1c01
Merge origin/master into jetty
11 years ago
reger
8da75a4b0c
fix contentType definition for Solr html responswriter
...
from xml to html
(hint: value is currently not used, but is in SolrServlet)
11 years ago
Michael Peter Christen
1f0bfa8fec
added test to Base64Order (runs successfully!)
11 years ago
reger
f111f30ace
Merge origin/master into jetty
11 years ago
Michael Peter Christen
219d5934a4
fixed termination bug in Solr Connector
11 years ago
Michael Peter Christen
9d5895f643
enhanced and fixed postprocessing
11 years ago
Michael Peter Christen
f86fe90eda
enhanced mass storage speed to remote solr servers
11 years ago
Michael Peter Christen
6ed9821209
fixed several problems in solr connectors
11 years ago
Michael Peter Christen
191fd3d7e7
added an optimization option to HandleSet mass data storage structure
11 years ago
Michael Peter Christen
94b565ea0d
fixed keepalive min value
11 years ago
Michael Peter Christen
24a052ecb9
removed debug code for existsByIds
11 years ago
Michael Peter Christen
1a4a69c226
set more logger to 'final static'
11 years ago
orbiter
b085cb522b
replaced old existsByIds for embedded Solr with obviously much faster
...
new selection method (including stil existing debug code to test that
this is in fact better)
11 years ago
reger
066a1ecf0a
add highlight queryparams to solrservlet if missing
...
- modify query params in Solr parameter map (instead of querystring)
11 years ago
Michael Peter Christen
899e7e92b0
added debug code
11 years ago
reger
4684330505
Merge origin/master into jetty
...
Conflicts:
source/net/yacy/cora/federate/solr/responsewriter/HTMLResponseWriter.java
11 years ago
reger
1437c45383
merge rc1/master
11 years ago
Michael Peter Christen
81bb50118e
found and fixed a huge memory leak in solr caching (inside Solr). The
...
not-flushed Solr cache is now handled in this way:
- it is smaller by default
- an Solr-internal process is started to flush the cache periodically
(this does NOT clean the cache, just removes old objects)
- a Solr-external process (the standard YaCy cleanup-process) now has
direct access to the solr internal cache and flushes them completely.
The time frame for such a flush is defined by the cleanup-process
frequency, by default 10 minutes.
11 years ago
reger
b85f702f22
add AccessTracker logging to SolrServlet
11 years ago
reger
de1f02420b
implement HtmlResponseWriter to solrServlet (and rss / opensearch responswriter) as in yacy select servlet.
...
- set contenttype of HTLM/GrepHTML-Reponsewriter to "text/html"
- set a contenttype to GSAsearchServlet
11 years ago
Michael Peter Christen
b2c329929f
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
Michael Peter Christen
60187a4ec2
fix in html parser
11 years ago
Michael Peter Christen
e1c1e57877
less overhead calling exist() with only one hash
11 years ago
reger
3d5d366f1c
fix html header in Solr HTMLResponseWriter
...
- move 1st body content after </head> tag
- add closing <span> tag
11 years ago