Michael Peter Christen
ab6ec4ec52
added snippet computation to solr/rss and gsa result writer
12 years ago
Michael Peter Christen
4716546ef5
- reduced memory usage in index transmission using a transformation of
...
Node to Row objects
- removed peerDeparture in solr remote search in case that peer does not
answer (this may be normal because it is allowed to switch this off)
12 years ago
Michael Peter Christen
af764c106c
re-activated audio and video search because they obviously work (!)
12 years ago
Michael Peter Christen
06b0081fdc
fix for NPE during host navigation computation
12 years ago
Michael Peter Christen
feb99bc291
fixed GSA format
12 years ago
Michael Peter Christen
653645c1cf
corrected solr query syntax
12 years ago
Michael Peter Christen
08ae142a3d
- enhanced caching after search queries to solr
...
- reduced caching after short memory
12 years ago
orbiter
716ea0cfe2
sorted the solr schema into mandatory and optional fields; reduced
...
number of used field to reduce solr index size
12 years ago
orbiter
9b8c8c0f47
fix from gaston in
...
http://forum.yacy-websuche.de/viewtopic.php?p=26909#p26909
12 years ago
orbiter
acb9f04e80
removed unused classes
12 years ago
Michael Peter Christen
0ad52ac4c3
gsa bugfix for date parser
12 years ago
Michael Peter Christen
3ce4c2f937
fixes for gsa result format
12 years ago
Michael Peter Christen
2d5fdfeb65
added authorization-based maximum results limitation to solr and gsa
...
search
12 years ago
Michael Peter Christen
67d235fae9
added gzip encoding to solr2sor http interface, client side (server
...
already works)
12 years ago
Michael Peter Christen
a049761e0c
fixed double-check
12 years ago
Michael Peter Christen
6fc5400f91
added a tooltip for search navigation to mention that search pages can
...
be navigated using the TAB key
12 years ago
Michael Peter Christen
f42a57cd7d
gsa format update
12 years ago
Michael Peter Christen
b3aad6cc35
bugfix for remote search when search is done to solr
12 years ago
Michael Peter Christen
ff3eaa21b0
added remote search to solr on YaCy peers!
...
- when doing a remote search, node peers are selected for solr queries
- the solr query is done concurrently to the standard YaCy rwi search
- the solr search result is feeded into the same data structure that
prepares the rwi search result
- the same remote seach that is done to several outside peers is done to
the local solr index
- the search process works now also without any 'old' RWI data using
solr
12 years ago
Michael Peter Christen
a06123aec6
more abstraction and less parameter overhead for remote search
12 years ago
Michael Peter Christen
f00733186b
code simplifications
12 years ago
Michael Peter Christen
755f5e76cf
removed strange assert statements and simplified code in metadata
...
transformation
12 years ago
Michael Peter Christen
db0d438709
fix for http://bugs.yacy.net/view.php?id=206
12 years ago
orbiter
404b0aab09
refactoring in remote search and stub for remote node peer selection
12 years ago
orbiter
d7ea45f698
- get nice text_t values from metadata conversions that are stored into
...
solr as fulltext search index.
- added slow migration from old metadata to solr index entries: each
entry from the old metadata is removed from that data structure and
written into solr.
12 years ago
orbiter
99ef57f103
reduced sleep times
12 years ago
orbiter
780f8974e7
added ramaining iteration methods for solr in fulltext class
12 years ago
orbiter
acd2dc3575
hack to removed StringBuilder overhead in query construction
12 years ago
orbiter
db6863db77
reduced solr cache sizes to check if that solves memory problems a bit
12 years ago
orbiter
6f01542aaa
explicit double-check in transferURL
12 years ago
orbiter
ee01c12e56
fixes for putDocument and putMetadata
12 years ago
orbiter
cc47a0876e
reverted bf55f69176
...
to have a fall-back option in case that memory problems as reported in
http://forum.yacy-websuche.de/viewtopic.php?p=26901#p26901
for full-solr installation are too strong and we have to work with an
'small memory footprint' peer system.
12 years ago
Michael Peter Christen
0904afe8fb
added concurrent iterator methods to the solr connectors
12 years ago
Michael Peter Christen
d54b80327a
refactoring
12 years ago
Michael Peter Christen
f9fc5cfaba
better check for bad urls in url transmission
12 years ago
Michael Peter Christen
d39463a85c
added deleteByQuery to solr connectors
12 years ago
Michael Peter Christen
0cab06c47c
refactoring
12 years ago
Michael Peter Christen
bf55f69176
removed write methods to old metadata file type; all metadata now goes
...
to solr
12 years ago
Michael Peter Christen
40c0856489
refactoring
12 years ago
Michael Peter Christen
2ccf1dba71
upgrade to solr 3.6.1
12 years ago
Michael Peter Christen
e651d3e320
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
Michael Peter Christen
06a78eecb7
code simplification
12 years ago
Michael Peter Christen
54bea21c02
bugfix for solr connector, possibly a cause for
...
http://forum.yacy-websuche.de/viewtopic.php?p=26893#p26893
12 years ago
Michael Peter Christen
9bece5ac5f
enhanced snippet fetch - removed a bug that caused documents to be
...
parsed even if a solr text was available
12 years ago
cominch
8a91f4fa42
local robots.txt: disallow external crawlers to follow the URL proxy
12 years ago
Michael Peter Christen
18f989dfb1
- refactoring (load -> getMetadata)
...
- added getDocument to retrieve Solr documents which shall replace
getMetadata
12 years ago
Michael Peter Christen
395b78a0d8
using the solr search index to concurrently search within solr and the
...
rwis during local search requests.
12 years ago
Michael Peter Christen
6197caf698
added clear-text search words in query params
12 years ago
Michael Peter Christen
efafa79db5
- added a content-encoding: gzip to streamed http server responses
...
- finish and close streamed http responses immediately
- this applies only to the solr interface which should be much faster
now!
12 years ago
Michael Peter Christen
23226676c6
FOR THE BRAVE.. this is a forced migration to solr which is now ready
...
for production as a replacement of the metadata-db.
This intermediate release 1.041 will switch on the previously optional
solr index and the old metadata-db will still work as it did before.
Solr+metadata are accessed in mixed mode, no migration is done yet.
If this causes not a catastrophe until the end of the weekend, we will
do a YaCy 1.1 main release containing this as default.
12 years ago