ee01c12e56
fixes for putDocument and putMetadata
12 years ago
cc47a0876e
reverted bf55f69176
...
to have a fall-back option in case that memory problems as reported in
http://forum.yacy-websuche.de/viewtopic.php?p=26901#p26901
for full-solr installation are too strong and we have to work with an
'small memory footprint' peer system.
12 years ago
0904afe8fb
added concurrent iterator methods to the solr connectors
12 years ago
d54b80327a
refactoring
12 years ago
f9fc5cfaba
better check for bad urls in url transmission
12 years ago
d39463a85c
added deleteByQuery to solr connectors
12 years ago
0cab06c47c
refactoring
12 years ago
bf55f69176
removed write methods to old metadata file type; all metadata now goes
...
to solr
12 years ago
40c0856489
refactoring
12 years ago
2ccf1dba71
upgrade to solr 3.6.1
12 years ago
e651d3e320
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
06a78eecb7
code simplification
12 years ago
54bea21c02
bugfix for solr connector, possibly a cause for
...
http://forum.yacy-websuche.de/viewtopic.php?p=26893#p26893
12 years ago
9bece5ac5f
enhanced snippet fetch - removed a bug that caused documents to be
...
parsed even if a solr text was available
12 years ago
8a91f4fa42
local robots.txt: disallow external crawlers to follow the URL proxy
12 years ago
18f989dfb1
- refactoring (load -> getMetadata)
...
- added getDocument to retrieve Solr documents which shall replace
getMetadata
12 years ago
395b78a0d8
using the solr search index to concurrently search within solr and the
...
rwis during local search requests.
12 years ago
6197caf698
added clear-text search words in query params
12 years ago
efafa79db5
- added a content-encoding: gzip to streamed http server responses
...
- finish and close streamed http responses immediately
- this applies only to the solr interface which should be much faster
now!
12 years ago
23226676c6
FOR THE BRAVE.. this is a forced migration to solr which is now ready
...
for production as a replacement of the metadata-db.
This intermediate release 1.041 will switch on the previously optional
solr index and the old metadata-db will still work as it did before.
Solr+metadata are accessed in mixed mode, no migration is done yet.
If this causes not a catastrophe until the end of the weekend, we will
do a YaCy 1.1 main release containing this as default.
12 years ago
a1b2c9a67d
doctype2mime fix, influences metadata conversion between old metadata
...
and solr
12 years ago
7c31be1c80
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
6456a1656a
changed local robots.txt to prevent external crawlers to submit random
...
search queries
12 years ago
a16206e38b
more attempts to clean the index (cleaning is faster then)
12 years ago
703f427303
fixed some peer-ping connection details
...
- larger time-out
- removed too old seedlist
- fixed a bug in connection test
12 years ago
597bb76e4f
get the peer location more quickly
12 years ago
156d457aec
fix for Index out of bounds exception in Network servlet
12 years ago
da93addec3
addon to e74d66e28c
...
(removed htmlparser.jar): for Mac App
12 years ago
ae9cd7a118
fix xss bug #204
12 years ago
1641835fef
replaced yacy xml encoding by solr xml encoding
12 years ago
89fe13e73d
enhanced GSA and RSS output format: corrected date, added some missing
...
fields, added xml encoding for utf8
12 years ago
ea49a8aa8c
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
d988ba50cf
added a very rudimentary, incomplete, non-verified GSA response writer
...
for solr. Try this:
http://localhost:8090/gsa/searchresult?q=pdf&site=col1&num=10
12 years ago
aab0b680c3
- added xslt support for solr result formats.
...
try i.e.
http://localhost:8090/solr/select?q=*:*&start=0&rows=10&wt=xslt&tr=json.xsl
- added servlet-side mime-type configuration for streamed servlets. this
is used for the result formatters in solr result formats
12 years ago
e74d66e28c
augmented browsing: remove htmlparser library
12 years ago
e2119f4e76
augmented browsing: replace htmlparser by jsoup, which is more stable
...
and reliable
12 years ago
ad62609ec7
added a possibility to define a custom network definition URL for remote
...
management
12 years ago
fb0f430685
Merge remote-tracking branch 'original yacy/master'
12 years ago
9448d9a8a2
ups
12 years ago
e5ef840f40
- renamed DoubleSolrConnector to MirrorSolrConnector and added a
...
hit/miss/document cache to the MirrorSolrConnector.
- more abstraction to SolrDocument in Connector interface
- bugfixes in Solr field reader
12 years ago
94a334f128
another fix to the Solr metadata reading process and to the shutdown
...
process
12 years ago
b51df6c7e8
- added coordinate storage in solr schema
...
- fixed shutdown process
- fixed some solr-to-metadata reading
- added a large number of metadata attributes in ViewFile.html
12 years ago
da851c6071
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
bd4f03bc85
removed unused class
12 years ago
39f8eb60c3
tried to prevent calls to bad-hack getSize() method and reduced overhead
...
of that method a bit.
12 years ago
9b88433f45
patch from hint in
...
http://forum.yacy-websuche.de/viewtopic.php?p=26858#p26858
from gaston
12 years ago
e816b88b55
changed behaviour of metadata storage: in case that any solr is
...
attached, the metadata is not written to the metadata-db, even if it is
enabled but instead to solr. This prevents that metadata is written in
two store systems at the same time. It is also the next step to migrate
the current metadata-db to solr.
12 years ago
2571e0d47a
removed unused classes
12 years ago
f9c0e6e950
- Implemented and integrated the URIMetadataNode object which is a
...
metadata representation from the solr index. This shall replace metadata
from the built-in database in the future.
- added the Solr-driven metadata into the search index of YaCy which
makes it now possible to run YaCy without the old metadata index. This
is a major stept forward to a full migration to Solr.
12 years ago
b2b480fff2
more abstraction of the YaCySchema -> Opensearch matching process
12 years ago
orbiter