Michael Peter Christen
8556a3d521
extended solr connector with a method to retrieve a single facet.
12 years ago
Michael Peter Christen
d0015df61c
added lucene memory library which is now necessary as solr has to
...
process more complex queries
12 years ago
Michael Peter Christen
80edd8ecd7
some more after-refactoring fixes
12 years ago
Michael Peter Christen
816cb6ce93
another fix for the debian installer: the installer fails because some
...
classes had unresolved dependencies. This fix removes the dependencies.
12 years ago
Michael Peter Christen
c461c28c5d
fix for debian package installation (caused by refactoring)
12 years ago
Michael Peter Christen
280e36c90b
allow Cross-Origin Resource Sharing for all stream servlets, that is the
...
solr and the gsa search interface. That means that all JavaScript in
browsers now can Cross-Origin access all YaCy search interfaces, which
opens the option of 'YaCy Client in Browser' and 'End-Point Fail-over'
concepts.
12 years ago
Michael Peter Christen
ccd65ecf8d
fixed url search in IndexControlURLs_p.html / using now the solr
...
interface
12 years ago
Michael Peter Christen
016ffa7434
increased strength of crawling waves in network image
12 years ago
Michael Peter Christen
23f68f2a69
force usage of default faceting mechanisms for search
12 years ago
Michael Peter Christen
24d2ee3c52
- better date ranking
...
- more protection against NPE and time travel effects
12 years ago
Michael Peter Christen
ca313e404f
- if a "/date" modifier is used, the solr remote query applies an
...
ordering by date (ascending)
- added also some 'anti-timetravel' protection (check if date is in the
future within any metadata date field)
12 years ago
Michael Peter Christen
a4214694df
We assert that no other metadata storage than solr is used now.
...
Therefore a property like solrConnected() must be true all the time.
Removal of this method causes removal of all write operations to the old
metadata index.
12 years ago
Michael Peter Christen
abab291162
made the index schema retrieval public and allow cross-domain retrieval
12 years ago
Michael Peter Christen
0cec7e761a
enhanced snippet extractor to find snippets also inside of tokens of an
...
url
12 years ago
sixcooler
c65b576a6f
added filename for missing crawlname when crawling from file
12 years ago
sixcooler
6c50d016ed
pdf- and zipParser should not use forced Memory-Limits
12 years ago
Michael Peter Christen
562183932b
- removed ip_s from default profile since that needs a DNS lookup to
...
create an document entry. This makes remote search much slower.
- removed synchronization of add method if ip_s is activated to prevent
that a user configuration causes bad behavior. The disadvantage of that
is, that a index dump can cause data loss if an indexing is running
during index dump
- catched more exceptions and more NPE
- better abstraction in MirrorSolrConnector
- slight performance enhancement when only the index count is requested
(rows=0 is sufficient to get a total count)
12 years ago
Michael Peter Christen
24f4ca4d85
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
apfelmaennchen
7efe9eb37b
adding CORS access header for Network.xml to overcome cross domain
...
restriction (e.g. necessary to build a JavaScript YaCy
client).
12 years ago
apfelmaennchen
116f429e35
fix for java.lang.RuntimeException: TableColumnIndex not available...
12 years ago
Michael Peter Christen
5ac61591f3
better abstraction for solr query params
12 years ago
Michael Peter Christen
c913b2ba77
- fix for NPEs during remote solr configuration
...
- fixed remote solr setting switch
- added more logging
12 years ago
Michael Peter Christen
b5192e03d7
fixed bad output in stopYACY.sh
12 years ago
Michael Peter Christen
882d54067a
added dummy update servlet
12 years ago
Michael Peter Christen
1533bfd63b
refactoring
12 years ago
Michael Peter Christen
e49359cc95
removed tenant query attribute since it is not used any more and is
...
replaced by the site-operator in the GSA interface. This operator can
also be simulated in the Solr interface using the collections_sxt field.
12 years ago
Michael Peter Christen
872f83ebe0
refactoring
12 years ago
Michael Peter Christen
fb9460f0a8
using the search filter to drill down search to file types.
...
A search like "mp3 filetype:mp3" will now maybe surprise you.
12 years ago
Michael Peter Christen
bc865ab816
more cleaning (yacy-cora)
12 years ago
Michael Peter Christen
640339ee21
added the indexrestore.sh script which must be called with the path of
...
the index dump. This is the reverse of indexdump.sh which takes the
output of indexdump.sh as input to restore an index.
Now it should be possible to transfer a complete YaCy Solr index from
one peer yacy1 to another peer yacy2 with the following command:
yacy2/bin/indexrestore.sh ´yacy1/bin/indexdump.sh´
12 years ago
Michael Peter Christen
15ea053c3a
- added xml output in IndexControlURLs to get the storage page of index
...
dump commands
- adjusted the apicall.sh script to get the downloaded text as output to
stdout which is necessary to parse the content out of it
- added indexdump.sh script which creates a solr dump and prints out the
storage path for the index dump
- added synchronization to the Fulltext class to prevent that data is
stored to a non-existing solr index while this index is disabled during
the storage of the dump
12 years ago
Michael Peter Christen
1b474139dd
used the new zip writer/reader to add a solr dump process: the whole
...
solr index can be written to a zip dump and also restored during runtime
12 years ago
Michael Peter Christen
4a3e684f8c
added a directory-to-zip writer and zip-to-directory reader
12 years ago
Michael Peter Christen
d9ebf4a40f
a bit more logging
12 years ago
Michael Peter Christen
5683162bd3
simplifications in DHT Distribution class and more documentation
12 years ago
Michael Peter Christen
e57bf2ca39
simplified DHT classes
12 years ago
orbiter
a053b356ee
added new classes to renovate the YaCy protocol based on simple data
...
structures in cora:
- added the Peer object, which is a fresh version of Seed
- added the Peers object, which is a fresh version of Network
- added the Network api access class to retrieve a list of peers based
on the Network.xml servlet in all YaCy peers.
12 years ago
orbiter
14897d4bfc
fixed mistake in wt-option which caused that the yacy json format
...
overlapped the solr built-in json format
12 years ago
Michael Peter Christen
8219a445f3
refactoring
12 years ago
Michael Peter Christen
f879a344e7
fix for no depth limit default value
12 years ago
Michael Peter Christen
fa7f6f0be8
added HostBrowser servlet (stub)
12 years ago
Michael Peter Christen
00c1c777fa
refactoring
12 years ago
orbiter
563d584420
removed more dependencies in cora from kelondro
12 years ago
orbiter
aa65282259
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
orbiter
63762d8f89
removed kelondro dependencies from cora
12 years ago
orbiter
39564fddbd
more ignore
12 years ago
orbiter
6e0f4557f8
added ftp to getName
12 years ago
cominch
23204d2245
change parameter to support the smw extension for list import
12 years ago
Michael Peter Christen
c235d5c0f1
fixed size parsing in RSS message parser (for YaCy size parameter)
12 years ago
orbiter
089a03114e
full memory usage for debian and when changing the size: debian seems to
...
dislike the big difference between xmx and xms (I have crashes here
which stop if both values are same)
12 years ago