90b47e83e6
fixed shutdown error when closing solr connectors
11 years ago
7640834b37
removed double concurrency to put Solr documents into the index. The
...
writings to the solr index are also buffered in
ConcurrentUpdateSolrConnector
11 years ago
99635e15b4
fix for switching 'simulate short memory status' and 'Memory Strategy'
...
thx Thomas
11 years ago
0f6b72f24b
do not use luke requests for remote solr servers if the result is
...
different from normal requests. This happens if the remote solr is
actually a solrCloud; in such cases the luke request returns only the
result of the single solr peer, not the whole cloud.
also done: some refactoring.
11 years ago
18a56446ce
reorg URL test classes add isLocal test with some IPv6 examples
...
- putting in default location and clean old package names
- add some valid RFC IPv6 sample urls (which don't pass the isLocal test)
11 years ago
f1a395ed46
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
11 years ago
95ea6ebb18
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
c89412af69
edit russian locale
11 years ago
c57026e242
recover from OOM
11 years ago
907db8b7a6
fix for bad query shortcut hack
11 years ago
a2b66fe2eb
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
9f6be762a6
- better logging for postprocessing
...
- fixed collection bug in postprocessing
11 years ago
de8f7994ab
as crawling has a low-cpu demand, we want it to run even if the CPU load
...
is VERY high. This applies also if the CPU load is high because of
in-cache crawling; in that case we want to experience a high-CPU load as
much as possible
11 years ago
d8e79731df
fixed wrong used memory display
11 years ago
da5d4128bf
prevent npe
11 years ago
a878c7982c
prevent npe
11 years ago
e4eb87d924
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
ced1a96f9c
fixed error cache
11 years ago
3ba81bd08a
Merge origin/master
11 years ago
4d896383db
fix: use timeout = proxy.ClientTimeout in ProxyHandler
...
(was 10sec fix) see http://bugs.yacy.net/view.php?id=236
11 years ago
072d4aa0c0
Updated German translation and Blacklist_p.html
11 years ago
163cbceca5
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
cfb647db6e
- introduced a miss cache in ConcurrentUpdateSolrConnector
...
- better usage of cache
- bugfix for postprocessing
11 years ago
2c8c51ce4b
make use of new -config cmd-line parameter in reconfgureYACY.sh
...
to asure pwd encoding is compatible with DIGEST auth. in future.
11 years ago
a87d8e4a8e
changed caching of ConcurrentUpdateSolrConnector: it caches now also the
...
url along with the load date. While this takes much more memory, it
eliminates database lookups for getURL() requests, which happen equally
often. This speeds up remote solr configurations.
11 years ago
f6e441dd77
refactoring
11 years ago
76c53faeb2
removed unused code (HostStat)
11 years ago
d3a88eaecb
introducing ConcurrentUpdateSolrServer for remote solr servers.
...
Scaling of write buffers and update queue size is made according to
assigned memory.
11 years ago
c3f6c06f2c
removed host increment on stored documents from crawler (that was wrong)
11 years ago
f97428fe5d
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
746aa32ad5
edit russian locale
11 years ago
809e976578
remove unused java imports form yacy.java
11 years ago
a9b06f8719
add a -config command line parameter e.g. -config "port=9090" "port.ssl=8043"
...
- useful for remote installation to set any config file property
- multipe parameter can be set at once, on Windows enclose parameter in doublequotes
- special handling "adminAccount=adminuser:adminpwd" sets adminusername and md5 encoded admin-pwd
- adjusted windows startbatch to allow command line parameter handling
- remove not needed classpath calculation from startYACY_debug.bat
11 years ago
edc8e1c4de
Finished translation of changed CrawlStartExpert_p.html
11 years ago
0923b09216
fix: allow 4 character admin user name
...
(was min 5 char)
11 years ago
7253ca4607
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
f8f0f6363d
edit russian locale
11 years ago
a86c2fe77d
fixed usage of media flag when started by automated process
11 years ago
254a7ac66c
fixed cleaning of index
11 years ago
28a7b42e6b
removed warning "sun.misc.BASE64Encoder is internal proprietary API and
...
may be removed in a future release"
11 years ago
046f5a03cb
one more SolrIndexSearcher bugfix
11 years ago
78c01b3eff
fix for 'AlreadyClosedException: this IndexReader is closed'
11 years ago
f11314aae7
Improved German de.lng translation and fixed adresses -> addresses in \htroot\CrawlStartScanner_p.html
11 years ago
f0eec6d0f3
Merge branch 'master' of git://gitorious.org/~copro/yacy/copros-rc1
11 years ago
1b5e3d523a
better control over close-state of remote solr connections
11 years ago
6278af4993
Edit German de locale and improved translation
11 years ago
1a364572a5
fix for
...
"org.apache.solr.core.SolrCore Too many close [count:-1] on
org.apache.solr.core.SolrCore@51af7c57"
-error
11 years ago
69391e5d9e
changed strategy to test existence of documents in Solr: using the
...
update time. The reason for that is a better caching for the crawler
double-check, which needs the update time for crawler steering.
11 years ago
790f103f32
delete fail-docs during postprocessing to prevent that they will appear
...
again and stay in postprocessing forever.
11 years ago
745d6d1c64
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
11 years ago
Michael Peter Christen