0d2342575e
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
11 years ago
3cc5c0ffdd
a concurrency enhancement which was not used because tests showed worse
...
indexing speed. I leave the code there since it may be useful in
SolrCloud environments.
11 years ago
e644981697
added one more postprocessing low memory check
11 years ago
1bbc0fe6d2
added a properties file format for the status_p api to support reading
...
of that information with the java Properties class (very easy for small
clients)
11 years ago
e40511f307
extended the status_p api with disk space information
11 years ago
5e645f4449
Merge origin/master
11 years ago
3b89176b9f
use config value htroot in Jetty init (was hardcoded)
...
- move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler
- use SwitchboardConstant.htroot where appropriate
11 years ago
e1bf65c892
added short memory protection during postprocessing
11 years ago
90b47e83e6
fixed shutdown error when closing solr connectors
11 years ago
7640834b37
removed double concurrency to put Solr documents into the index. The
...
writings to the solr index are also buffered in
ConcurrentUpdateSolrConnector
11 years ago
99635e15b4
fix for switching 'simulate short memory status' and 'Memory Strategy'
...
thx Thomas
11 years ago
0f6b72f24b
do not use luke requests for remote solr servers if the result is
...
different from normal requests. This happens if the remote solr is
actually a solrCloud; in such cases the luke request returns only the
result of the single solr peer, not the whole cloud.
also done: some refactoring.
11 years ago
18a56446ce
reorg URL test classes add isLocal test with some IPv6 examples
...
- putting in default location and clean old package names
- add some valid RFC IPv6 sample urls (which don't pass the isLocal test)
11 years ago
f1a395ed46
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
11 years ago
95ea6ebb18
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
c89412af69
edit russian locale
11 years ago
c57026e242
recover from OOM
11 years ago
907db8b7a6
fix for bad query shortcut hack
11 years ago
a2b66fe2eb
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
9f6be762a6
- better logging for postprocessing
...
- fixed collection bug in postprocessing
11 years ago
de8f7994ab
as crawling has a low-cpu demand, we want it to run even if the CPU load
...
is VERY high. This applies also if the CPU load is high because of
in-cache crawling; in that case we want to experience a high-CPU load as
much as possible
11 years ago
d8e79731df
fixed wrong used memory display
11 years ago
da5d4128bf
prevent npe
11 years ago
a878c7982c
prevent npe
11 years ago
e4eb87d924
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
ced1a96f9c
fixed error cache
11 years ago
3ba81bd08a
Merge origin/master
11 years ago
4d896383db
fix: use timeout = proxy.ClientTimeout in ProxyHandler
...
(was 10sec fix) see http://bugs.yacy.net/view.php?id=236
11 years ago
072d4aa0c0
Updated German translation and Blacklist_p.html
11 years ago
163cbceca5
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
cfb647db6e
- introduced a miss cache in ConcurrentUpdateSolrConnector
...
- better usage of cache
- bugfix for postprocessing
11 years ago
2c8c51ce4b
make use of new -config cmd-line parameter in reconfgureYACY.sh
...
to asure pwd encoding is compatible with DIGEST auth. in future.
11 years ago
a87d8e4a8e
changed caching of ConcurrentUpdateSolrConnector: it caches now also the
...
url along with the load date. While this takes much more memory, it
eliminates database lookups for getURL() requests, which happen equally
often. This speeds up remote solr configurations.
11 years ago
f6e441dd77
refactoring
11 years ago
76c53faeb2
removed unused code (HostStat)
11 years ago
d3a88eaecb
introducing ConcurrentUpdateSolrServer for remote solr servers.
...
Scaling of write buffers and update queue size is made according to
assigned memory.
11 years ago
c3f6c06f2c
removed host increment on stored documents from crawler (that was wrong)
11 years ago
f97428fe5d
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
746aa32ad5
edit russian locale
11 years ago
809e976578
remove unused java imports form yacy.java
11 years ago
a9b06f8719
add a -config command line parameter e.g. -config "port=9090" "port.ssl=8043"
...
- useful for remote installation to set any config file property
- multipe parameter can be set at once, on Windows enclose parameter in doublequotes
- special handling "adminAccount=adminuser:adminpwd" sets adminusername and md5 encoded admin-pwd
- adjusted windows startbatch to allow command line parameter handling
- remove not needed classpath calculation from startYACY_debug.bat
11 years ago
edc8e1c4de
Finished translation of changed CrawlStartExpert_p.html
11 years ago
0923b09216
fix: allow 4 character admin user name
...
(was min 5 char)
11 years ago
7253ca4607
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
f8f0f6363d
edit russian locale
11 years ago
a86c2fe77d
fixed usage of media flag when started by automated process
11 years ago
254a7ac66c
fixed cleaning of index
11 years ago
28a7b42e6b
removed warning "sun.misc.BASE64Encoder is internal proprietary API and
...
may be removed in a future release"
11 years ago
046f5a03cb
one more SolrIndexSearcher bugfix
11 years ago
78c01b3eff
fix for 'AlreadyClosedException: this IndexReader is closed'
11 years ago
Michael Peter Christen