ca8b100f96
run the cleanup process even when load is high, do postprocessing even
...
if load > 1 (but < 2) but only if there is enough memory (now: 0.5 GB
RAM available). The memory amount of the postprocessing is the cause
that systems block because they run into a frequent-GC chain which
almost locks the peer. If running with enough memory, the postprocessing
is fast and not damaging to the system.
Because the required RAM of 0.5 GB is never available in default
setting, the postprocessing will not run if the peer is not reconfigured
to use more memory.
11 years ago
195e5868d3
catch solr close exceptions
11 years ago
751c128544
extra sleep for remote searches enhances search results because there is
...
more time for more remote peers to contribute on the first result page
11 years ago
0cabcbbe83
more efficient wordcount
11 years ago
3d474a843e
added memory protection for postprocessing
11 years ago
412d55523c
enhanced memory protection and OOM exception handling in Solr connector
11 years ago
d9858e1b8a
removed warnings and superfluous logging
11 years ago
acc8d7faa7
fixed setting of shortMemoryStatus in MemoryControl
11 years ago
94245ce0a8
fixed "Size in KBytes" calculation in PerformanceQueues_p.html,
...
see http://bugs.yacy.net/view.php?id=362
11 years ago
726e8c3ad5
removed unused classes and servlets
11 years ago
6e59ca4ebf
removed jena library and all code that depended on jena. When jena was
...
introduced, it was also used for search facets. The generic search
facets are now deduced from generic solr fields which makes jena as tool
for facet semantics superfluous.
11 years ago
9228214f9b
enrichment of PerformanceMemory display of SolrInfoMBean table
11 years ago
e8bdf16ea7
added statistic information for solr resources in PerformanceMemory
11 years ago
931541d198
re-inserted default value re-set button to performance queues and
...
patched missing values for recent new queues
11 years ago
456e52e0d5
enhanced strategy to clear solr caches
...
- redesigned the instance mirror class (which was a mess)
- added final method to close a searcher (which otherwise keeps a cache)
- changed cache clear method which iterates over resources and calls
clear to all caches in the searcher resources
11 years ago
bd1685c94a
fix not needed getFileExtension().toLower (double)
...
add missing .getFileExtension
11 years ago
a11f072504
enhanced didyoumean
11 years ago
c0e6a65ec3
enhanced didyoumean
11 years ago
6d2dab7b21
fixed 'resource leak' warning
11 years ago
22e3524797
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
c40ba51ca6
added new suggest method which replaces more-than-one suggestions:
...
instead of computing suggest permutations of the given words, the
completion of a phrase using the given words is searched in the fulltext
index.
11 years ago
ad4b213145
remove unused static var from HTTPDProxyHandler
11 years ago
b693ce9759
allow combining selection of different search nav's (facets)
...
- selecting more than one nav combines the 2 selections (with AND)
- unselecting one nav clears all selected
(e.g. select filetype:pdf and /language/fr shows ~ french pdf's only)
11 years ago
cb71413d19
fix page nav, to keeping modifier
...
(was new issue)
11 years ago
416481c33e
added a boost on appearance of combined words (in the same order the
...
user submitted that) when searching for more than one word
11 years ago
c589ee8c6e
URLproxy access check too tight
...
respect config ip pattern (was own ip)
11 years ago
ebfaf753b7
- faster initialization of index files
...
- removal of not used space if index files shrink (rare, but possible)
11 years ago
d2b8f2b477
enhancements for staticIP and ipv6 handling
11 years ago
a71718a459
add config value for ssl/https port (default=8443)
...
adjust server routines to use config
11 years ago
a3e2cca8e9
improve isOlder check to not overwrite node index with metadata on equal load date
11 years ago
9b24dae2b7
add language navigation filter clause to rwi results
11 years ago
f307d65dcf
prepare for a language navigator
...
works fine to restrict language for local solrSearches.
More work needs to be done to make rwi/remote searches respect the modifier.language restriction.
11 years ago
cf553e5045
added hint to web.xml and for completeness the full set of hardcoded mappings
11 years ago
c84bcc878a
first try to add a generic solr servlet as luke request servlet
11 years ago
4cb7e2a2ca
refactoring: renamed the SolrServlet to SolrSelectServlet for better
...
naming of more Solr Servlets
11 years ago
dc06e407ce
added two virtual instances of solr for the both cores: collection1 and
...
webgraph. These cores are now accessible at
/solr/collection1/select instead /solr/select?core=collection1
and
/solr/webgraph/select instead /solr/select?core=webgraph
in addition to the old behavior to support compatibility to the old
peers. These new paths are fully solr standard-conform and will allow
the cross-linking between YaCy peers using their public solr API.
11 years ago
8b14e92ba4
added button in host browser to re-load 404/failed documents
11 years ago
771d8261c1
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
c351e47a84
fix for bad-formatted lonlat
11 years ago
4c603b216e
optimize parse ServerSideInclude
11 years ago
5ec0c969c9
fix for http://bugs.yacy.net/view.php?id=354
11 years ago
0002abd583
fix for OOM during remote search and too high load protection
11 years ago
5a917e13c6
use less ram on dht-URL transfer by not using a URIMetadataNode[]
11 years ago
c87cdfca2e
do not set a load prerequisite that prevents the start of one-time-jobs
11 years ago
4d77ca52c9
workaround to let dht-out run on smal Systems like a Pi
11 years ago
6ada0daae9
making latency_factor and maximum number of same hosts in loader queue
...
settings available in Crawler_p.html servlet for steering.
11 years ago
489c3fbc90
code simplifications / removed warnings
11 years ago
0168f80c28
new crawling factors can now be changed during runtime
11 years ago
be5e808236
- removed hardcoded load-test which is now handled in BusyQueues
...
steering, see /PerformanceQueues_p.html
- changed default values for crawler queue load limit (high, because
these jobs are started upon user request)
11 years ago
40a4030b55
configurable max-load values for YaCy-Threads:
...
try lower values on smal systems like a Pi
11 years ago
Michael Peter Christen