You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen 030d0776ff
Enhanced crawl start for very, very large crawl lists (i.e. > 5000)
11 years ago
..
data fix for mustmatch regex computation: result had correct semantic, but 11 years ago
retrieval fix NPE on modified since check ( Response.requestHeader allowed to be null) 11 years ago
robots added concurrency for mass crawl check 11 years ago
Balancer.java self-healing of mistakenly deactivated crawl profiles. This fixes a bug 11 years ago
CrawlStacker.java Enhanced crawl start for very, very large crawl lists (i.e. > 5000) 11 years ago
CrawlSwitchboard.java enhanced postprocessing: fixed bugs, enable proper postprocessing also 11 years ago
HarvestProcess.java fix for wrong display of error urls in HostBrowser 12 years ago
HostQueue.java Added new data structure to be used by the balancer (not used yet). 11 years ago
HostQueues.java Added new data structure to be used by the balancer (not used yet). 11 years ago