You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen 075b6f9278
refactoring of the crawl balancer: the balancer is turned into an
11 years ago
..
data refactoring of the crawl balancer: the balancer is turned into an 11 years ago
retrieval fix for wrong status codes of error pages 11 years ago
robots also delete the robots.txt file from the cache when a new crawl is 11 years ago
Balancer.java refactoring of the crawl balancer: the balancer is turned into an 11 years ago
CrawlStacker.java fix for bad/missing values of size_i 11 years ago
CrawlSwitchboard.java enhanced concurrent loading by using a fixed set of concurrent loader 11 years ago
HarvestProcess.java fix for wrong display of error urls in HostBrowser 12 years ago
HostQueue.java - removed old metadata database and all migration code 11 years ago
HostQueues.java Added new data structure to be used by the balancer (not used yet). 12 years ago
LegacyBalancer.java refactoring of the crawl balancer: the balancer is turned into an 11 years ago