You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen 1bf605b6d1
toString() fix
10 years ago
..
data changed handling of crawl profile field crawlingIfOlder: this should be 10 years ago
retrieval added an option to set 'obey nofollow' for links with rel="nofollow" 10 years ago
robots toString() fix 10 years ago
Balancer.java - added a new Crawler Balancer: HostBalancer and HostQueues: 11 years ago
CrawlStacker.java refactoring (change Metadata name of load time data structure to avoid 10 years ago
CrawlSwitchboard.java changed handling of crawl profile field crawlingIfOlder: this should be 10 years ago
HarvestProcess.java
HostBalancer.java enhanced crawler host round-robin strategy 11 years ago
HostQueue.java Crawler hostbalancer does not delete finished queue files, 11 years ago
LegacyBalancer.java special strategy for balancer: do not remove targets with zero wait time 11 years ago