You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen 025516f682
fix for crawl limit for number of pages fail
11 years ago
..
data fix for subpath crawl filter 11 years ago
retrieval fixes and speed updates for search process 11 years ago
robots do not store failure of loading of robots.txt into the index as a fail 11 years ago
Balancer.java - added a new Crawler Balancer: HostBalancer and HostQueues: 11 years ago
CrawlStacker.java fix for crawl limit for number of pages fail 11 years ago
CrawlSwitchboard.java added option to reverse-sort YaCy tables (internal API change only) 11 years ago
HarvestProcess.java fix for wrong display of error urls in HostBrowser 12 years ago
HostBalancer.java addon to latest fix 11 years ago
HostQueue.java fix for crawl limit for number of pages fail 11 years ago
LegacyBalancer.java special strategy for balancer: do not remove targets with zero wait time 11 years ago