You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen ebd0be2cea
fixes and speed updates for search process
11 years ago
..
data fix for subpath crawl filter 11 years ago
retrieval fixes and speed updates for search process 11 years ago
robots do not store failure of loading of robots.txt into the index as a fail 11 years ago
Balancer.java - added a new Crawler Balancer: HostBalancer and HostQueues: 11 years ago
CrawlStacker.java changed method to write the citation index: do not catch up references 11 years ago
CrawlSwitchboard.java typo 11 years ago
HarvestProcess.java fix for wrong display of error urls in HostBrowser 12 years ago
HostBalancer.java addon to latest fix 11 years ago
HostQueue.java fix for malformed hostpath names in crawl balancer 11 years ago
LegacyBalancer.java special strategy for balancer: do not remove targets with zero wait time 11 years ago