You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 001e05bb80 do not store failure of loading of robots.txt into the index as a fail ... document		11 years ago
..
data	fix for image alt attachment to AnchorURLs in html parser.	11 years ago
retrieval	…
robots	do not store failure of loading of robots.txt into the index as a fail	11 years ago
Balancer.java	…
CrawlStacker.java	…
CrawlSwitchboard.java	…
HarvestProcess.java	…
HostBalancer.java	…
HostQueue.java	…
LegacyBalancer.java	special strategy for balancer: do not remove targets with zero wait time	11 years ago