You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen eca9380e3d bugfix for crawler double-check: if an url is redirected, the ... redirect-target was not double-checked. This is now done by replacing the redirect-URL on the crawl queue again (where it is double-checked)		11 years ago
..
data	…
retrieval	bugfix for crawler double-check: if an url is redirected, the	11 years ago
robots	…
Balancer.java	…
CrawlStacker.java	bugfix for crawler double-check: if an url is redirected, the	11 years ago
CrawlSwitchboard.java	…
HarvestProcess.java	…
HostBalancer.java	…
HostQueue.java	…
LegacyBalancer.java	…