You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

reger 7789c32c82 delete crawl queue on init exception ... (happens occasionally on path name vaiolation and will never get resolved)		9 years ago
..
data	use supplied url port to get robots.txt in crawlers hostqueue	9 years ago
retrieval	result heuristic (also used in greedy learning mode) to use outbound links if result is full index doc. Otherwise use default loader methode.	9 years ago
robots	…
Balancer.java	…
CrawlStacker.java	…
CrawlSwitchboard.java	…
HarvestProcess.java	…
HostBalancer.java	delete crawl queue on init exception	9 years ago
HostQueue.java	delete crawl queue on init exception	9 years ago
LegacyBalancer.java	use supplied url port to get robots.txt in crawlers hostqueue	9 years ago
RecrawlBusyThread.java	…