You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 9fcd8f1bda added canonical filter ... attention: this is on by default! (it should do the right thing)		2 years ago
..
data	added canonical filter	2 years ago
retrieval	added canonical filter	2 years ago
robots	Various javadoc fixes	3 years ago
Balancer.java	Various javadoc fixes	3 years ago
CrawlStacker.java	added canonical filter	2 years ago
CrawlStarterFromScraper.java	adding SPDX license and copyright headers	4 years ago
CrawlSwitchboard.java	added canonical filter	2 years ago
FileCrawlStarterTask.java	adding SPDX license and copyright headers	4 years ago
HarvestProcess.java	adding SPDX license and copyright headers	4 years ago
HostBalancer.java	addressing/fixing some concurrency issues from	2 years ago
HostQueue.java	addressing/fixing some concurrency issues from	2 years ago
IllegalCrawlProfileException.java	adding SPDX license and copyright headers	4 years ago
LegacyBalancer.java	fixed missing thread name revert after balancer waiting	3 years ago
RecrawlBusyThread.java	added canonical filter	2 years ago