You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

luccioman 46f37e38dc Customized Threads with generic name for easier monitoring.		7 years ago
..
data	Added HT Cache basic statistics (hit rate)	8 years ago
retrieval	Support parsing gzip files from servers with redundant headers.	8 years ago
robots	Use unredirected robots.txt URL when adding an entry to the table.	8 years ago
Balancer.java	Fixed display of crawler pending URLs counts in HostBrowser.html page.	8 years ago
CrawlStacker.java	Factored code re-implementing DigestURL.hosthash() method.	8 years ago
CrawlStarterFromScraper.java	Updated a license header typo.	7 years ago
CrawlSwitchboard.java	remove wrong log line in CrawlSwitchboard	9 years ago
FileCrawlStarterTask.java	fix typo	7 years ago
HarvestProcess.java	fix for wrong display of error urls in HostBrowser	12 years ago
HostBalancer.java	Fixed display of crawler pending URLs counts in HostBrowser.html page.	8 years ago
HostQueue.java	to prevent crawler to concurrently access and alter same crawl queue	9 years ago
IllegalCrawlProfileException.java	Crawl from local file : faster task end when manually terminating crawl.	8 years ago
LegacyBalancer.java	use supplied url port to get robots.txt in crawlers hostqueue	9 years ago
RecrawlBusyThread.java	Customized Threads with generic name for easier monitoring.	7 years ago