luccioman c1401d821e Adjusted crawl depth control for FTP crawl start URLs.		8 years ago
..
data	adjust Cache getHeader to prev. changes/commit	8 years ago
retrieval	reduce creation of empty legacy RequestHeader() in situation where null	8 years ago
robots	Added control over Robots.txt active threads maximum number.	8 years ago
Balancer.java	removed warnings	10 years ago
CrawlStacker.java	Adjusted crawl depth control for FTP crawl start URLs.	8 years ago
CrawlStarterFromSraper.java	Advanced Crawl from local file : better processing of large files.	9 years ago
CrawlSwitchboard.java	remove wrong log line in CrawlSwitchboard	9 years ago
FileCrawlStarterTask.java	Crawl from local file : faster task end when manually terminating crawl.	9 years ago
HarvestProcess.java	fix for wrong display of error urls in HostBrowser	12 years ago
HostBalancer.java	Customized name for Threads still using the default "Thread-n" pattern.	9 years ago
HostQueue.java	to prevent crawler to concurrently access and alter same crawl queue	9 years ago
IllegalCrawlProfileException.java	Crawl from local file : faster task end when manually terminating crawl.	9 years ago
LegacyBalancer.java	use supplied url port to get robots.txt in crawlers hostqueue	9 years ago
RecrawlBusyThread.java	init Recrawl job chunk size to max crawl loader during job start, to use some system preferences	10 years ago