You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

reger ce87025462 further avoid to set connect info properties as header value ... following comment "use of properties as header values is discouraged" in case where (proxy)HTTPClient overwrites values with supplied url. Use defined request.referer procedure in response class.		8 years ago
..
data	Fixed display of crawler pending URLs counts in HostBrowser.html page.	8 years ago
retrieval	further avoid to set connect info properties as header value	8 years ago
robots	Added control over Robots.txt active threads maximum number.	8 years ago
Balancer.java	Fixed display of crawler pending URLs counts in HostBrowser.html page.	8 years ago
CrawlStacker.java	Factored code re-implementing DigestURL.hosthash() method.	8 years ago
CrawlStarterFromSraper.java	…
CrawlSwitchboard.java	…
FileCrawlStarterTask.java	Crawl from local file : faster task end when manually terminating crawl.	8 years ago
HarvestProcess.java	…
HostBalancer.java	Fixed display of crawler pending URLs counts in HostBrowser.html page.	8 years ago
HostQueue.java	…
IllegalCrawlProfileException.java	Crawl from local file : faster task end when manually terminating crawl.	8 years ago
LegacyBalancer.java	…
RecrawlBusyThread.java	…