You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

sixcooler 9551720d5c re-enable saved setting for proxy-crawl-profile		12 years ago
..
data	added a crawl option to obey html-meta-robots-noindex. This is on by	12 years ago
retrieval	added url_file_name_s in default collection schema for the file name	12 years ago
robots	reduced locking situation in crawler: shifted synchronized location and	12 years ago
Balancer.java	hack to prevent long waiting times in crawler	12 years ago
CrawlStacker.java	added a crawl option to obey html-meta-robots-noindex. This is on by	12 years ago
CrawlSwitchboard.java	re-enable saved setting for proxy-crawl-profile	12 years ago
HarvestProcess.java	fix for wrong display of error urls in HostBrowser	13 years ago