You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen a34e137e27 fix for citation index generation in case that entry.referrerhash() is ... null. This is especially the case if ftp sites are crawled		12 years ago
..
data	added a crawl option to obey html-meta-robots-noindex. This is on by	12 years ago
retrieval	added url_file_name_s in default collection schema for the file name	12 years ago
robots	reduced locking situation in crawler: shifted synchronized location and	12 years ago
Balancer.java	hack to prevent long waiting times in crawler	12 years ago
CrawlStacker.java	fix for citation index generation in case that entry.referrerhash() is	12 years ago
CrawlSwitchboard.java	re-enable saved setting for proxy-crawl-profile	12 years ago
HarvestProcess.java	fix for wrong display of error urls in HostBrowser	12 years ago