You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 0b6566a389 optimizations when starting large crawl requests with many start urls in ... one request: - allow larger match-fields in html interface - delete all host hashes at once from zurl - when deleting by host, do not count size of deleted entries since that was the reason it took so long		12 years ago
..
data	optimizations when starting large crawl requests with many start urls in	12 years ago
retrieval	small sanitary fixes	12 years ago
robots	fix for wrong robots.txt loading for https protocol	12 years ago
Balancer.java	fix for smb crawl situation (lost too many urls)	12 years ago
CrawlStacker.java	fix for smb crawl situation (lost too many urls)	12 years ago
CrawlSwitchboard.java	added separate delete commands for the local+remote solr index, the old	12 years ago
HarvestProcess.java	fix for wrong display of error urls in HostBrowser	12 years ago