You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen bd3f2483a1
replaced url and date retrieval by only url retrieval
3 years ago
..
data enhanced crawler 4 years ago
retrieval replaced url and date retrieval by only url retrieval 3 years ago
robots enhanced crawler 4 years ago
Balancer.java enhanced crawler 4 years ago
CrawlStacker.java replaced url and date retrieval by only url retrieval 3 years ago
CrawlStarterFromScraper.java adding SPDX license and copyright headers 4 years ago
CrawlSwitchboard.java adding SPDX license and copyright headers 4 years ago
FileCrawlStarterTask.java adding SPDX license and copyright headers 4 years ago
HarvestProcess.java adding SPDX license and copyright headers 4 years ago
HostBalancer.java making sure that crawl queues are closed correctly to prevent data loss 3 years ago
HostQueue.java making sure that crawl queues are closed correctly to prevent data loss 3 years ago
IllegalCrawlProfileException.java adding SPDX license and copyright headers 4 years ago
LegacyBalancer.java enhanced crawler 4 years ago
RecrawlBusyThread.java enhanced crawler 4 years ago