You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
reger c50e23c495
reduce creation of empty legacy RequestHeader() in situation where null
8 years ago
..
data adjust Cache getHeader to prev. changes/commit 8 years ago
retrieval reduce creation of empty legacy RequestHeader() in situation where null 8 years ago
robots Added control over Robots.txt active threads maximum number. 8 years ago
Balancer.java
CrawlStacker.java expanded error message on rejected crawl url due to faile dns lookup 8 years ago
CrawlStarterFromSraper.java
CrawlSwitchboard.java
FileCrawlStarterTask.java Crawl from local file : faster task end when manually terminating crawl. 8 years ago
HarvestProcess.java
HostBalancer.java Customized name for Threads still using the default "Thread-n" pattern. 8 years ago
HostQueue.java
IllegalCrawlProfileException.java Crawl from local file : faster task end when manually terminating crawl. 8 years ago
LegacyBalancer.java
RecrawlBusyThread.java