You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler/data
reger 379e9b330d
use supplied url port to get robots.txt in crawlers hostqueue
9 years ago
..
Cache.java try a healing of the cache if the index file is corrupted 9 years ago
CrawlProfile.java fix for filesystem crawl 9 years ago
CrawlQueues.java Add the Autocrawl thread 9 years ago
Latency.java use supplied url port to get robots.txt in crawlers hostqueue 9 years ago
NoticedURL.java Init remote crawler on demand 10 years ago
ResultImages.java fix for image alt attachment to AnchorURLs in html parser. 10 years ago
ResultURLs.java added a new way of content browsing in search results: 10 years ago
Snapshots.java enhanced timezone managament for indexed data: 10 years ago
Transactions.java added link to Snapshots in search results if the snapshot exists and 10 years ago