You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
sgaebel fc03c4b4fe
removes some warning and unused objects
4 years ago
..
data replaced json library from JSON.org with libandroid-json-java 5 years ago
retrieval Added new crawler attribute for finer control over Media Type detection 6 years ago
robots Small perf improvement : initialize threads names early when possible 7 years ago
Balancer.java Fixed display of crawler pending URLs counts in HostBrowser.html page. 8 years ago
CrawlStacker.java removes some warning and unused objects 4 years ago
CrawlStarterFromScraper.java Updated a license header typo. 7 years ago
CrawlSwitchboard.java Do not block whole server startup on persisted crawl profile load error 7 years ago
FileCrawlStarterTask.java removed transformer 7 years ago
HarvestProcess.java
HostBalancer.java Fixed NullPointerException case on malformed crawl queue folder name 6 years ago
HostQueue.java Fixed crawl queue folder naming for IPv6 hosts on MS Windows filesystems 6 years ago
IllegalCrawlProfileException.java Crawl from local file : faster task end when manually terminating crawl. 8 years ago
LegacyBalancer.java use supplied url port to get robots.txt in crawlers hostqueue 9 years ago
RecrawlBusyThread.java fixes deleting during recrawl 4 years ago