You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
Michael Christen 6e66c9d7f1
fix for http://bugs.yacy.net/view.php?id=87
13 years ago
..
retrieval fix for http://bugs.yacy.net/view.php?id=87 13 years ago
Balancer.java
CrawlProfile.java added an option in the bookmark import process to put everything into the crawler 13 years ago
CrawlQueues.java some last-minute performance hacks 13 years ago
CrawlStacker.java removed unnecessary log entries 13 years ago
CrawlSwitchboard.java - less automatic indexing after a search (needs to reset the default 13 years ago
ImporterException.java
Latency.java
NoticedURL.java
RSSLoader.java
ResourceObserver.java
ResultImages.java
ResultURLs.java
RobotsTxt.java produce a bookmark entry from every crawl start. these bookmarks are always private. 13 years ago
RobotsTxtEntry.java - enhanced logging in robots.txt parser for remote debugging 14 years ago
RobotsTxtParser.java fix for robot parser 14 years ago
SitemapImporter.java
ZURL.java