You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
Michael Peter Christen 434ee90c59
added classification for control file types which shall not be loaded
13 years ago
..
retrieval cleaned unnecessary nested code 13 years ago
Balancer.java removed unused method parameters 13 years ago
Cache.java prevent loading of content from the cache when retrieval with IFFRESH is 13 years ago
CrawlProfile.java removed unused method parameters 13 years ago
CrawlQueues.java made class methods static where possible 13 years ago
CrawlStacker.java added classification for control file types which shall not be loaded 13 years ago
CrawlSwitchboard.java made class methods static where possible 13 years ago
ImporterException.java
Latency.java enhanced crawler/balancer: better remaining waiting-time guessing 13 years ago
NoticedURL.java made class methods static where possible 13 years ago
RSSLoader.java better integration of blacklist according to use case 13 years ago
ResourceObserver.java
ResultImages.java
ResultURLs.java ehanced location search: 13 years ago
RobotsTxt.java fixing redirects and status codes: storing of status code in 13 years ago
RobotsTxtEntry.java
RobotsTxtParser.java refactoring + parser bugfixes 13 years ago
SitemapImporter.java fix for sitemap importer: can now also import very large sitemaps within 13 years ago
ZURL.java added option to record urls that are forwarded to the solr index 13 years ago