You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
Michael Peter Christen e7e381d110
added configuration to switch off redirection following in crawler
13 years ago
..
retrieval added configuration to switch off redirection following in crawler 13 years ago
Balancer.java enhanced crawler/balancer: better remaining waiting-time guessing 13 years ago
Cache.java refactoring 13 years ago
CrawlProfile.java fixed default must-match filter for full domain crawls - the old filter 13 years ago
CrawlQueues.java fixed bug in solr error document 13 years ago
CrawlStacker.java Now used synchronization in all close() methods to make sure all objects 13 years ago
CrawlSwitchboard.java Now used synchronization in all close() methods to make sure all objects 13 years ago
ImporterException.java added final where possible 17 years ago
Latency.java enhanced crawler/balancer: better remaining waiting-time guessing 13 years ago
NoticedURL.java Now used synchronization in all close() methods to make sure all objects 13 years ago
RSSLoader.java refactoring: 14 years ago
ResourceObserver.java more logging in resource observer 13 years ago
ResultImages.java ConcurrentLinkedQueue has a VERY long return time on the .size() method. 13 years ago
ResultURLs.java Removed handling of components objects for URIMetadataRows. 13 years ago
RobotsTxt.java refactoring + parser bugfixes 13 years ago
RobotsTxtEntry.java - enhanced logging in robots.txt parser for remote debugging 13 years ago
RobotsTxtParser.java refactoring + parser bugfixes 13 years ago
SitemapImporter.java refactoring: 14 years ago
ZURL.java fixed bug in solr error document 13 years ago