You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
Michael Christen 22f05c83ff
fixed default must-match filter for full domain crawls - the old filter
13 years ago
..
retrieval Fixed a lot CHMOD rights (no need for execute flag on *.java/*.html) and introduced local/remote crawl size ratio based check 13 years ago
Balancer.java enhanced crawler 13 years ago
CrawlProfile.java fixed default must-match filter for full domain crawls - the old filter 13 years ago
CrawlQueues.java complete redesign of crawl queue monitoring: do not look at a 13 years ago
CrawlStacker.java fixed default must-match filter for full domain crawls - the old filter 13 years ago
CrawlSwitchboard.java - less automatic indexing after a search (needs to reset the default 13 years ago
ImporterException.java added final where possible 17 years ago
Latency.java complete redesign of crawl queue monitoring: do not look at a 13 years ago
NoticedURL.java complete redesign of crawl queue monitoring: do not look at a 13 years ago
RSSLoader.java refactoring: 14 years ago
ResourceObserver.java more logging in resource observer 13 years ago
ResultImages.java ConcurrentLinkedQueue has a VERY long return time on the .size() method. 13 years ago
ResultURLs.java Removed handling of components objects for URIMetadataRows. 13 years ago
RobotsTxt.java produce a bookmark entry from every crawl start. these bookmarks are always private. 13 years ago
RobotsTxtEntry.java - enhanced logging in robots.txt parser for remote debugging 13 years ago
RobotsTxtParser.java fix for robot parser 13 years ago
SitemapImporter.java refactoring: 14 years ago
ZURL.java ConcurrentLinkedQueue has a VERY long return time on the .size() method. 13 years ago