You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter fffb91447a
fixed crawl queue delete function
14 years ago
..
retrieval - added a catch-all parser for all documents that cannot be parsed: they will contributed with their document url for the search index only 14 years ago
Balancer.java fixed crawl queue delete function 14 years ago
CrawlProfile.java custom + generic skins: 14 years ago
CrawlQueues.java - low-memory patch for crawler 14 years ago
CrawlStacker.java * add option to network definition to provide a domainlist (syntax like in blacklists) 14 years ago
CrawlSwitchboard.java fixed a number of small bugs: 14 years ago
ImporterException.java added final where possible 17 years ago
Latency.java preparations to move the HTCache into cora: 14 years ago
NoticedURL.java fixed crawl queue delete function 14 years ago
RSSLoader.java fix for scheduling of rss feeds 14 years ago
ResourceObserver.java change in handling of the all-visible home path for storage in YaCy: 14 years ago
ResultImages.java redesign of parser interface: 15 years ago
ResultURLs.java - added a tag cloud to search results (using the topics) 14 years ago
RobotsEntry.java - replaced pdfbox and fontbox version 1.1.0 with 1.2.1 14 years ago
RobotsTxt.java - moved yacybot user agent string definition to MultiProtocolURI since there are basic access mechanisms where the bot string is needed 14 years ago
SitemapImporter.java added a sitemap entry parser and loader for sitemaps 14 years ago
ZURL.java fixed crawler bug caused by NPE in logging 14 years ago
robotsParser.java added a sitemap entry parser and loader for sitemaps 14 years ago