You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 1110d16af9
performance hack: replaced generic row.getColBytes() call with row.getPrimaryKeyBytes() where the column is 0
14 years ago
..
retrieval performance hack: replaced generic row.getColBytes() call with row.getPrimaryKeyBytes() where the column is 0 14 years ago
Balancer.java *) deleted LogStatistics since the page did not work anymore and it seemed to be obsolete, tell me if you miss it and I will add it again 14 years ago
CrawlProfile.java - fixed document number limitation for crawls that restrict the number of documents per domain 14 years ago
CrawlQueues.java - fixed document number limitation for crawls that restrict the number of documents per domain 14 years ago
CrawlStacker.java - fixed document number limitation for crawls that restrict the number of documents per domain 14 years ago
CrawlSwitchboard.java - fixed document number limitation for crawls that restrict the number of documents per domain 14 years ago
ImporterException.java
Latency.java preparations to move the HTCache into cora: 15 years ago
NoticedURL.java *) fixed bug which caused entries to not be deleted when deleting by URL on IndexCreateWWWLocalQueue_p.html (I hope this did not break anything else) 14 years ago
RSSLoader.java * fix system update if urls are in blacklist (for example for very general blacklists like *.de) 14 years ago
ResourceObserver.java same units for memory observer configuration (MiB) 14 years ago
ResultImages.java *) cleaning up the code a little bit 14 years ago
ResultURLs.java - fixed document number limitation for crawls that restrict the number of documents per domain 14 years ago
RobotsEntry.java - replaced pdfbox and fontbox version 1.1.0 with 1.2.1 15 years ago
RobotsTxt.java - moved yacybot user agent string definition to MultiProtocolURI since there are basic access mechanisms where the bot string is needed 15 years ago
SitemapImporter.java enhanced crawler: 14 years ago
ZURL.java performance hack: replaced generic row.getColBytes() call with row.getPrimaryKeyBytes() where the column is 0 14 years ago
robotsParser.java added a sitemap entry parser and loader for sitemaps 14 years ago