You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 4c99d4683d
possible fix for lost crawl profile handles: clean-up job did wrong measurement to see if crawl is still running.
15 years ago
..
retrieval - added function to OAI-PMH reader that can pull all records from a server using an evaluation of the resumption token to get URL to retrieve remaining records 15 years ago
AbstractImporter.java start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root 15 years ago
Balancer.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 15 years ago
CrawlProfile.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 15 years ago
CrawlQueues.java possible fix for lost crawl profile handles: clean-up job did wrong measurement to see if crawl is still running. 15 years ago
CrawlStacker.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 15 years ago
CrawlSwitchboard.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 15 years ago
ExternalIndexImporter.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 15 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root 15 years ago
Latency.java refactoring 15 years ago
LoaderMessage.java - refactoring 15 years ago
NoticeURLImporter.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 15 years ago
NoticedURL.java start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root 15 years ago
ResourceObserver.java option to disable dht by memory limit: 15 years ago
ResultImages.java refactoring of yacy documents and parsers: they depend now only on the kelondro classes 15 years ago
ResultURLs.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 15 years ago
RobotsEntry.java * added index segments 15 years ago
RobotsTxt.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 15 years ago
SitemapImporter.java refactoring 15 years ago
ZURL.java added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/ 15 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago