You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 5bb8074150
removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency.
16 years ago
..
retrieval removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency. 16 years ago
AbstractImporter.java serialized all logging using concurrency: 16 years ago
Balancer.java - inserted request object into response object which carries this now instead generating new objects 16 years ago
CrawlProfile.java removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency. 16 years ago
CrawlQueues.java removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency. 16 years ago
CrawlStacker.java - inserted request object into response object which carries this now instead generating new objects 16 years ago
CrawlSwitchboard.java removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency. 16 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java serialized all logging using concurrency: 16 years ago
Latency.java - inserted request object into response object which carries this now instead generating new objects 16 years ago
LoaderMessage.java -removed superfluous crawl cache 16 years ago
NoticeURLImporter.java -removed superfluous crawl cache 16 years ago
NoticedURL.java -removed superfluous crawl cache 16 years ago
ResourceObserver.java all stack/heap files that had been stored in DATA/PLASMA are now stored in the network-specific QUEUES path 16 years ago
ResultImages.java refactoring of parsers and document processing 16 years ago
ResultURLs.java serialized all logging using concurrency: 16 years ago
RobotsTxt.java -removed superfluous crawl cache 16 years ago
SitemapImporter.java more performance hacks 16 years ago
ZURL.java -removed superfluous crawl cache 16 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago