You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 21b8704fb4
refactoring of the ParserDispatcher and ParserConfig: resulted into Idiom, Parser and Classification classes
16 years ago
..
AbstractImporter.java serialized all logging using concurrency: 16 years ago
Balancer.java extending visibility of objects and methods to avoid synthetic accessor methods and increase performance 16 years ago
CrawlEntry.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 16 years ago
CrawlProfile.java simplification of the code: removed unused classes, methods and variables 16 years ago
CrawlQueues.java refactoring of parsers and document processing 16 years ago
CrawlStacker.java serialized all logging using concurrency: 16 years ago
CrawlSwitchboard.java refactoring of parsers and document processing 16 years ago
FTPLoader.java refactoring of the ParserDispatcher and ParserConfig: resulted into Idiom, Parser and Classification classes 16 years ago
HTTPLoader.java refactoring of the ParserDispatcher and ParserConfig: resulted into Idiom, Parser and Classification classes 16 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java serialized all logging using concurrency: 16 years ago
IndexingStack.java small refactoring to prepare for new queues 16 years ago
Latency.java - fixed a not working selection rule in balancer 16 years ago
LoaderMessage.java refactoring of parsers and document processing 16 years ago
NoticeURLImporter.java refactoring of plasmaWordIndex: 16 years ago
NoticedURL.java serialized all logging using concurrency: 16 years ago
ProtocolLoader.java refactoring of parsers and document processing 16 years ago
ResourceObserver.java all stack/heap files that had been stored in DATA/PLASMA are now stored in the network-specific QUEUES path 16 years ago
ResultImages.java refactoring of parsers and document processing 16 years ago
ResultURLs.java serialized all logging using concurrency: 16 years ago
RobotsTxt.java code cleanup: call of static methods directly to the class 16 years ago
SitemapImporter.java more performance hacks 16 years ago
ZURL.java extending visibility of objects and methods to avoid synthetic accessor methods and increase performance 16 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago