You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 13c63f4082
a set of small fixes to crawling behaviour
16 years ago
..
AbstractImporter.java serialized all logging using concurrency: 16 years ago
Balancer.java a set of small fixes to crawling behaviour 16 years ago
CrawlEntry.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 16 years ago
CrawlProfile.java simplification of the code: removed unused classes, methods and variables 16 years ago
CrawlQueues.java a set of small fixes to crawling behaviour 16 years ago
CrawlStacker.java serialized all logging using concurrency: 16 years ago
CrawlSwitchboard.java a set of small fixes to crawling behaviour 16 years ago
FTPLoader.java enhanced document type recognition 16 years ago
HTTPLoader.java enhanced parser with more extension + mime attributes 16 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java serialized all logging using concurrency: 16 years ago
IndexingStack.java a set of small fixes to crawling behaviour 16 years ago
Latency.java a set of small fixes to crawling behaviour 16 years ago
LoaderMessage.java refactoring of parsers and document processing 16 years ago
NoticeURLImporter.java enable warnings and fix most of it 16 years ago
NoticedURL.java a set of small fixes to crawling behaviour 16 years ago
ProtocolLoader.java refactoring of parsers and document processing 16 years ago
ResourceObserver.java all stack/heap files that had been stored in DATA/PLASMA are now stored in the network-specific QUEUES path 16 years ago
ResultImages.java refactoring of parsers and document processing 16 years ago
ResultURLs.java serialized all logging using concurrency: 16 years ago
RobotsTxt.java enable warnings and fix most of it 16 years ago
SitemapImporter.java more performance hacks 16 years ago
ZURL.java extending visibility of objects and methods to avoid synthetic accessor methods and increase performance 16 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago