You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 2b32248079
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1516&p=10545#p10545
16 years ago
..
AbstractImporter.java added final where possible 17 years ago
Balancer.java fix for deadlock-like behavior in balancer 16 years ago
CrawlEntry.java removed active profiling in kelondroRowSet 16 years ago
CrawlProfile.java - added fast fingerprint computation for files (any). Will be used in new index dump method 16 years ago
CrawlQueues.java - refactoring of CrawlEntry and CrawlStacker 16 years ago
CrawlStacker.java fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1516&p=10545#p10545 16 years ago
FTPLoader.java performance hacks 16 years ago
HTTPLoader.java added more exception handling during crawling 16 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java added final where possible 17 years ago
IndexingStack.java refactoring and new architecture to store the files of the web cache: 16 years ago
LoaderMessage.java modifications towards a single database operation to read/write http header and cached file at once: 16 years ago
NoticeURLImporter.java more performance hacks 16 years ago
NoticedURL.java performance hacks 16 years ago
ProtocolLoader.java removed the permanent cache flush and replaced it with a periodic cache flush 16 years ago
ResourceObserver.java javadoc 16 years ago
ResultImages.java * refactoring 17 years ago
ResultURLs.java fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1351&p=9242#p9242 16 years ago
RobotsTxt.java removed unnecessary usage of kelondroBLOBTree 16 years ago
SitemapImporter.java more performance hacks 16 years ago
ZURL.java - more space in error db to store larger error messages 16 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago