You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter d58b395993
fix for http://forum.yacy-websuche.de/viewtopic.php?p=15693#p15693
16 years ago
..
AbstractImporter.java refactoring of logging 16 years ago
Balancer.java omit most of forced crawl delays by using a separat delay table which flushes delayed URLs at the correct time 16 years ago
CrawlEntry.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 16 years ago
CrawlProfile.java fix for http://forum.yacy-websuche.de/viewtopic.php?p=15693#p15693 16 years ago
CrawlQueues.java - fixed a not working selection rule in balancer 16 years ago
CrawlStacker.java more refactoring to make the segment object easier to use and to be prepared to integrate author navigation 16 years ago
CrawlSwitchboard.java new fully redesigned balancer and bugfixes regarding lost profile handles and killed crawls 16 years ago
FTPLoader.java refactoring of plasmaWordIndex: 16 years ago
HTTPLoader.java refactoring of plasmaWordIndex: 16 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java more memory leak fixing hacks 16 years ago
IndexingStack.java new fully redesigned balancer and bugfixes regarding lost profile handles and killed crawls 16 years ago
Latency.java - fixed a not working selection rule in balancer 16 years ago
LoaderMessage.java refactoring: better abstraction of reference and metadata prototypes. 16 years ago
NoticeURLImporter.java refactoring of plasmaWordIndex: 16 years ago
NoticedURL.java new fully redesigned balancer and bugfixes regarding lost profile handles and killed crawls 16 years ago
ProtocolLoader.java refactoring: better abstraction of reference and metadata prototypes. 16 years ago
ResourceObserver.java refactoring of plasmaWordIndex: 16 years ago
ResultImages.java * refactoring 17 years ago
ResultURLs.java refactoring: better abstraction of reference and metadata prototypes. 16 years ago
RobotsTxt.java migration of all databases that use the deprecated BLOBTree format into the BLOBHeap format. Old databases are migrated automatically. 16 years ago
SitemapImporter.java more performance hacks 16 years ago
ZURL.java - added migration class to go from index collections to the index cell data structure. 16 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago