You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 42ae40b9f6
some bugfixes to database close() methods
16 years ago
..
AbstractImporter.java refactoring of logging 16 years ago
Balancer.java - removed useCell option: the indexCell data structure is now the default index structure; old collection data is still migrated 16 years ago
CrawlEntry.java - added writing of temporary file names and renaming to final file name when index dump/merge are done. Interrupted merges can be cleaned up. 16 years ago
CrawlProfile.java migration of all databases that use the deprecated BLOBTree format into the BLOBHeap format. Old databases are migrated automatically. 16 years ago
CrawlQueues.java refactoring of plasmaWordIndex: 16 years ago
CrawlStacker.java more refactoring to make the segment object easier to use and to be prepared to integrate author navigation 16 years ago
CrawlSwitchboard.java refactoring of plasmaWordIndex: 16 years ago
FTPLoader.java refactoring of plasmaWordIndex: 16 years ago
HTTPLoader.java refactoring of plasmaWordIndex: 16 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java more memory leak fixing hacks 16 years ago
IndexingStack.java some bugfixes to database close() methods 16 years ago
Latency.java - removed deprecated threads 16 years ago
LoaderMessage.java refactoring: better abstraction of reference and metadata prototypes. 16 years ago
NoticeURLImporter.java refactoring of plasmaWordIndex: 16 years ago
NoticedURL.java - removed useCell option: the indexCell data structure is now the default index structure; old collection data is still migrated 16 years ago
ProtocolLoader.java refactoring: better abstraction of reference and metadata prototypes. 16 years ago
ResourceObserver.java refactoring of plasmaWordIndex: 16 years ago
ResultImages.java * refactoring 17 years ago
ResultURLs.java refactoring: better abstraction of reference and metadata prototypes. 16 years ago
RobotsTxt.java migration of all databases that use the deprecated BLOBTree format into the BLOBHeap format. Old databases are migrated automatically. 16 years ago
SitemapImporter.java more performance hacks 16 years ago
ZURL.java - added migration class to go from index collections to the index cell data structure. 16 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago