You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 3621aa96ab
- added a memory protection for the IndexCell migration
16 years ago
..
AbstractImporter.java refactoring of logging 16 years ago
Balancer.java - added a memory protection for the IndexCell migration 16 years ago
CrawlEntry.java - added Latency control to the crawler: 16 years ago
CrawlProfile.java - added migration class to go from index collections to the index cell data structure. 16 years ago
CrawlQueues.java fixed bug introduced in SVN 5756 in EcoTable.put() 16 years ago
CrawlStacker.java more care about open file handles. Now files also close on windows and can be deleted afterwards. 16 years ago
FTPLoader.java - added Latency control to the crawler: 16 years ago
HTTPLoader.java - added Latency control to the crawler: 16 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java more memory leak fixing hacks 16 years ago
IndexingStack.java removed option to use different primary keys in kelondro tables 16 years ago
Latency.java added new concurrent merger class for IndexCell RWI data 16 years ago
LoaderMessage.java more refactoring of kelondro.text / deleted de.anomic.index 16 years ago
NoticeURLImporter.java - added migration class to go from index collections to the index cell data structure. 16 years ago
NoticedURL.java added new concurrent merger class for IndexCell RWI data 16 years ago
ProtocolLoader.java more refactoring of kelondro.text / deleted de.anomic.index 16 years ago
ResourceObserver.java refactoring of wordIndex class 16 years ago
ResultImages.java * refactoring 17 years ago
ResultURLs.java more refactoring of kelondro.text / deleted de.anomic.index 16 years ago
RobotsTxt.java - added migration class to go from index collections to the index cell data structure. 16 years ago
SitemapImporter.java more performance hacks 16 years ago
ZURL.java - added migration class to go from index collections to the index cell data structure. 16 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago