You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter ce972ff4ef
update to default ranking profile which has now some settings to deny some phpbb3 pages which are redundant in the index when crawling phpbb3.
16 years ago
..
retrieval - fixed a problem loading images through yacy's document loader, 16 years ago
AbstractImporter.java serialized all logging using concurrency: 16 years ago
Balancer.java fix for possible deadlock, see 16 years ago
CrawlProfile.java update to default ranking profile which has now some settings to deny some phpbb3 pages which are redundant in the index when crawling phpbb3. 16 years ago
CrawlQueues.java - fixed a problem loading images through yacy's document loader, 16 years ago
CrawlStacker.java fix for deadlock 16 years ago
CrawlSwitchboard.java update to default ranking profile which has now some settings to deny some phpbb3 pages which are redundant in the index when crawling phpbb3. 16 years ago
ExternalIndexImporter.java refactoring: 16 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java serialized all logging using concurrency: 16 years ago
Latency.java - fixes for some problems with the new crawling/caching strategies 16 years ago
LoaderMessage.java -removed superfluous crawl cache 16 years ago
NoticeURLImporter.java -removed superfluous crawl cache 16 years ago
NoticedURL.java -removed superfluous crawl cache 16 years ago
ResourceObserver.java refactoring: 16 years ago
ResultImages.java refactoring of parsers and document processing 16 years ago
ResultURLs.java serialized all logging using concurrency: 16 years ago
RobotsTxt.java - fixes for some problems with the new crawling/caching strategies 16 years ago
SitemapImporter.java refactoring: 16 years ago
ZURL.java -removed superfluous crawl cache 16 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago