You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 73f03e05ee
fixed a bug in snippet fetch strategy: cache only does not help if resource can only be found in web
15 years ago
..
retrieval - scanned remote search process and enhanced some data structure and synchronizations here and there 15 years ago
AbstractImporter.java - cleanup, removed unused imports 15 years ago
Balancer.java fixes and enhancements for balancer: 15 years ago
CrawlProfile.java fixed a bug in snippet fetch strategy: cache only does not help if resource can only be found in web 15 years ago
CrawlQueues.java - scanned remote search process and enhanced some data structure and synchronizations here and there 15 years ago
CrawlStacker.java - added new protocol loader for 'file'-type URLs 15 years ago
CrawlSwitchboard.java fixed a bug in snippet fetch strategy: cache only does not help if resource can only be found in web 15 years ago
Importer.java
ImporterException.java
ImporterManager.java
Latency.java fixes to balancer when crawling filesystem (problem was: host == null) 15 years ago
NoticedURL.java
ResourceObserver.java
ResultImages.java - added new protocol loader for 'file'-type URLs 15 years ago
ResultURLs.java - more abstraction (HashMap -> Map) 15 years ago
RobotsEntry.java redesign of remote proxy settings 15 years ago
RobotsTxt.java better handling of OOM situations 15 years ago
SitemapImporter.java
ZURL.java
robotsParser.java