You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 3300930fc5
- (almost) fixed FTP crawler
15 years ago
..
retrieval - (almost) fixed FTP crawler 15 years ago
AbstractImporter.java
Balancer.java better look-ahead into the crawl queue: show more on crawl monitor 15 years ago
CrawlProfile.java - added BEncoder class 15 years ago
CrawlQueues.java slightly changed crawling policy 15 years ago
CrawlStacker.java slightly changed crawling policy 15 years ago
CrawlSwitchboard.java
Importer.java
ImporterException.java
ImporterManager.java
Latency.java
NoticedURL.java
ResourceObserver.java allow global search if res. observer disabled index transmission 15 years ago
ResultImages.java
ResultURLs.java redesign of CrawlResult data structures because of OOM occurrences during URL deletion processes. 15 years ago
RobotsEntry.java - fixed a bug in robots.txt parser 15 years ago
RobotsTxt.java - fixed a bug in robots.txt parser 15 years ago
SitemapImporter.java
ZURL.java slightly changed crawling policy 15 years ago
robotsParser.java - fixed a bug in robots.txt parser 15 years ago