You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
f1ori 0b02083e97
* function for simple crawl of one url
14 years ago
..
retrieval better abstraction of http client identification 14 years ago
Balancer.java Added federated index storage to solr. 14 years ago
CrawlProfile.java enhanced location search: 14 years ago
CrawlQueues.java more UTF8 getBytes() performance hacks 14 years ago
CrawlStacker.java * function for simple crawl of one url 14 years ago
CrawlSwitchboard.java more UTF8 getBytes() performance hacks 14 years ago
ImporterException.java added final where possible 17 years ago
Latency.java fix for bug http://bugs.yacy.net/view.php?id=10 14 years ago
NoticedURL.java added a handling of appearances of yacy bot entries in robots.txt if this entry addresses the yacy peer 14 years ago
RSSLoader.java more UTF8 getBytes() performance hacks 14 years ago
ResourceObserver.java more UTF8 getBytes() performance hacks 14 years ago
ResultImages.java - fixed a bug in crawl start with file name (npe in new url) 14 years ago
ResultURLs.java more UTF8 getBytes() performance hacks 14 years ago
RobotsEntry.java more UTF8 getBytes() performance hacks 14 years ago
RobotsTxt.java better abstraction of http client identification 14 years ago
SitemapImporter.java more UTF8 getBytes() performance hacks 14 years ago
ZURL.java - enhanced html parser: recognized much more details in the content 14 years ago
robotsParser.java fixes to crawler and new user-agent crawl-delay handling 14 years ago