You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter 97d1347adb added also a default accept field to robots.txt downloads ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8049 6c8d7289-2bf4-0310-a012-ef5d649a1542		13 years ago
..
retrieval	added a default accept header in http requests since some http fraud detection functions check that this header field exist	13 years ago
Balancer.java	fix for http://bugs.yacy.net/view.php?id=62	13 years ago
CrawlProfile.java	- added a cache for active crawl profiles to the crawl switchboard	13 years ago
CrawlQueues.java	refactoring	14 years ago
CrawlStacker.java	- added a cache for active crawl profiles to the crawl switchboard	13 years ago
CrawlSwitchboard.java	- added a cache for active crawl profiles to the crawl switchboard	13 years ago
ImporterException.java	added final where possible	17 years ago
Latency.java	another performance hack: re-use of known host addresses for isLocal property; avoids look-up in local hash	14 years ago
NoticedURL.java	fix for http://bugs.yacy.net/view.php?id=62	13 years ago
RSSLoader.java	refactoring:	14 years ago
ResourceObserver.java	refactoring:	14 years ago
ResultImages.java	- fixed a bug in crawl start with file name (npe in new url)	14 years ago
ResultURLs.java	fixed urls to media content during indexing	13 years ago
RobotsTxt.java	added also a default accept field to robots.txt downloads	13 years ago
RobotsTxtEntry.java	- enhanced logging in robots.txt parser for remote debugging	13 years ago
RobotsTxtParser.java	fix for robot parser	13 years ago
SitemapImporter.java	refactoring:	14 years ago
ZURL.java	typo	13 years ago