You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter eb1c7c041d write info about robots.txt evaluation into getpageinfo_p.xml ... git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8038 6c8d7289-2bf4-0310-a012-ef5d649a1542		14 years ago
..
retrieval	- performance hacks (should affect the crawl balancer and reduce CPU load during crawl stack re-fill)	14 years ago
Balancer.java	fix for http://bugs.yacy.net/view.php?id=62	14 years ago
CrawlProfile.java	- added a cache for active crawl profiles to the crawl switchboard	14 years ago
CrawlQueues.java	refactoring	14 years ago
CrawlStacker.java	- added a cache for active crawl profiles to the crawl switchboard	14 years ago
CrawlSwitchboard.java	- added a cache for active crawl profiles to the crawl switchboard	14 years ago
ImporterException.java	…
Latency.java	another performance hack: re-use of known host addresses for isLocal property; avoids look-up in local hash	14 years ago
NoticedURL.java	fix for http://bugs.yacy.net/view.php?id=62	14 years ago
RSSLoader.java	refactoring:	14 years ago
ResourceObserver.java	refactoring:	14 years ago
ResultImages.java	- fixed a bug in crawl start with file name (npe in new url)	14 years ago
ResultURLs.java	fixed urls to media content during indexing	14 years ago
RobotsTxt.java	refactoring	14 years ago
RobotsTxtEntry.java	write info about robots.txt evaluation into getpageinfo_p.xml	14 years ago
RobotsTxtParser.java	normalization of url using urlencoding/decoding	14 years ago
SitemapImporter.java	refactoring:	14 years ago
ZURL.java	typo	14 years ago