You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
hermens 62a7341c4d
Fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2204
15 years ago
..
retrieval *) Removed base tag from errror page. This has been added by myself a long time ago as a workaround for some weird behavior of my router, but as it turns out, it does more bad than good in general: If HTTPS is used for communication with YaCy, entering a wrong passwort led to an errror page with a form which would send username and password unencrypted with the user possibly being unaware of this. 15 years ago
AbstractImporter.java serialized all logging using concurrency: 16 years ago
Balancer.java Fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2204 15 years ago
CrawlProfile.java update to default ranking profile which has now some settings to deny some phpbb3 pages which are redundant in the index when crawling phpbb3. 15 years ago
CrawlQueues.java added configuration to enable ram table copy 15 years ago
CrawlStacker.java fix for deadlock 16 years ago
CrawlSwitchboard.java update to default ranking profile which has now some settings to deny some phpbb3 pages which are redundant in the index when crawling phpbb3. 15 years ago
ExternalIndexImporter.java refactoring: 16 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java serialized all logging using concurrency: 16 years ago
Latency.java - fixes for some problems with the new crawling/caching strategies 16 years ago
LoaderMessage.java -removed superfluous crawl cache 16 years ago
NoticeURLImporter.java added configuration to enable ram table copy 15 years ago
NoticedURL.java added configuration to enable ram table copy 15 years ago
ResourceObserver.java refactoring: 16 years ago
ResultImages.java refactoring of parsers and document processing 16 years ago
ResultURLs.java serialized all logging using concurrency: 16 years ago
RobotsTxt.java - fixes for some problems with the new crawling/caching strategies 16 years ago
SitemapImporter.java refactoring: 16 years ago
ZURL.java added configuration to enable ram table copy 15 years ago
robotsParser.java * Robots.txt: don't interpret Crawl-Delays for other robots 16 years ago