boxtec
/
yacy_search_server
mirror of https://github.com/yacy/yacy_search_server
4
1
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '78d6d6ca06'
${ noResults }
yacy_search_server/source/de/anomic/crawler
History
orbiter 17530ca7b5
fix for bug http://bugs.yacy.net/view.php?id=10 		14 years ago
..
retrieval fixes to crawler and new user-agent crawl-delay handling 14 years ago
Balancer.java added a handling of appearances of yacy bot entries in robots.txt if this entry addresses the yacy peer 14 years ago
CrawlProfile.java enhancements to web cache and less strict caching rules 14 years ago
CrawlQueues.java added a handling of appearances of yacy bot entries in robots.txt if this entry addresses the yacy peer 14 years ago
CrawlStacker.java - removed file upload function in crawl start and replaced it with an input field for a file path where the crawl start file is loaded. This was necessary to support the API steering for file crawl starts, for two reasons: 14 years ago
CrawlSwitchboard.java fix for bug http://bugs.yacy.net/view.php?id=10 14 years ago
ImporterException.java added final where possible 17 years ago
Latency.java fix for bug http://bugs.yacy.net/view.php?id=10 14 years ago
NoticedURL.java added a handling of appearances of yacy bot entries in robots.txt if this entry addresses the yacy peer 14 years ago
RSSLoader.java *) set SVN properties 14 years ago
ResourceObserver.java same units for memory observer configuration (MiB) 14 years ago
ResultImages.java more memory protection: auto-flush of caches in case of memory shortage 14 years ago
ResultURLs.java - added geo information parsing to html parser 14 years ago
RobotsEntry.java fixes to crawler and new user-agent crawl-delay handling 14 years ago
RobotsTxt.java fixes to crawler and new user-agent crawl-delay handling 14 years ago
SitemapImporter.java enhanced crawler: 14 years ago
ZURL.java moved getBytes() to UTF8.getBytes() to use a default String encoding 14 years ago
robotsParser.java fixes to crawler and new user-agent crawl-delay handling 14 years ago