boxtec
/
yacy_search_server
mirror of https://github.com/yacy/yacy_search_server
4
1
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '36bd843ece'
${ noResults }
yacy_search_server/source/de/anomic/crawler
History
orbiter c855fc48c6
only load robots.txt for http and http protocol 		15 years ago
..
retrieval - (almost) fixed FTP crawler 15 years ago
AbstractImporter.java start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root 16 years ago
Balancer.java better look-ahead into the crawl queue: show more on crawl monitor 15 years ago
CrawlProfile.java - added BEncoder class 15 years ago
CrawlQueues.java slightly changed crawling policy 15 years ago
CrawlStacker.java slightly changed crawling policy 15 years ago
CrawlSwitchboard.java added some modifications recommended by PMD for better performance 15 years ago
Importer.java refactoring: 17 years ago
ImporterException.java added final where possible 17 years ago
ImporterManager.java start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root 16 years ago
Latency.java - clean-up of robots.txt parser 15 years ago
NoticedURL.java added extensive memory protection logic to avoid out of memory errors that may be caused by the RowCollection memory allocation function 15 years ago
ResourceObserver.java allow global search if res. observer disabled index transmission 15 years ago
ResultImages.java refactoring of yacy documents and parsers: they depend now only on the kelondro classes 16 years ago
ResultURLs.java redesign of CrawlResult data structures because of OOM occurrences during URL deletion processes. 15 years ago
RobotsEntry.java - fixed a bug in robots.txt parser 15 years ago
RobotsTxt.java only load robots.txt for http and http protocol 15 years ago
SitemapImporter.java applied code changes that are recommended by PMD 15 years ago
ZURL.java slightly changed crawling policy 15 years ago
robotsParser.java - fixed a bug in robots.txt parser 15 years ago