You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen 8c3e5b7b6d
added experimental pdf splitting which enables YaCy to split pdfs during
10 years ago
..
data reactivated on-demand snapshot loading 10 years ago
retrieval added experimental pdf splitting which enables YaCy to split pdfs during 10 years ago
robots more ipv6 bugfixes 10 years ago
Balancer.java - added a new Crawler Balancer: HostBalancer and HostQueues: 11 years ago
CrawlStacker.java ViewFile servlet: update index if newer, 10 years ago
CrawlSwitchboard.java enhanced the snapshot functionality: 10 years ago
HarvestProcess.java fix for wrong display of error urls in HostBrowser 12 years ago
HostBalancer.java reduce number of calls to queue.size() because that may be a bottleneck 10 years ago
HostQueue.java more stacks shall be considered for on-demand loading, not only 10 years ago
LegacyBalancer.java special strategy for balancer: do not remove targets with zero wait time 11 years ago