You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen e586e423aa
in case that loading from the cache fails, load from wkhtmltopdf without
10 years ago
..
data in case that loading from the cache fails, load from wkhtmltopdf without 10 years ago
retrieval moved snapshot generation out of the html handler to prevent that 10 years ago
robots more ipv6 bugfixes 10 years ago
Balancer.java - added a new Crawler Balancer: HostBalancer and HostQueues: 11 years ago
CrawlStacker.java explain crawl denial when not switched to intranet mode 10 years ago
CrawlSwitchboard.java YaCy can now create web page snapshots as pdf documents which can later 10 years ago
HarvestProcess.java fix for wrong display of error urls in HostBrowser 12 years ago
HostBalancer.java reduce number of calls to queue.size() because that may be a bottleneck 10 years ago
HostQueue.java more stacks shall be considered for on-demand loading, not only 10 years ago
LegacyBalancer.java special strategy for balancer: do not remove targets with zero wait time 11 years ago