You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen 226aea5914
added a servlet which can create preview images, preview tumbnails and
10 years ago
..
data added a servlet which can create preview images, preview tumbnails and 10 years ago
retrieval moved snapshot generation out of the html handler to prevent that 10 years ago
robots more ipv6 bugfixes 10 years ago
Balancer.java - added a new Crawler Balancer: HostBalancer and HostQueues: 11 years ago
CrawlStacker.java explain crawl denial when not switched to intranet mode 10 years ago
CrawlSwitchboard.java YaCy can now create web page snapshots as pdf documents which can later 10 years ago
HarvestProcess.java fix for wrong display of error urls in HostBrowser 12 years ago
HostBalancer.java reduce number of calls to queue.size() because that may be a bottleneck 10 years ago
HostQueue.java more stacks shall be considered for on-demand loading, not only 10 years ago
LegacyBalancer.java special strategy for balancer: do not remove targets with zero wait time 11 years ago