You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
Michael Peter Christen 226aea5914
added a servlet which can create preview images, preview tumbnails and
11 years ago
..
data added a servlet which can create preview images, preview tumbnails and 11 years ago
retrieval moved snapshot generation out of the html handler to prevent that 11 years ago
robots more ipv6 bugfixes 11 years ago
Balancer.java - added a new Crawler Balancer: HostBalancer and HostQueues: 11 years ago
CrawlStacker.java explain crawl denial when not switched to intranet mode 11 years ago
CrawlSwitchboard.java YaCy can now create web page snapshots as pdf documents which can later 11 years ago
HarvestProcess.java fix for wrong display of error urls in HostBrowser 13 years ago
HostBalancer.java reduce number of calls to queue.size() because that may be a bottleneck 11 years ago
HostQueue.java more stacks shall be considered for on-demand loading, not only 11 years ago
LegacyBalancer.java special strategy for balancer: do not remove targets with zero wait time 11 years ago