You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter 8952153ecf update to Balancer algorithm: ... - create a load list from the current list of known hosts - do not create this list for each Balancer.pop access - create the list from those hosts which have a zero-waiting time - select 1/3 from that list which have the most urls waiting - get hosts from the wainting list in random order - fixes for some delta-time computations - always load all urls from hosts which have never been loaded before		12 years ago
..
data	update to Balancer algorithm:	12 years ago
retrieval	update to Balancer algorithm:	12 years ago
robots	removed the option to prevent removal of & parts inside of the	12 years ago
Balancer.java	update to Balancer algorithm:	12 years ago
CrawlStacker.java	- removed dependencies from URIMetadataRow and made direct access to	12 years ago
CrawlSwitchboard.java	fixes to crawl profiles	12 years ago