You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 101a6e6e14 Patch the citation index for links with canonical tags. ... This shall fulfill the following requirement: If a document A links to B and B contains a 'canonical C', then the citation rank computation shall consider that A links to C and B does not link to C. To do so, we first must collect all canonical links, find all references to them, get the anchor list of the documents and patch the citation reference of these links.		11 years ago
..
data	- crawl profiles shall be deleted from active and passive stacks if they	11 years ago
retrieval	fix NPE on modified since check ( Response.requestHeader allowed to be null)	11 years ago
robots	- the webgraph shall store all links which appear on a web page and not	11 years ago
Balancer.java	self-healing of mistakenly deactivated crawl profiles. This fixes a bug	11 years ago
CrawlStacker.java	Patch the citation index for links with canonical tags.	11 years ago
CrawlSwitchboard.java	fix for crawl domain counter limitation (limit was reached too early)	11 years ago
HarvestProcess.java	…
HostQueue.java	Added new data structure to be used by the balancer (not used yet).	11 years ago
HostQueues.java	Added new data structure to be used by the balancer (not used yet).	11 years ago