You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 542c20a597 changed handling of crawl profile field crawlingIfOlder: this should be ... filled with the date, when the url is recognized as to be outdated. That field was partly misinterpreted and the time interval was filled in. In case that all the urls which are in the index shall be treated as outdated, the field is filled now with Long.MAX_VALUE because then all crawl dates are before that date and therefore outdated.		10 years ago
..
Cache.java	added an option to set 'obey nofollow' for links with rel="nofollow"	10 years ago
CrawlProfile.java	changed handling of crawl profile field crawlingIfOlder: this should be	10 years ago
CrawlQueues.java	added an option to set 'obey nofollow' for links with rel="nofollow"	10 years ago
Latency.java	- added a new Crawler Balancer: HostBalancer and HostQueues:	11 years ago
NoticedURL.java	made number of open files in crawler configurable and increased default	11 years ago
ResultImages.java	- replaced the properties object in AnchorURL with distinct variables	11 years ago
ResultURLs.java	migrated the index export methods from the old metadata to solr. Now	12 years ago