You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 2de159719b added an option to set 'obey nofollow' for links with rel="nofollow" ... attribute in the <a> tag for each crawl. This introduces a lot of changes because it extends the usage of the AnchorURL Object type which now also has a different toString method that the underlying DigestURL.toString. It is therefore not advised to use .toString at all for urls, just just toNormalform(false) instead.		10 years ago
..
FTPLoader.java	added crawl depth for failed documents	11 years ago
FileLoader.java	use configured admin-username for api calls	11 years ago
HTTPLoader.java	added an option to set 'obey nofollow' for links with rel="nofollow"	10 years ago
ImporterException.java	…
RSSLoader.java	changed strategy to test existence of documents in Solr: using the	11 years ago
Request.java	added an option to set 'obey nofollow' for links with rel="nofollow"	10 years ago
Response.java	bugfix for image search	11 years ago
SMBLoader.java	use configured admin-username for api calls	11 years ago
SitemapImporter.java	added an option to set 'obey nofollow' for links with rel="nofollow"	10 years ago
URLRewriterLibrary.java	Added 'final' for all exception blocks as this helps the Java compiler	11 years ago