You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen eca9380e3d bugfix for crawler double-check: if an url is redirected, the ... redirect-target was not double-checked. This is now done by replacing the redirect-URL on the crawl queue again (where it is double-checked)		11 years ago
..
FTPLoader.java	added crawl depth for failed documents	11 years ago
FileLoader.java	fix for file urls	11 years ago
HTTPLoader.java	bugfix for crawler double-check: if an url is redirected, the	11 years ago
ImporterException.java	…
RSSLoader.java	better error handling for remote solr queries and exists-checks	11 years ago
Request.java	added an option to set 'obey nofollow' for links with rel="nofollow"	11 years ago
Response.java	bugfix for image search	11 years ago
SMBLoader.java	…
SitemapImporter.java	better error handling for remote solr queries and exists-checks	11 years ago
URLRewriterLibrary.java	…