You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler/retrieval
Michael Peter Christen eca9380e3d
bugfix for crawler double-check: if an url is redirected, the
11 years ago
..
FTPLoader.java added crawl depth for failed documents 11 years ago
FileLoader.java fix for file urls 11 years ago
HTTPLoader.java bugfix for crawler double-check: if an url is redirected, the 11 years ago
ImporterException.java refactoring 13 years ago
RSSLoader.java better error handling for remote solr queries and exists-checks 11 years ago
Request.java added an option to set 'obey nofollow' for links with rel="nofollow" 11 years ago
Response.java bugfix for image search 11 years ago
SMBLoader.java use configured admin-username for api calls 11 years ago
SitemapImporter.java better error handling for remote solr queries and exists-checks 11 years ago
URLRewriterLibrary.java Added 'final' for all exception blocks as this helps the Java compiler 12 years ago