You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler/retrieval
orbiter 4b06adb751
fix for file urls
11 years ago
..
FTPLoader.java added crawl depth for failed documents 11 years ago
FileLoader.java fix for file urls 11 years ago
HTTPLoader.java added an option to set 'obey nofollow' for links with rel="nofollow" 11 years ago
ImporterException.java refactoring 13 years ago
RSSLoader.java changed strategy to test existence of documents in Solr: using the 11 years ago
Request.java added an option to set 'obey nofollow' for links with rel="nofollow" 11 years ago
Response.java bugfix for image search 11 years ago
SMBLoader.java use configured admin-username for api calls 11 years ago
SitemapImporter.java added an option to set 'obey nofollow' for links with rel="nofollow" 11 years ago
URLRewriterLibrary.java Added 'final' for all exception blocks as this helps the Java compiler 12 years ago