You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler/retrieval
Michael Peter Christen 252bb51f98
fix for wrong mime type in noload crawler
12 years ago
..
FTPLoader.java introduced a better place to update the lastacc time value in latency 12 years ago
FileLoader.java added a feature to find similarities in documents. 12 years ago
HTTPLoader.java added the generation of 50 (!!) new solr field in the core 'webgraph'. 12 years ago
ImporterException.java refactoring 13 years ago
RSSLoader.java added the generation of 50 (!!) new solr field in the core 'webgraph'. 12 years ago
Request.java replaced the custom robots.txt loader by the standard http loader 12 years ago
Response.java fix for wrong mime type in noload crawler 12 years ago
SMBLoader.java added a feature to find similarities in documents. 12 years ago
SitemapImporter.java added the generation of 50 (!!) new solr field in the core 'webgraph'. 12 years ago
URLRewriterLibrary.java added an url rewriter which can be used to remove session ids from urls 12 years ago