You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

luccioman fcf6b16db4 Added new crawler attribute for finer control over Media Type detection ... New "Media Type detection" section in the advanced crawl start page allow to choose between : - not loading URLs with unknown or unsupported file extension without checking the actual Media Type (relying Content-Type header for now). This was the old default behavior, faster, but not really accurate. - always cross check URL file extension against the actual Media Type. This lets properly parse URLs ending with an apparently odd file extension, but which have actually a supported Media Type such as text/html. Sample URLs with misleading file extensions added as documentation in the crawl start page. fixes issue #244		6 years ago
..
FTPLoader.java	…
FileLoader.java	Finer control on bounded input streams with custom stream implementation	8 years ago
HTTPLoader.java	Do locale independant case conversion on hosts, schemes, and file exts.	7 years ago
ImporterException.java	…
RSSLoader.java	Added support for enclosures (media links) to the RSS loader	7 years ago
Request.java	…
Response.java	Added new crawler attribute for finer control over Media Type detection	6 years ago
SMBLoader.java	…
SitemapImporter.java	…
StreamResponse.java	Make StreamResponse usable in Java try-with-resources statements	7 years ago
URLRewriterLibrary.java	…