You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 2de159719b added an option to set 'obey nofollow' for links with rel="nofollow" ... attribute in the <a> tag for each crawl. This introduces a lot of changes because it extends the usage of the AnchorURL Object type which now also has a different toString method that the underlying DigestURL.toString. It is therefore not advised to use .toString at all for urls, just just toNormalform(false) instead.		10 years ago
..
content	added missing @Override annotation	11 years ago
importer	fixed generics warnings for generic array instantiation that appeared	11 years ago
language	added missing @Override annotation	11 years ago
parser	added an option to set 'obey nofollow' for links with rel="nofollow"	10 years ago
AbstractParser.java	fix AbstractParser.singleList not adding null strings	11 years ago
Condenser.java	fix NPE in Condenser,	11 years ago
Document.java	added an option to set 'obey nofollow' for links with rel="nofollow"	10 years ago
ImageParser.java	Added 'final' for all exception blocks as this helps the Java compiler	11 years ago
LargeNumberCache.java	…
LibraryProvider.java	removed jena library and all code that depended on jena. When jena was	11 years ago
Parser.java	- replaced the properties object in AnchorURL with distinct variables	11 years ago
Phrase.java	…
SentenceReader.java	hacks to prevent storage of data longer than necessary during search and	11 years ago
SnippetExtractor.java	Added 'final' for all exception blocks as this helps the Java compiler	11 years ago
TextParser.java	added linkScraperParser, a parser which ignores the text like the	11 years ago
WordTokenizer.java	hacks to prevent storage of data longer than necessary during search and	11 years ago