4 Commits (a4629ad83be986587db24d1b5477219d0be0846a)

Author	SHA1	Message	Date
reger	77851fa53c	fix parser test cases ... (Vocabulary paramete)	10 years ago
Michael Peter Christen	68c605d637	replace with CommonPattern.SPACE for split	10 years ago
Michael Peter Christen	2de159719b	added an option to set 'obey nofollow' for links with rel="nofollow" ... attribute in the <a> tag for each crawl. This introduces a lot of changes because it extends the usage of the AnchorURL Object type which now also has a different toString method that the underlying DigestURL.toString. It is therefore not advised to use .toString at all for urls, just just toNormalform(false) instead.	11 years ago
reger	431a5f9c4e	added test case for TextSnippet, ... removed obsolete/unused parameter and reference to MediaSnippet	11 years ago