yacy_search_server

Commit Graph

Author	SHA1	Message	Date
Michael Peter Christen	2de159719b	added an option to set 'obey nofollow' for links with rel="nofollow" attribute in the <a> tag for each crawl. This introduces a lot of changes because it extends the usage of the AnchorURL Object type which now also has a different toString method that the underlying DigestURL.toString. It is therefore not advised to use .toString at all for urls, just just toNormalform(false) instead.	11 years ago
reger	431a5f9c4e	added test case for TextSnippet, removed obsolete/unused parameter and reference to MediaSnippet	11 years ago

Author

SHA1

Message

Date

Michael Peter Christen

2de159719b

added an option to set 'obey nofollow' for links with rel="nofollow"

attribute in the <a> tag for each crawl. This introduces a lot of
changes because it extends the usage of the AnchorURL Object type which
now also has a different toString method that the underlying
DigestURL.toString. It is therefore not advised to use .toString at all
for urls, just just toNormalform(false) instead.

reger

431a5f9c4e

added test case for TextSnippet,

removed obsolete/unused parameter and reference to MediaSnippet

2 Commits (5082feb103742d30f1caa179a80766cf4d0a00d8)