You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter 54af9e6b49 - added parsing of robots meta-tag in html headers to detect a noindexing request ... - added evaluation and indexing prevention in case that a noindexing is given in a html file git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6709 6c8d7289-2bf4-0310-a012-ef5d649a1542		15 years ago
..
AbstractScraper.java	refactoring of yacy documents and parsers: they depend now only on the kelondro classes	16 years ago
AbstractTransformer.java	refactoring of yacy documents and parsers: they depend now only on the kelondro classes	16 years ago
CharacterCoding.java	preset of proper HashMap dimensions: should prevent re-hashing and increase performance	15 years ago
ContentScraper.java	- added parsing of robots meta-tag in html headers to detect a noindexing request	15 years ago
ContentTransformer.java	applied code changes that are recommended by PMD	15 years ago
ImageEntry.java	added json and rss output for image search	15 years ago
Scraper.java	refactoring of yacy documents and parsers: they depend now only on the kelondro classes	16 years ago
ScraperInputStream.java	applied code changes that are recommended by PMD	15 years ago
ScraperListener.java	refactoring of yacy documents and parsers: they depend now only on the kelondro classes	16 years ago
Transformer.java	refactoring of yacy documents and parsers: they depend now only on the kelondro classes	16 years ago
TransformerWriter.java	applied code changes that are recommended by PMD	15 years ago