Commit Graph

3 Commits (6eba2cb96b74cc8db4f4b4a117ce6fe6dd1cf854)

Author SHA1 Message Date
orbiter f204076d25 removed usage of temporary files: causes too much IO
15 years ago
orbiter 54af9e6b49 - added parsing of robots meta-tag in html headers to detect a noindexing request
15 years ago
orbiter b79f4f062f refactoring of yacy documents and parsers: they depend now only on the kelondro classes
16 years ago