Commit Graph

2 Commits (51b48a10e84c421fe65ac551bb7cf56f8e9f85a4)

Author SHA1 Message Date
theli 0aafb83edc *) Bugfix for robots.txt isDisallowed Check.
20 years ago
theli f8ad65eae1 *) First trial implementation of robots.txt support
20 years ago