boxtec
/
yacy_search_server
mirror of https://github.com/yacy/yacy_search_server
4
1
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'd223cf0ae4'
${ noResults }
yacy_search_server/source/net/yacy/crawler/robots
History
Michael Peter Christen 9b1958e8ca
more ipv6 bugfixes 		10 years ago
..
RobotsTxt.java more ipv6 bugfixes 10 years ago
RobotsTxtEntry.java support for multiple sitemaps in robots.txt 11 years ago
RobotsTxtParser.java support for multiple sitemaps in robots.txt 11 years ago