3 Commits (4177c9cf050036d9c4091dc52d49c009890de0aa)

Author	SHA1	Message	Date
Michael Peter Christen	f23c4142e0	added option to configure a custom user agent within allip networks	11 years ago
Michael Peter Christen	a2fba6584f	use submitted default userAgent if cloning a crawl	11 years ago
orbiter	d29b6db270	made crawl start pages public since they do not reveal individual ... information and they are also not used as servlet to actually start the crawl (which is Crawler_p.html).	11 years ago