Commit Graph

3 Commits (a8a5df4a51f75b7c0fa75b3318fa33ccc3d59737)

Author SHA1 Message Date
orbiter 9b0ae4b989 added referrer to remote crawl url list
18 years ago
orbiter 89b9b2b02a redesigned remote crawl process:
18 years ago
orbiter bb426565f0 added new yacy protocol for mass url-pull for better remote crawling distribution
18 years ago