Commit Graph

6 Commits (3944984840253d323a716f3d4f66e33ce630b441)

Author SHA1 Message Date
luccioman 0f80c978d6 Limit the number of initially previewed links in crawl start pages.
8 years ago
luc 8682dfbd5e Updated getpageinfo outputs to return page icons list.
9 years ago
Michael Peter Christen 85a427ec54 support for multiple sitemaps in robots.txt
11 years ago
cominch cef8ebc41d getpageinfo: Checks if there is a OAI repository behind the URL.
13 years ago
orbiter eb1c7c041d write info about robots.txt evaluation into getpageinfo_p.xml
13 years ago
orbiter f8b8c82421 - refactoring of getpageinfo_p.xml (moved out of util)
13 years ago