Commit Graph

6 Commits (f8b94f98916871cbea587bc24a99b72aa6389025)

Author SHA1 Message Date
luccioman 0f80c978d6 Limit the number of initially previewed links in crawl start pages.
8 years ago
luc 8682dfbd5e Updated getpageinfo outputs to return page icons list.
9 years ago
Michael Peter Christen 85a427ec54 support for multiple sitemaps in robots.txt
11 years ago
cominch cef8ebc41d getpageinfo: Checks if there is a OAI repository behind the URL.
13 years ago
orbiter eb1c7c041d write info about robots.txt evaluation into getpageinfo_p.xml
13 years ago
orbiter f8b8c82421 - refactoring of getpageinfo_p.xml (moved out of util)
13 years ago