4 Commits (5f3e2ef3536b21493f13e0da9dc4d84b23b76f7c)

Author	SHA1	Message	Date
luccioman	acab6a6def	Also handle text content when parsing XML within limits.	8 years ago
luccioman	452a17a8d5	Finer control on bounded input streams with custom stream implementation	8 years ago
luccioman	bf55f1d6e5	Started support of partial parsing on large streamed resources. ... Thus enable getpageinfo_p API to return something in a reasonable amount of time on resources over MegaBytes size range. Support added first with the generic XML parser, for other formats regular crawler limits apply as usual.	8 years ago
luccioman	319231a458	Added a generic XML parser, able to parse elements text and URLs. ... This parser adds support for any XML based format other than already supported XML vocabularies such XHTML, RSS/Atom feeds... It will eventually be used as a fallback if one of these specific parsers fail, before falling back to the existing genericParser which extracts not that much useful information except URL tokens.	8 years ago