4 Commits (f2c479fe88daf26d2b688f81331e4f4ea8b1ef4d)

Author	SHA1	Message	Date
luccioman	acab6a6def	Also handle text content when parsing XML within limits.	8 years ago
luccioman	ed678186a8	Updated xml parser limited parsing test for use latest jdk.	8 years ago
luccioman	bf55f1d6e5	Started support of partial parsing on large streamed resources. ... Thus enable getpageinfo_p API to return something in a reasonable amount of time on resources over MegaBytes size range. Support added first with the generic XML parser, for other formats regular crawler limits apply as usual.	8 years ago
luccioman	319231a458	Added a generic XML parser, able to parse elements text and URLs. ... This parser adds support for any XML based format other than already supported XML vocabularies such XHTML, RSS/Atom feeds... It will eventually be used as a fallback if one of these specific parsers fail, before falling back to the existing genericParser which extracts not that much useful information except URL tokens.	8 years ago