yacy_search_server

Commit Graph

Author	SHA1	Message	Date
luccioman	bf55f1d6e5	Started support of partial parsing on large streamed resources. Thus enable getpageinfo_p API to return something in a reasonable amount of time on resources over MegaBytes size range. Support added first with the generic XML parser, for other formats regular crawler limits apply as usual.	8 years ago
luccioman	a9cb083fa1	Improved consistency between loader openInputStream and load functions	8 years ago

Author

SHA1

Message

Date

luccioman

bf55f1d6e5

Started support of partial parsing on large streamed resources.

Thus enable getpageinfo_p API to return something in a reasonable amount
of time on resources over MegaBytes size range.
Support added first with the generic XML parser, for other formats
regular crawler limits apply as usual.

luccioman

a9cb083fa1

Improved consistency between loader openInputStream and load functions

2 Commits (5216c681a9971b921aea8c041106df8b2102055b)