You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter b6fb239e74 redesign of parser interface: ... some file types are containers for several files. These containers had been parsed in such a way that the set of resulting parsed content was merged into one single document before parsing. Using this parser infrastructure it is not possible to parse document containers that contain individual files. An example is a rss file where the rss messages can be treated as individual documents with their own url reference. Another example is a surrogate file which was treated with a special operation outside of the parser infrastructure. This commit introduces a redesigned parser interface and a new abstract parser implementation. The new parser interface has now only one entry point and returns always a set of parsed documents. In case of single documents the parser method returns a set of one documents. To be compliant with the new interface, the zip and tar parser had been also completely redesigned. All parsers are now much more simple and cleaner in its structure. The switchboard operations had been extended to operate with sets of parsed files, not single parsed files. additionally, parsing of jar manifest files had been added. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6955 6c8d7289-2bf4-0310-a012-ef5d649a1542		15 years ago
..
retrieval	redesign of parser interface:	15 years ago
AbstractImporter.java	- cleanup, removed unused imports	15 years ago
Balancer.java	fixes and enhancements for balancer:	15 years ago
CrawlProfile.java	more abstraction of the htcache when using the LoaderDispatcher:	15 years ago
CrawlQueues.java	- added animated visualization for DHT-in and DHT-out in network graphic	15 years ago
CrawlStacker.java	added a 'transition feature' that shall lower the barrier to move from g**gle to yacy (yes!):	15 years ago
CrawlSwitchboard.java	fixed a bug in snippet fetch strategy: cache only does not help if resource can only be found in web	15 years ago
Importer.java	…
ImporterException.java	…
ImporterManager.java	*) some minor changes for better code readability	15 years ago
Latency.java	fixes to balancer when crawling filesystem (problem was: host == null)	15 years ago
NoticedURL.java	continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790	15 years ago
ResourceObserver.java	allow global search if res. observer disabled index transmission	15 years ago
ResultImages.java	redesign of parser interface:	15 years ago
ResultURLs.java	- more abstraction (HashMap -> Map)	15 years ago
RobotsEntry.java	redesign of remote proxy settings	15 years ago
RobotsTxt.java	better handling of OOM situations	15 years ago
SitemapImporter.java	applied code changes that are recommended by PMD	15 years ago
ZURL.java	possible fix for ZURL.list counter	15 years ago
robotsParser.java	- fixed a bug in robots.txt parser	15 years ago