yacy_search_server

History

Michael Peter Christen 8df8ffbb6d enhanced the snapshot functionality: - snapshots can now also be xml files which are extracted from the solr index and stored as individual xml files in the snapshot directory along the pdf and jpg images - a transaction layer was placed above of the snapshot directory to distinguish snapshots into 'inventory' and 'archive'. This may be used to do transactions of index fragments using archived solr search results between peers. This is currently unfinished, we need a protocol to move snapshots from inventory to archive - the SNAPSHOT directory was renamed to snapshot and contains now two snapshot subdirectories: inventory and archive - snapshots may now be generated by everyone, not only such peers running on a server with xkhtml2pdf installed. The expert crawl starts provides the option for snapshots to everyone. PDF snapshots are now optional and the option is only shown if xkhtml2pdf is installed. - the snapshot api now provides the request for historised xml files, i.e. call: http://localhost:8090/api/snapshot.xml?urlhash=Q3dQopFh1hyQ The result of such xml files is identical with solr search results with only one hit. The pdf generation has been moved from the http loading process to the solr document storage process. This may slow down the process a lot and a different version of the process may be needed.		10 years ago
..
content	…
importer	Replaced all fixed thread pools with cached thread pools. The cached	10 years ago
language	…
parser	enhanced the snapshot functionality:	10 years ago
AbstractParser.java	…
Condenser.java	skip to tokenize punktuation as word in WordTokenizer	10 years ago
Document.java	…
ImageParser.java	…
LargeNumberCache.java	…
LibraryProvider.java	…
Parser.java	…
Phrase.java	…
SentenceReader.java	…
SnippetExtractor.java	skip unused call parameter for hashSentence()	10 years ago
TextParser.java	…
WordTokenizer.java	skip unused call parameter for hashSentence()	10 years ago