yacy_search_server

History

Michael Peter Christen 66b5a56976 Added and integrated new date detection class which can identify date notions within the fulltext of a document. This class attempts to identify also dates given abbreviated or with missing year or described with names for special days, like 'Halloween'. In case that a date has no year given, the current year and following years are considered. This process is therefore able to identify a large set of dates to a document, either because there are several dates given in the document or the date is ambiguous. Four new Solr fields are used to store the parsing result: dates_in_content_sxt: if date expressions can be found in the content, these dates are listed here in order of the appearances dates_in_content_count_i: the number of entries in dates_in_content_sxt date_in_content_min_dt: if dates_in_content_sxt is filled, this contains the oldest date from the list of available dates #date_in_content_max_dt: if dates_in_content_sxt is filled, this contains the youngest date from the list of available dates, that may also be possibly in the future These fields are deactiviated by default because the evaluation of regular expressions to detect the date is yet too CPU intensive. Maybe future enhancements will cause that this is switched on by default. The purpose of these fields is the creation of calendar-like search facets, to be implemented next.		10 years ago
..
MonitoredReader.java	…
TablesRowComparator.java	…
YMarkAutoTagger.java	Added and integrated new date detection class which can identify date	10 years ago
YMarkCrawlStart.java	enhanced the snapshot functionality:	10 years ago
YMarkDMOZImporter.java	…
YMarkDate.java	…
YMarkEntry.java	…
YMarkHTMLImporter.java	…
YMarkImporter.java	…
YMarkJSONImporter.java	…
YMarkMetadata.java	better error handling for remote solr queries and exists-checks	11 years ago
YMarkTables.java	…
YMarkTag.java	…
YMarkUtil.java	…
YMarkXBELImporter.java	…