You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 0a879c98e7 added new 'firstSeen' database table and necessary data structures which ... hold a date for each URL to record when a url was first seen. This is then used to overwrite the modification date for urls upon recrawl in case that the first-seen date is before the latest document date. This behaviour is necessary due to the common behaviour of content management systems which attach always the current date to all documents. Using the firstSeen database it is possible to approximate a real first document creation date in case that the crawler starts frequently for the same domain. As a result the search results ordered by date have a much better quality and the usage of YaCy as search agent for latest news has a better quality.		10 years ago
..
DocumentIndex.java	added an option to set 'obey nofollow' for links with rel="nofollow"	11 years ago
ErrorCache.java	concurrently initialize the error cache; extended also the cache by	10 years ago
Fulltext.java	fix assertation-failure in version-string for Solr-4.10.2 by changing	10 years ago
ReindexSolrBusyThread.java	removed unused options from BusyThreads	10 years ago
Segment.java	added new 'firstSeen' database table and necessary data structures which	10 years ago