yacy_search_server

History

orbiter 161d2fd2ef redesign of access to the HTCache (now http.client.Cache): - better control to the cache by using combined request-header and content access methods - refactoring of many classes to comply to this new access method - make shure that the cache is always written if something was loaded - some redesign of the process how http response results are feeded into the new indexing queue - introduction of a cache read policy: * never use the cache * use the cache if entry exist * use the cache if the proxy freshness rule confirmes * use only the cache and go never online - added configuration options for the crawl profiles to use the new cache policies. There is not yet a input during crawl start to set the policy but this will be added in another step. - set the default policies for the existing crawl profiles. If you want them to appear in your default profiles you must delete the crawl profiles database; othervise the policy is 'proxy freshness rule' - enhanced some cache access methods in such a way that unnecessary retrievals are omitted (i.e. for size computation). That should reduce some IO but also a lot of CPU computation because sizes were computed after decompression of content after retrieval of the content from the disc. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6239 6c8d7289-2bf4-0310-a012-ef5d649a1542		16 years ago
..
list	…
wiki	refactoring:	16 years ago
AbstractBlacklist.java	…
Blacklist.java	…
DefaultBlacklist.java	…
SitemapParser.java	redesign of access to the HTCache (now http.client.Cache):	16 years ago
URLAnalysis.java	…
URLLicense.java	…
blogBoard.java	removed strange debugging strings	16 years ago
blogBoardComments.java	removed strange debugging strings	16 years ago
bookmarksDB.java	redesign of access to the HTCache (now http.client.Cache):	16 years ago
diff.java	refactoring of parsers and document processing	16 years ago
listManager.java	refactoring:	16 years ago
messageBoard.java	removed strange debugging strings	16 years ago
translator.java	removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency.	16 years ago
userDB.java	refactoring:	16 years ago