You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter 161d2fd2ef redesign of access to the HTCache (now http.client.Cache): ... - better control to the cache by using combined request-header and content access methods - refactoring of many classes to comply to this new access method - make shure that the cache is always written if something was loaded - some redesign of the process how http response results are feeded into the new indexing queue - introduction of a cache read policy: * never use the cache * use the cache if entry exist * use the cache if the proxy freshness rule confirmes * use only the cache and go never online - added configuration options for the crawl profiles to use the new cache policies. There is not yet a input during crawl start to set the policy but this will be added in another step. - set the default policies for the existing crawl profiles. If you want them to appear in your default profiles you must delete the crawl profiles database; othervise the policy is 'proxy freshness rule' - enhanced some cache access methods in such a way that unnecessary retrievals are omitted (i.e. for size computation). That should reduce some IO but also a lot of CPU computation because sizes were computed after decompression of content after retrieval of the content from the disc. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6239 6c8d7289-2bf4-0310-a012-ef5d649a1542		16 years ago
..
FTPLoader.java	redesign of access to the HTCache (now http.client.Cache):	16 years ago
HTTPLoader.java	redesign of access to the HTCache (now http.client.Cache):	16 years ago
LoaderDispatcher.java	redesign of access to the HTCache (now http.client.Cache):	16 years ago
Request.java	redesign of access to the HTCache (now http.client.Cache):	16 years ago
Response.java	redesign of access to the HTCache (now http.client.Cache):	16 years ago