You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter 764a40e37d speed enhancements for crawler and url retrieval (affects also search speed) ... - concurrency for LURL-fetching: this can be done using a concurrent lookup into the separated url databases. Concurrency is possible because there is no IO during lookup. The more LURL-Tables are present, the better is the speedup. More CPUs will increase speed - because a large number of LURL-lookups are made during crawling (for double-check), the LURL-Lookup speed enhancements enhances also crawling speed - search speed also profits from LURL-lookup enhancement - changed some flushing parameters in word index caching which should make better use of large word index caches and should speed up indexing - removed flush chunksize parameter, because this was only useful for IO path enhancement feature which was removed some weeks ago to prevent blocking and deadlocks during search requests git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4628 6c8d7289-2bf4-0310-a012-ef5d649a1542		17 years ago
..
de/anomic	speed enhancements for crawler and url retrieval (affects also search speed)	17 years ago
dbtest.java	- refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads	17 years ago
genpw.java	…
migration.java	…
screenshot.java	refactoring	17 years ago
yacy.java	- refactoring and abstraction of index reference (urls) handling: blacklisting is part of reference filtering	17 years ago