You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
orbiter
764a40e37d
speed enhancements for crawler and url retrieval (affects also search speed)
...
- concurrency for LURL-fetching: this can be done using a concurrent lookup into the separated url databases. Concurrency is possible because there is no IO during lookup. The more LURL-Tables are present, the better is the speedup. More CPUs will increase speed
- because a large number of LURL-lookups are made during crawling (for double-check), the LURL-Lookup speed enhancements enhances also crawling speed
- search speed also profits from LURL-lookup enhancement
- changed some flushing parameters in word index caching which should make better use of large word index caches and should speed up indexing
- removed flush chunksize parameter, because this was only useful for IO path enhancement feature which was removed some weeks ago to prevent blocking and deadlocks during search requests
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4628 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
..
logging
- fixed bug with too much RAM in crawler queue
17 years ago
portForwarding
- refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads
17 years ago
serverAbstractBlockingThread.java
enhanced the concurrency handling of indexing process (better queue size control, better data concept, better shutdown behavior)
17 years ago
serverAbstractBusyThread.java
added concurrency to indexing process:
17 years ago
serverAbstractSwitch.java
- refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads
17 years ago
serverAbstractThread.java
- refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads
17 years ago
serverBlockingThread.java
enhanced the concurrency handling of indexing process (better queue size control, better data concept, better shutdown behavior)
17 years ago
serverBusyThread.java
added concurrency to indexing process:
17 years ago
serverByteBuffer.java
…
serverCachedFileOutputStream.java
…
serverCharBuffer.java
…
serverClassLoader.java
more generics
17 years ago
serverCodings.java
modified dir servlet to cooperate with intranet indexing from the own HTDOCS repository:
17 years ago
serverCore.java
speed enhancements for crawler and url retrieval (affects also search speed)
17 years ago
serverCoreSocket.java
…
serverDate.java
…
serverDomains.java
more multithreading support:
17 years ago
serverFileUtils.java
- next try to fix the networking problem:
17 years ago
serverHandler.java
some code enhancements and bugfixes
17 years ago
serverInstantBlockingThread.java
enhanced the concurrency handling of indexing process (better queue size control, better data concept, better shutdown behavior)
17 years ago
serverInstantBusyThread.java
- refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads
17 years ago
serverMemory.java
consistent use of de.anomic.server.serverMemory to get information about memory statistics
17 years ago
serverObjects.java
experiments wit openstreetmaps
17 years ago
serverPlainSwitch.java
refactoring of switchboard queueing
17 years ago
serverProcessor.java
enhanced the concurrency handling of indexing process (better queue size control, better data concept, better shutdown behavior)
17 years ago
serverProcessorJob.java
enhanced the concurrency handling of indexing process (better queue size control, better data concept, better shutdown behavior)
17 years ago
serverProfiling.java
addition/correction to last commit: usage of concurrent-classes
17 years ago
serverSemaphore.java
…
serverSwitch.java
- refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads
17 years ago
serverSwitchAbstractAction.java
…
serverSwitchAction.java
…
serverSystem.java
- next try to fix the networking problem:
17 years ago
serverThread.java
- refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads
17 years ago
servletProperties.java
…