Commit Graph

115 Commits (ea427df944c14b06a10f5a2dad8db8f3a1951b24)

Author SHA1 Message Date
orbiter 1d8d51075c refactoring:
16 years ago
orbiter 5bb8074150 removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency.
16 years ago
orbiter dafffd0153 refactoring of parsers and document processing
16 years ago
orbiter ce1adf9955 serialized all logging using concurrency:
16 years ago
orbiter 88426912ad more refactoring to make the segment object easier to use and to be prepared to integrate author navigation
16 years ago
orbiter 99bf0b8e41 refactoring of plasmaWordIndex:
16 years ago
orbiter 63a0255166 - refactoring: added new content package, which will contain connector classes for different types of data sources to import texts into the YaCy index
16 years ago
orbiter d3f8aa5a2a set of small fixes
16 years ago
lotus daea87d436 do not accept dht from bad versions
16 years ago
orbiter fa3adbbfc6 added domain checks to surrogate reader and RWI transfer receiver to prevent spaming using surrogates
16 years ago
orbiter c8624903c6 full redesign of index access data model:
16 years ago
orbiter 44e01afa5b - refactoring
16 years ago
orbiter c2359f20dd refactoring: better abstraction of reference and metadata prototypes.
16 years ago
orbiter 83792d9233 more refactoring
16 years ago
orbiter 474aac65af more refactoring
16 years ago
orbiter 7f67238f8b refactoring of plasmaWordIndex: less methods in the class, separated the index to CachedIndexCollection
16 years ago
orbiter 14a1c33823 refactoring of wordIndex class
16 years ago
orbiter aa44d9bad9 more refactoring of kelondro.text / deleted de.anomic.index
16 years ago
orbiter 6ffc6e3389 more refactoring of indexer and kelondro classes;
16 years ago
orbiter 76ef5f0f14 refactoring of index package: better names for the classes (to be continued)
16 years ago
orbiter 94c42691d8 - reject less transmissions as transmission receiver
16 years ago
orbiter 6a32193916 - refactoring of cache naming in web index cache (no more dht semantics there)
16 years ago
orbiter c25c334b75 replaced old DHT transmission method with new method. Many things have changed! some of them:
16 years ago
orbiter 94110df85a moved logging partially to kelondro
16 years ago
orbiter 024da2916b refactoring of logging
16 years ago
orbiter dedfc7df7f removed distinction between DHT-in and DHT-out. This is necessary to make room for the new cell data structure, which cannot use this this distinction in the first place, but will enable the same meaning with different mechanisms (segments, later)
16 years ago
orbiter efe801173c better dht-in cache flush. see also:
16 years ago
orbiter 47292e696a more performance hacks
16 years ago
orbiter d014b2728a Design-check, Extension and Refactoring of DHT target position computation:
16 years ago
orbiter 05dbba4bab added logging conditions to all fine and finest log line calls
16 years ago
danielr cd19d0aee6 - added warnings for failed transferRWI (dht-in)
16 years ago
orbiter 536e77e8b7 modifications towards a single database operation to read/write http header and cached file at once:
16 years ago
danielr 3bb870bfcd added final where possible
17 years ago
orbiter c3d461d191 - removed superfluous copyright statement
17 years ago
orbiter 3ca98fee42 removed superfluous copyright statement
17 years ago
danielr 7feae906aa - organize imports
17 years ago
orbiter cfe6790498 - added option to switch between yacy networks, especially between the two default networks (freeworld and intranet),
17 years ago
orbiter db032fb6de - added RWI transmissions to the event terminal
17 years ago
orbiter d2ba1fd2ab major step forward to network switching (target is easy switch to intranet or other networks .. and back)
17 years ago
orbiter 512f48e7d6 - removed unused methods
17 years ago
orbiter 14384e7a45 deactivated unnecessary and very CPU-intensive deletion check for blacklisted URLs in index receive
17 years ago
orbiter 7f9f639d20 - refactoring and abstraction of index reference (urls) handling: blacklisting is part of reference filtering
17 years ago
orbiter d6050b9ffb - separated the LURL data storage and Crawl result stack for process supervision.
17 years ago
orbiter 541b817502 refactoring of switchboard queueing
17 years ago
orbiter 5530b8e1ca reverted changes to yacy protocol classes: they caused the sciencenet to loose connections
17 years ago
orbiter f4c73d8c68 - fixed highslide usage
17 years ago
borg-0300 77ba446332 seedDB helpers update/cleanup
17 years ago
borg-0300 85a82950e0 seedDB helpers
17 years ago
orbiter a6ca3b51be more generics
17 years ago
orbiter a5054c038d - added large number of generics
17 years ago