Commit Graph

450 Commits (d547c3b4bd3e2a44f62b5241f5d0866d28815bab)

Author SHA1 Message Date
orbiter c75cacda95 added a flex-width-array: this is a table where it is
19 years ago
orbiter 4a907a570f 1st step to migrate kelondroTree to usage of kelondroRow instead of byte[][]
19 years ago
orbiter 572d53506c new kelondroRow objects now replace byte[][] objects in object cache
19 years ago
orbiter 89424ff122 multiple bugfixes for new stack/row features
19 years ago
orbiter 3c3c047d0a integrated kelondroRow into kelondroStack
19 years ago
orbiter 5bb565944f integration of new kelondroRow into some parts of kelondro,
19 years ago
orbiter d580f582dc update to row/column handling
19 years ago
orbiter 196b8abb30 refactoring
19 years ago
orbiter 24686e50a2 - fixed a caching bug
19 years ago
orbiter 899c1a5df5 integrated cell-, and row-management classes
19 years ago
orbiter 4d8f8ba384 added cache-performance analysis for node caches
19 years ago
orbiter 1b4a27cd99 added monitoring for new miss-cache
19 years ago
orbiter bd057b44dd - automatic setting of peer-does-not-accept-remote-crawl
19 years ago
orbiter 912116c5a7 renew cache update time if a cache-read hit happens
19 years ago
orbiter 81e79f2caf fixed new cache behaviour changes
19 years ago
orbiter 545f81b317 bugfix
19 years ago
orbiter cda087f43b - integrated cache miss storage into object cache
19 years ago
orbiter af098b815c - fix for blog/wiki error
19 years ago
orbiter 74a78ebd78 turned back handling of map-writing into kelondro because of possible bug for testing
19 years ago
orbiter e656a00b74 removed some unused methods
19 years ago
orbiter 338047e056 replaced kelondroDyn write methods for properties and maps by faster version
19 years ago
orbiter b40f0edbe5 replaced property- and map-reader in AbstractRA by much faster version
19 years ago
orbiter 7f28a1a4cb another fix in kelondroDyn: construction of getDyn chunks was not clean
19 years ago
orbiter bb931c7b83 fix for some improper details in kelondroDyn
19 years ago
orbiter 19c6e67003 - added generation of news for blog entries
19 years ago
auron_x 55ea4cbfe6 *)reverted patch for memory-display issue
19 years ago
auron_x 53d9ab6db7 *)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers
19 years ago
orbiter d4b4812732 extended kelondroDyn with new objectBuffer
19 years ago
orbiter 35995cf8c7 some enhancements to caching and kelondroRA-methods
19 years ago
orbiter 2e89477f22 undoing last change
19 years ago
orbiter a3a4525931 usage of a buffer to prevent too many cache lookups in kelondroMap
19 years ago
orbiter 55c5b41bd0 modified kelondroDyn to work better with new object caches
19 years ago
orbiter 3e31820c3d - corrections to PerformanceMemory display of object cache
19 years ago
orbiter 29b1b0823c added monitoring of new object cache to performanceMemory page
19 years ago
orbiter 23ced30e83 fixed a bug in new caching
19 years ago
orbiter bab9ee38e7 added very experimental object cache for all kelondroTree
19 years ago
orbiter e9aadb2e11 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19765#19765
19 years ago
orbiter 5defe97ccb fixed a problem / possible bug with ordering implementation (did not rotate always)
19 years ago
rramthun 250864406f ...
19 years ago
orbiter a37b09e303 implemented automatic adoption of chunk-read-ahead in kelondroTree to needed chunk size
19 years ago
orbiter 526407f32e adoptions, fixes for last commit
19 years ago
orbiter 488a0ed580 replaced old keyIterator and rowIterator by buffered iterators
19 years ago
orbiter dba02f399f starting of re-design of kelondroTree iterator
19 years ago
orbiter f02b426073 made kelondroTree.nodeIterator private
19 years ago
orbiter 431a4f3609 eliminated correcting iterator in kelondroTree
19 years ago
orbiter 9cca36a107 no more strict comparator checking in map exclude method if not needed
19 years ago
orbiter 4239db0d1c fixed new ordering for backup iterator TreeSet
19 years ago
orbiter f0464042fc fix for latest iterator-replacement-fix:
19 years ago
orbiter bcd99fe83e introduced a second RAM cache for DHT transfer
19 years ago
orbiter 69d26045eb quick-fix for http://www.yacy-forum.de/viewtopic.php?p=18805#18805
19 years ago
orbiter be88687d8c fixed some problems with new cache flush karenz
19 years ago
orbiter c51603a405 added two new kelondro classes that will handle the new index data structures (not used yet)
19 years ago
orbiter ba5fe0b287 fixed (again) nullPointerException in kelondroTree
19 years ago
orbiter 0017812b2e bugfix for null compare
19 years ago
orbiter 01c668fe1b experimental disabling of db write buffer
19 years ago
orbiter 4438a96b87 tried to fix "Object type or Object type combination not supported" bug
19 years ago
orbiter c70befbe9c added xml read/write example file: kelondroXMLTables
19 years ago
orbiter 785763d070 added debug output for "Object type or Object type combination not supported" bug.
19 years ago
hermens 56936139ae Fix logging in kelondroTree:
19 years ago
orbiter 3419b3bcdd fix for bug that caused the peer-counter problem.
19 years ago
orbiter 03c65742ba changes towards the new index storage scheme:
19 years ago
rramthun 84a00e5673 Use YaCy logging instead of something I don't understand.
19 years ago
orbiter b9d73f63e7 replaced String object in loop detection by byte[] to omit String-generation
19 years ago
orbiter 47843e69e2 auto-reset for switchboard queue stack
19 years ago
orbiter a70970f993 fixed increment in content iterator
19 years ago
orbiter d6581c445b added content iterator for corrupted database files
19 years ago
orbiter bb2095fe39 assortment files are now not deleted, but shifted to a backup directory.
19 years ago
orbiter 7366e39dd3 tried to fix 100% CPU bug.
19 years ago
orbiter 0371494010 tried to add word position to index
19 years ago
hermens 84fce71d11 *) correct merging of indexes when enumerating downward
19 years ago
orbiter d45b1162e2 signature fix
19 years ago
orbiter c51e18c4ad - added signatures to ordering
19 years ago
orbiter 38b19ff56a another bugfix to the correctedNodeIterator
19 years ago
orbiter 45c44ca9c8 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1717
19 years ago
orbiter c137683a5c added patch to correct tree-iterator
19 years ago
orbiter 2028403670 - consolidated different orderings to kelondroNaturalOrder
19 years ago
orbiter 9544c47684 added some UTF-8 handling.
19 years ago
orbiter a125fee9ce fixed iterator
19 years ago
orbiter 33f8920e1c new database format: splitted trees, using an ordering to split the tree
19 years ago
orbiter 10a095d6b5 - added base64 ordering methods
19 years ago
orbiter 9086261476 refactoring of base64 encoding:
19 years ago
orbiter 7c0d7ed4f8 introduction of generic order interface for kelondro
19 years ago
orbiter 60fc34d9e8 iterartion bug:
19 years ago
rramthun 45ebe477ee Bugfix for http://www.yacy-forum.de/viewtopic.php?p=14175
19 years ago
orbiter 83a34b838d * added Object allocation monitor on performanceMemory page
19 years ago
orbiter 3031903d50 re-design of RAM cache flush into assortment cluster
19 years ago
orbiter 676e384b45 changed synchronization to fix 'contains loops' bug in kelondroTree
19 years ago
orbiter 3cc02fe749 enhanced buffered write by combination of several chunks into one chunk
19 years ago
orbiter 0c762daf4b better startup failure handling
19 years ago
orbiter f27f9ecf15 * activated write buffer for databases.
19 years ago
orbiter c59d1b2f5e - Tests with write buffer (new class kelondroBufferedIOChunks, not yet active)
19 years ago
orbiter ca7e60279d introduced IOChunks.
19 years ago
orbiter fed92d364b introduced USAGE object for counter synchronization in kelondroRecords
19 years ago
orbiter 356231b033 changed only for testing with new hastable implementation.
19 years ago
orbiter 1041f4946a experiments with locks to remove synchronization
19 years ago
orbiter 288b2c353e debugging of kelondroRecords ... possibly synchronization bugs found
19 years ago
orbiter 37f88b4017 code cleanup
19 years ago
orbiter ec2b39c1ce code cleanup
19 years ago
orbiter 76618442e0 code cleanup
19 years ago
orbiter 3d8a5ae652 code cleanup
19 years ago
orbiter 7920e1547d code cleanup
19 years ago
orbiter a04930f025 code cleanup
19 years ago
theli 7028412c54 *) Bugfix for NullpointerException in Java Finalizer
19 years ago
orbiter 420d56ce79 extended db-testing
19 years ago
orbiter 40621a5663 anhancements in ranking preparation and fixed problem with parser/mime recognition
19 years ago
orbiter 85282b1d98 enhanced YBR recognition and search result heuristics
19 years ago
orbiter 0e25020f51 added first generation and usage of YBR index-files. Enhanced overall ranking of search results.
19 years ago
orbiter bfe51c7228 added generation of domain-list
19 years ago
orbiter 0ec54d9c5f enhanced CR-file handling and added first RCI-evaluation tests
19 years ago
theli c2fe3a1670 *) Updating jMimeMagic Ruleset
19 years ago
orbiter 88e3234393 fine-tuning of rci-generation
19 years ago
orbiter a12759c1bf first try to implement a rci-computation from cr-files
19 years ago
orbiter 4a8e8f269e refactoring of cr-processing; new kelondro class to handle the attribute file format
19 years ago
orbiter 24dc0e0760 implemented cr-file processing and further transmission steps
19 years ago
orbiter 022530df7e small bugfix in kelondroTree
19 years ago
orbiter 9913049009 fixed outOfMemory bug caused by loops in kelondroTree during enumeration
19 years ago
orbiter a3fd0069f5 fixed bug in kelondroTree node iteration (rotation did not work)
19 years ago
orbiter 6dc42a2392 detecting of loops in kelondroTree during last/first-Node search
19 years ago
orbiter 5b0911d7ea added new performance menu for search sequence configuration and monitoring
19 years ago
orbiter 4fa942511b de-serialized read and write access
19 years ago
orbiter 1ff0ced515 integration of an interface class for abstract access of kelondro indexed structures like kelondroTree and kelondroHashtable
19 years ago
orbiter 8d827cdb30 tried to fix problems with order of network list by last-seen (which could also improve the network picture)
19 years ago
theli b7e21ec107 *) Adding DB import function which allows to import an foreign yacy DB (from directory PLASMADB)
19 years ago
theli 959eefbc4f *) Robots.txt parser/ppt
19 years ago
borg-0300 4191b21e73 cleaned, finals, Properties
19 years ago
theli a2fa75e688 *) Asynchronous queuing of crawl job URLs (stackCrawl)
19 years ago
orbiter f6a0e0f162 small bugfix to readFully
19 years ago
orbiter 6d5d0ac801 bugfix for startup problems
19 years ago
orbiter 5dc0d41900 bugfix in kelondroRA (hint by Martin)
19 years ago
orbiter 25a59a51ad fixed problem created with last svn commit
19 years ago
orbiter 72ce36baba cleanup in kelondroRecords
19 years ago
orbiter e380d4e55e cleanup (no functional change)
19 years ago
orbiter de0a58d79c no more sync
19 years ago
orbiter 495bc8bec6 removed cache-control from low and medium priority caches which reduces memory use and computation overhead
19 years ago
orbiter 979a3ee3c0 exceptions for better testing of bug http://www.yacy-forum.de/viewtopic.php?p=9852#9852
19 years ago
orbiter 18d9e1a256 fix for http://www.yacy-forum.de/viewtopic.php?p=10026#10026
19 years ago
orbiter ef85fce661 change of memory-consumption constants (had been much too low)
19 years ago
borg-0300 6d1de8abfd finals; cleaned;
19 years ago
orbiter fb52a82008 added new performance page for memory settings
19 years ago
orbiter e6b30911c3 small changes to caching
19 years ago
orbiter 900ab97422 change of memory-allocation blocking value for GC prevention
19 years ago
orbiter 0ffca99886 added priority-organization to kelondroRecord cache. This should virtually double the cache capacity.
19 years ago
orbiter 2d22626386 automatic switch-off of cache control in kelondroRecords in case that cache is big enough (so that no cache-aging needs to be controled)
19 years ago
orbiter cddd9aaa33 fixed SERIOUS bug with kelondroStack; affected all stack processing since 729
19 years ago
orbiter 19547f1821 changed node manipulation methods in kelondro core to reduce object allocation
19 years ago
orbiter debb207a74 removed file sync
19 years ago
orbiter 2148c0cf49 replaced kelondro storage core; much less objects in kelondro cache now; less IO from DB
19 years ago
orbiter 43b42854a0 fix for null-entries and http://www.yacy-forum.de/viewtopic.php?p=8649
19 years ago
theli bead8a32aa *) IndexCreate_p.java:
19 years ago
theli 6adf8a4bde *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
19 years ago
theli b33094e925 *) Trying to solve "Too many open files bug"
19 years ago
theli b67f008eb8 *) Trying to solve "Too many open files bug"
19 years ago
orbiter 5716f8521d bug fixes for word ordering and dht index selection
20 years ago
orbiter c796a38424 doc update
20 years ago
orbiter 40da910f41 bugfixes and automatic news-cleanup
20 years ago
orbiter e84a177c49 many bigfixes
20 years ago
orbiter 5672709ef3 several bugfixes for YaCyNews
20 years ago
orbiter 1022fbeb65 many YaCyNews fixes
20 years ago
orbiter ad90f0ad13 activated RWI distribution to DHT for senior peers (default redundancy 3), necessary now for network growth
20 years ago
orbiter 3470a72d48 fixed div by zero, set default delays, fixed release number format and display
20 years ago
orbiter 0f663bcebf added global ppm computation
20 years ago
orbiter 1d2155675b changed assortment memory cache flush
20 years ago
orbiter 19dbed7cc8 code clean-up
20 years ago
orbiter 311e627363 blocking of blacklisted urls in indexReceive and small changes
20 years ago
orbiter 858cd94299 replaced indexing ram-queue by file-based stack-queue
20 years ago
orbiter 3addf58046 enhanced snippet-loading with threads
20 years ago
orbiter 4afcf10158 added kelondroHashtable (not finished yet)
20 years ago
orbiter 1e7f062350 many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets
20 years ago
orbiter 68dc2b0c6b added kelondroArray, the basis for upcoming kelondroHash and some bug fixes
20 years ago
orbiter 5728cdf8b5 bugfix
20 years ago
orbiter a19541e563 code-enhancements after analysis with AppPerfect
20 years ago
orbiter 85075269a6 extended fail-safe memory-managament. prevents too much allocation, too often GC and should help for the 100%CPU-bug
20 years ago
orbiter e3c92818db avoiding OutOfMemoryError routines
20 years ago
orbiter 3e8ee5a46d enhanced caching in kelondroRecords and added better synchronization/finalizer
20 years ago
orbiter 3be98f194d tried to find the socket bug
20 years ago
theli 9e47ba5ad6 *) adding missing calls for function close() to avoid "too many open file" bug
20 years ago
theli 451ca6b818 *) changing reference to logger
20 years ago
orbiter e89ded9e41 bugfixes
20 years ago
orbiter 650ca3955a added flush-thread for index cache and added language-name mapping in Language_p
20 years ago
orbiter f8f8dd05db fixed "Too many open files" - bug
20 years ago
orbiter 4b01ff7548 activated assortments, removed write-queues
20 years ago
orbiter e26ac60c3e modified assortment data structures
20 years ago
orbiter 287d2e6f10 further enhanced caching (new cache flush methods)
20 years ago
orbiter ea478f3975 enhanced indexing-caching
20 years ago
theli a5fec449c8 *) setting threadnames for kelondroMap:writequeue and publishSeed
20 years ago
orbiter db1da3345d introduced singleton-database
20 years ago
orbiter a9b22647dc fixed bug in indexDump.stack - generation
20 years ago
orbiter 1d7fed87dc redesign of index caching - removed indexCache.db
20 years ago
theli 2aa5fe8f50 *) Import statements reorganized
20 years ago
orbiter c7c6aaf06e many bug-fixes
20 years ago
orbiter 995673d795 several bugfixes
20 years ago
orbiter 2de90020ed fixed caching+synchronization+brute-force-denial
20 years ago
theli 47e426ff7e *) one possible deadlock (because of nested object locks) removed in class kelondroMap
20 years ago
orbiter ba16da72b4 fixed not-working kelondroRecords-Cache
20 years ago
orbiter 7fb645b0ab enhanced crawling performance, changed memory settings, new performace options
20 years ago
orbiter 8b31f9e202 enhanced shut-down behaviour & added experimental nio-wrapper for kelondroRA (not active yet)
20 years ago
orbiter 96516fc9d8 fixed bugs (search+kelondroException, dns)
20 years ago
orbiter e374aca2cd enhanced exception handling in kelondro
20 years ago
orbiter 072052f150 fixed bugs (dns, seedDB)
20 years ago
orbiter 248077d3f0 initial load with yacy 0.36
20 years ago