Commit Graph

429 Commits (f05ca437806a51766a31e4a90c863218d4d53861)

Author SHA1 Message Date
orbiter 75b03a4580 fix for new ArrayIndexOutOfBoundException
18 years ago
orbiter 96c6e4e322 - enhancements to detailed search page
18 years ago
orbiter 9340dbb501 fixed all possible problems with nullpointer exception for LURLs
18 years ago
orbiter a2525072f2 bugfix for kelondroRow - property generation
18 years ago
orbiter 985dcbde7f changed some parameters that may cause better memory usage and more indexing speed
18 years ago
orbiter b7f4a1521b added options to switch on or off the kelondroFlexTable for NURL, EURL and PreNURL
18 years ago
orbiter c26da4893b turned back NURL usage of kelondroTree, kelondroFlexTable has still problems with deleted entries
18 years ago
orbiter db1eae0227 * simplified initialization of database objects
18 years ago
orbiter 135e019883 removed one superfluous line from last commit
19 years ago
orbiter 1591a55963 added object cache miss-cache use for remove method
19 years ago
orbiter 23dd972608 fixed memory calculation in performanceMemory web page
19 years ago
orbiter 3e9d509c39 some small fixes
19 years ago
orbiter 0187c60010 because of a bug in the JRE 1.4.2 there was no memory protection
19 years ago
orbiter 6ad471ef96 * applied many compiler warning recommendations
19 years ago
orbiter 8418af141a added several consistency checks and small changes
19 years ago
orbiter 9ae9062bd3 * disabled new kelondroFlex table for NURLs
19 years ago
orbiter 689bbcf9cd replaced kelondroTree db for NURLs by new kelondroFlexTable
19 years ago
orbiter 95160d7f2c fixed size computation of index elements from the collection index
19 years ago
orbiter abf22f6e60 removed url normalform computation from htmlFilterContentScraper.
19 years ago
orbiter 740d49751d * strict type and size check in kelondroRow handling
19 years ago
orbiter 61b151b083 * added another auto-fix for collection index inconsitency check
19 years ago
orbiter 0bbbd129ef small fix for exception message
19 years ago
orbiter 718fbc2dae enhancements in kelondroCollectionIndex:
19 years ago
orbiter d468d665c9 some changes that may help to prevent deadlocks that cause an OutOfMemoryError
19 years ago
orbiter 279b1d969d Integrated new indexing data structure 'collections' into the main class
19 years ago
orbiter 4ff742e42d implemented indexCollectionRI
19 years ago
orbiter 01f95eccd3 re-write of kelondroCollectionIndex. This is the data structure that
19 years ago
orbiter c4e922885a replaced indexURLEntry by new class that uses a kelondroRow.Entry object
19 years ago
orbiter e357599f92 * fixed problem with indexContainer iteration from RAM:
19 years ago
orbiter 8b77afd72c some fixes to new container merger
19 years ago
orbiter 830167596a bugfix for
19 years ago
orbiter 417ed5102e redesign of database iterators:
19 years ago
orbiter 58df8b7bbf a large collection of different changes
19 years ago
orbiter 40aa735520 fixe timing problem causing too long delay during initialization of kelondroTree objects
19 years ago
orbiter 671fd9a5c9 work towards new indexing database structure
19 years ago
orbiter 92f4cb4d73 added option to configure the start-up delay time for kelondro database files.
19 years ago
orbiter ce9dd3e76d some work in the index construction zone (no effect yet)
19 years ago
orbiter 3b69b35bf2 added pre-load of node cache entries to kelondroRecords
19 years ago
orbiter 85d575e928 enhancements to kelondroRow and kelondroColumn
19 years ago
orbiter ab1ed053f5 another small correction
19 years ago
orbiter b92561fb67 removed unused code
19 years ago
orbiter eadbd56fc5 small adjustment to last commit
19 years ago
orbiter e9765ac4e6 introduced bulk read for node iterator in kelondroRecords
19 years ago
orbiter 6af70febef - added kelondroTree index option to kelondroFlexTable
19 years ago
orbiter dd2865178a major bugfix (searched a whole week for the bug) for
19 years ago
orbiter f9b9d085c4 just changed testing code
19 years ago
orbiter ef84fc4956 added IOException to size() and row()
19 years ago
orbiter 84dfd76a6a kelondroFlex bugfix
19 years ago
orbiter e40987ecab removed default memory reservation for testing
19 years ago
orbiter 4cc6e6551f bugfix
19 years ago
orbiter 66964dc015 removed high/med/low from kelondroRecords cache control.
19 years ago
orbiter 41c4641612 added some profiling to kelondro caching classes
19 years ago
orbiter dd560e4b2f finetuning
19 years ago
orbiter 5b1d77cd4b some enhancements to caching
19 years ago
orbiter 650c7e9e55 some enhancements to caching
19 years ago
orbiter bde748f68f - integrated buffer in RowCollectionSet which speeds up the new
19 years ago
orbiter d083b15c4b tests/fixes
19 years ago
orbiter ce9a98ee25 experiments with buffer for collection class
19 years ago
orbiter 6aa0f6eb0f better abstraction, less synchronization
19 years ago
orbiter 1ec07fe351 better structure of the kelondro collection classes
19 years ago
orbiter 761d3bba54 integrated kelondroRowCollection in kelondroCollectionIndex
19 years ago
orbiter 8f0c1a240a added kelondroRowCollection and kelondroRowSet which
19 years ago
orbiter 4fa3271754 adopted memory calculation to new memory amount used by kelondroCollectionObjectMap
19 years ago
orbiter 11951aed41 replaced node cache Object type in kelondroTree:
19 years ago
orbiter 12af69dd86 cosmetics
19 years ago
orbiter ea72a7c580 added new objectMap (can replace HashMap and should use less memory, but is slower)
19 years ago
orbiter e8848a3532 bugfixing for new kelondroFlexTable
19 years ago
orbiter 75ed507d39 some debugging of new kelondroFlexTable class
19 years ago
orbiter 8a18302e84 some work on the intMap
19 years ago
orbiter 56084e9edc added a intMap, the new index management structure for kelondroFlexTables
19 years ago
orbiter eda055e729 - enhanced kelondroCollection speed
19 years ago
orbiter 5d2cd26529 enhanced kelondroCollection performance
19 years ago
orbiter 577a6e6487 some work on kelondroCollection, no effect on current YaCy functions
19 years ago
orbiter b30645305b some additions to kelondroCollection
19 years ago
orbiter 370c481fa7 bugfixes
19 years ago
orbiter c36e9fc8d3 full integration of kelondroRow
19 years ago
orbiter 6e49721762 completed and tested kelondroFlexTable
19 years ago
orbiter b68f7dec9d added stub of new table class
19 years ago
orbiter b21824ef16 added new array interface
19 years ago
orbiter c75cacda95 added a flex-width-array: this is a table where it is
19 years ago
orbiter 4a907a570f 1st step to migrate kelondroTree to usage of kelondroRow instead of byte[][]
19 years ago
orbiter 572d53506c new kelondroRow objects now replace byte[][] objects in object cache
19 years ago
orbiter 89424ff122 multiple bugfixes for new stack/row features
19 years ago
orbiter 3c3c047d0a integrated kelondroRow into kelondroStack
19 years ago
orbiter 5bb565944f integration of new kelondroRow into some parts of kelondro,
19 years ago
orbiter d580f582dc update to row/column handling
19 years ago
orbiter 196b8abb30 refactoring
19 years ago
orbiter 24686e50a2 - fixed a caching bug
19 years ago
orbiter 899c1a5df5 integrated cell-, and row-management classes
19 years ago
orbiter 4d8f8ba384 added cache-performance analysis for node caches
19 years ago
orbiter 1b4a27cd99 added monitoring for new miss-cache
19 years ago
orbiter bd057b44dd - automatic setting of peer-does-not-accept-remote-crawl
19 years ago
orbiter 912116c5a7 renew cache update time if a cache-read hit happens
19 years ago
orbiter 81e79f2caf fixed new cache behaviour changes
19 years ago
orbiter 545f81b317 bugfix
19 years ago
orbiter cda087f43b - integrated cache miss storage into object cache
19 years ago
orbiter af098b815c - fix for blog/wiki error
19 years ago
orbiter 74a78ebd78 turned back handling of map-writing into kelondro because of possible bug for testing
19 years ago
orbiter e656a00b74 removed some unused methods
19 years ago
orbiter 338047e056 replaced kelondroDyn write methods for properties and maps by faster version
19 years ago
orbiter b40f0edbe5 replaced property- and map-reader in AbstractRA by much faster version
19 years ago
orbiter 7f28a1a4cb another fix in kelondroDyn: construction of getDyn chunks was not clean
19 years ago
orbiter bb931c7b83 fix for some improper details in kelondroDyn
19 years ago
orbiter 19c6e67003 - added generation of news for blog entries
19 years ago
auron_x 55ea4cbfe6 *)reverted patch for memory-display issue
19 years ago
auron_x 53d9ab6db7 *)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers
19 years ago
orbiter d4b4812732 extended kelondroDyn with new objectBuffer
19 years ago
orbiter 35995cf8c7 some enhancements to caching and kelondroRA-methods
19 years ago
orbiter 2e89477f22 undoing last change
19 years ago
orbiter a3a4525931 usage of a buffer to prevent too many cache lookups in kelondroMap
19 years ago
orbiter 55c5b41bd0 modified kelondroDyn to work better with new object caches
19 years ago
orbiter 3e31820c3d - corrections to PerformanceMemory display of object cache
19 years ago
orbiter 29b1b0823c added monitoring of new object cache to performanceMemory page
19 years ago
orbiter 23ced30e83 fixed a bug in new caching
19 years ago
orbiter bab9ee38e7 added very experimental object cache for all kelondroTree
19 years ago
orbiter e9aadb2e11 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19765#19765
19 years ago
orbiter 5defe97ccb fixed a problem / possible bug with ordering implementation (did not rotate always)
19 years ago
rramthun 250864406f ...
19 years ago
orbiter a37b09e303 implemented automatic adoption of chunk-read-ahead in kelondroTree to needed chunk size
19 years ago
orbiter 526407f32e adoptions, fixes for last commit
19 years ago
orbiter 488a0ed580 replaced old keyIterator and rowIterator by buffered iterators
19 years ago
orbiter dba02f399f starting of re-design of kelondroTree iterator
19 years ago
orbiter f02b426073 made kelondroTree.nodeIterator private
19 years ago
orbiter 431a4f3609 eliminated correcting iterator in kelondroTree
19 years ago
orbiter 9cca36a107 no more strict comparator checking in map exclude method if not needed
19 years ago
orbiter 4239db0d1c fixed new ordering for backup iterator TreeSet
19 years ago
orbiter f0464042fc fix for latest iterator-replacement-fix:
19 years ago
orbiter bcd99fe83e introduced a second RAM cache for DHT transfer
19 years ago
orbiter 69d26045eb quick-fix for http://www.yacy-forum.de/viewtopic.php?p=18805#18805
19 years ago
orbiter be88687d8c fixed some problems with new cache flush karenz
19 years ago
orbiter c51603a405 added two new kelondro classes that will handle the new index data structures (not used yet)
19 years ago
orbiter ba5fe0b287 fixed (again) nullPointerException in kelondroTree
19 years ago
orbiter 0017812b2e bugfix for null compare
19 years ago
orbiter 01c668fe1b experimental disabling of db write buffer
19 years ago
orbiter 4438a96b87 tried to fix "Object type or Object type combination not supported" bug
19 years ago
orbiter c70befbe9c added xml read/write example file: kelondroXMLTables
19 years ago
orbiter 785763d070 added debug output for "Object type or Object type combination not supported" bug.
19 years ago
hermens 56936139ae Fix logging in kelondroTree:
19 years ago
orbiter 3419b3bcdd fix for bug that caused the peer-counter problem.
19 years ago
orbiter 03c65742ba changes towards the new index storage scheme:
19 years ago
rramthun 84a00e5673 Use YaCy logging instead of something I don't understand.
19 years ago
orbiter b9d73f63e7 replaced String object in loop detection by byte[] to omit String-generation
19 years ago
orbiter 47843e69e2 auto-reset for switchboard queue stack
19 years ago
orbiter a70970f993 fixed increment in content iterator
19 years ago
orbiter d6581c445b added content iterator for corrupted database files
19 years ago
orbiter bb2095fe39 assortment files are now not deleted, but shifted to a backup directory.
19 years ago
orbiter 7366e39dd3 tried to fix 100% CPU bug.
19 years ago
orbiter 0371494010 tried to add word position to index
19 years ago
hermens 84fce71d11 *) correct merging of indexes when enumerating downward
19 years ago
orbiter d45b1162e2 signature fix
19 years ago
orbiter c51e18c4ad - added signatures to ordering
19 years ago
orbiter 38b19ff56a another bugfix to the correctedNodeIterator
19 years ago
orbiter 45c44ca9c8 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1717
19 years ago
orbiter c137683a5c added patch to correct tree-iterator
19 years ago
orbiter 2028403670 - consolidated different orderings to kelondroNaturalOrder
19 years ago
orbiter 9544c47684 added some UTF-8 handling.
19 years ago
orbiter a125fee9ce fixed iterator
19 years ago
orbiter 33f8920e1c new database format: splitted trees, using an ordering to split the tree
19 years ago
orbiter 10a095d6b5 - added base64 ordering methods
19 years ago
orbiter 9086261476 refactoring of base64 encoding:
19 years ago
orbiter 7c0d7ed4f8 introduction of generic order interface for kelondro
19 years ago
orbiter 60fc34d9e8 iterartion bug:
19 years ago
rramthun 45ebe477ee Bugfix for http://www.yacy-forum.de/viewtopic.php?p=14175
19 years ago
orbiter 83a34b838d * added Object allocation monitor on performanceMemory page
19 years ago
orbiter 3031903d50 re-design of RAM cache flush into assortment cluster
19 years ago
orbiter 676e384b45 changed synchronization to fix 'contains loops' bug in kelondroTree
19 years ago
orbiter 3cc02fe749 enhanced buffered write by combination of several chunks into one chunk
19 years ago
orbiter 0c762daf4b better startup failure handling
19 years ago
orbiter f27f9ecf15 * activated write buffer for databases.
19 years ago
orbiter c59d1b2f5e - Tests with write buffer (new class kelondroBufferedIOChunks, not yet active)
19 years ago
orbiter ca7e60279d introduced IOChunks.
19 years ago
orbiter fed92d364b introduced USAGE object for counter synchronization in kelondroRecords
19 years ago
orbiter 356231b033 changed only for testing with new hastable implementation.
19 years ago
orbiter 1041f4946a experiments with locks to remove synchronization
19 years ago
orbiter 288b2c353e debugging of kelondroRecords ... possibly synchronization bugs found
19 years ago
orbiter 37f88b4017 code cleanup
19 years ago
orbiter ec2b39c1ce code cleanup
19 years ago
orbiter 76618442e0 code cleanup
19 years ago
orbiter 3d8a5ae652 code cleanup
19 years ago
orbiter 7920e1547d code cleanup
19 years ago
orbiter a04930f025 code cleanup
19 years ago
theli 7028412c54 *) Bugfix for NullpointerException in Java Finalizer
19 years ago
orbiter 420d56ce79 extended db-testing
19 years ago
orbiter 40621a5663 anhancements in ranking preparation and fixed problem with parser/mime recognition
19 years ago
orbiter 85282b1d98 enhanced YBR recognition and search result heuristics
19 years ago
orbiter 0e25020f51 added first generation and usage of YBR index-files. Enhanced overall ranking of search results.
19 years ago
orbiter bfe51c7228 added generation of domain-list
19 years ago
orbiter 0ec54d9c5f enhanced CR-file handling and added first RCI-evaluation tests
19 years ago
theli c2fe3a1670 *) Updating jMimeMagic Ruleset
19 years ago
orbiter 88e3234393 fine-tuning of rci-generation
19 years ago
orbiter a12759c1bf first try to implement a rci-computation from cr-files
19 years ago
orbiter 4a8e8f269e refactoring of cr-processing; new kelondro class to handle the attribute file format
19 years ago
orbiter 24dc0e0760 implemented cr-file processing and further transmission steps
19 years ago
orbiter 022530df7e small bugfix in kelondroTree
19 years ago
orbiter 9913049009 fixed outOfMemory bug caused by loops in kelondroTree during enumeration
19 years ago
orbiter a3fd0069f5 fixed bug in kelondroTree node iteration (rotation did not work)
19 years ago
orbiter 6dc42a2392 detecting of loops in kelondroTree during last/first-Node search
19 years ago
orbiter 5b0911d7ea added new performance menu for search sequence configuration and monitoring
19 years ago
orbiter 4fa942511b de-serialized read and write access
19 years ago
orbiter 1ff0ced515 integration of an interface class for abstract access of kelondro indexed structures like kelondroTree and kelondroHashtable
19 years ago