Commit Graph

283 Commits (fc594e8eda269753cddc8c69e6ebab61c4625200)

Author SHA1 Message Date
orbiter 7366e39dd3 tried to fix 100% CPU bug.
19 years ago
orbiter 0371494010 tried to add word position to index
19 years ago
hermens 84fce71d11 *) correct merging of indexes when enumerating downward
19 years ago
orbiter d45b1162e2 signature fix
19 years ago
orbiter c51e18c4ad - added signatures to ordering
19 years ago
orbiter 38b19ff56a another bugfix to the correctedNodeIterator
19 years ago
orbiter 45c44ca9c8 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1717
19 years ago
orbiter c137683a5c added patch to correct tree-iterator
19 years ago
orbiter 2028403670 - consolidated different orderings to kelondroNaturalOrder
19 years ago
orbiter 9544c47684 added some UTF-8 handling.
19 years ago
orbiter a125fee9ce fixed iterator
19 years ago
orbiter 33f8920e1c new database format: splitted trees, using an ordering to split the tree
19 years ago
orbiter 10a095d6b5 - added base64 ordering methods
19 years ago
orbiter 9086261476 refactoring of base64 encoding:
19 years ago
orbiter 7c0d7ed4f8 introduction of generic order interface for kelondro
19 years ago
orbiter 60fc34d9e8 iterartion bug:
19 years ago
rramthun 45ebe477ee Bugfix for http://www.yacy-forum.de/viewtopic.php?p=14175
19 years ago
orbiter 83a34b838d * added Object allocation monitor on performanceMemory page
19 years ago
orbiter 3031903d50 re-design of RAM cache flush into assortment cluster
19 years ago
orbiter 676e384b45 changed synchronization to fix 'contains loops' bug in kelondroTree
19 years ago
orbiter 3cc02fe749 enhanced buffered write by combination of several chunks into one chunk
19 years ago
orbiter 0c762daf4b better startup failure handling
19 years ago
orbiter f27f9ecf15 * activated write buffer for databases.
19 years ago
orbiter c59d1b2f5e - Tests with write buffer (new class kelondroBufferedIOChunks, not yet active)
19 years ago
orbiter ca7e60279d introduced IOChunks.
19 years ago
orbiter fed92d364b introduced USAGE object for counter synchronization in kelondroRecords
19 years ago
orbiter 356231b033 changed only for testing with new hastable implementation.
19 years ago
orbiter 1041f4946a experiments with locks to remove synchronization
19 years ago
orbiter 288b2c353e debugging of kelondroRecords ... possibly synchronization bugs found
19 years ago
orbiter 37f88b4017 code cleanup
19 years ago
orbiter ec2b39c1ce code cleanup
19 years ago
orbiter 76618442e0 code cleanup
19 years ago
orbiter 3d8a5ae652 code cleanup
19 years ago
orbiter 7920e1547d code cleanup
19 years ago
orbiter a04930f025 code cleanup
19 years ago
theli 7028412c54 *) Bugfix for NullpointerException in Java Finalizer
19 years ago
orbiter 420d56ce79 extended db-testing
19 years ago
orbiter 40621a5663 anhancements in ranking preparation and fixed problem with parser/mime recognition
19 years ago
orbiter 85282b1d98 enhanced YBR recognition and search result heuristics
19 years ago
orbiter 0e25020f51 added first generation and usage of YBR index-files. Enhanced overall ranking of search results.
19 years ago
orbiter bfe51c7228 added generation of domain-list
19 years ago
orbiter 0ec54d9c5f enhanced CR-file handling and added first RCI-evaluation tests
19 years ago
theli c2fe3a1670 *) Updating jMimeMagic Ruleset
19 years ago
orbiter 88e3234393 fine-tuning of rci-generation
19 years ago
orbiter a12759c1bf first try to implement a rci-computation from cr-files
19 years ago
orbiter 4a8e8f269e refactoring of cr-processing; new kelondro class to handle the attribute file format
19 years ago
orbiter 24dc0e0760 implemented cr-file processing and further transmission steps
19 years ago
orbiter 022530df7e small bugfix in kelondroTree
19 years ago
orbiter 9913049009 fixed outOfMemory bug caused by loops in kelondroTree during enumeration
19 years ago
orbiter a3fd0069f5 fixed bug in kelondroTree node iteration (rotation did not work)
19 years ago
orbiter 6dc42a2392 detecting of loops in kelondroTree during last/first-Node search
19 years ago
orbiter 5b0911d7ea added new performance menu for search sequence configuration and monitoring
19 years ago
orbiter 4fa942511b de-serialized read and write access
19 years ago
orbiter 1ff0ced515 integration of an interface class for abstract access of kelondro indexed structures like kelondroTree and kelondroHashtable
19 years ago
orbiter 8d827cdb30 tried to fix problems with order of network list by last-seen (which could also improve the network picture)
19 years ago
theli b7e21ec107 *) Adding DB import function which allows to import an foreign yacy DB (from directory PLASMADB)
19 years ago
theli 959eefbc4f *) Robots.txt parser/ppt
19 years ago
borg-0300 4191b21e73 cleaned, finals, Properties
19 years ago
theli a2fa75e688 *) Asynchronous queuing of crawl job URLs (stackCrawl)
19 years ago
orbiter f6a0e0f162 small bugfix to readFully
19 years ago
orbiter 6d5d0ac801 bugfix for startup problems
19 years ago
orbiter 5dc0d41900 bugfix in kelondroRA (hint by Martin)
19 years ago
orbiter 25a59a51ad fixed problem created with last svn commit
19 years ago
orbiter 72ce36baba cleanup in kelondroRecords
19 years ago
orbiter e380d4e55e cleanup (no functional change)
19 years ago
orbiter de0a58d79c no more sync
19 years ago
orbiter 495bc8bec6 removed cache-control from low and medium priority caches which reduces memory use and computation overhead
19 years ago
orbiter 979a3ee3c0 exceptions for better testing of bug http://www.yacy-forum.de/viewtopic.php?p=9852#9852
19 years ago
orbiter 18d9e1a256 fix for http://www.yacy-forum.de/viewtopic.php?p=10026#10026
19 years ago
orbiter ef85fce661 change of memory-consumption constants (had been much too low)
19 years ago
borg-0300 6d1de8abfd finals; cleaned;
19 years ago
orbiter fb52a82008 added new performance page for memory settings
19 years ago
orbiter e6b30911c3 small changes to caching
19 years ago
orbiter 900ab97422 change of memory-allocation blocking value for GC prevention
19 years ago
orbiter 0ffca99886 added priority-organization to kelondroRecord cache. This should virtually double the cache capacity.
19 years ago
orbiter 2d22626386 automatic switch-off of cache control in kelondroRecords in case that cache is big enough (so that no cache-aging needs to be controled)
19 years ago
orbiter cddd9aaa33 fixed SERIOUS bug with kelondroStack; affected all stack processing since 729
19 years ago
orbiter 19547f1821 changed node manipulation methods in kelondro core to reduce object allocation
19 years ago
orbiter debb207a74 removed file sync
19 years ago
orbiter 2148c0cf49 replaced kelondro storage core; much less objects in kelondro cache now; less IO from DB
19 years ago
orbiter 43b42854a0 fix for null-entries and http://www.yacy-forum.de/viewtopic.php?p=8649
19 years ago
theli bead8a32aa *) IndexCreate_p.java:
19 years ago
theli 6adf8a4bde *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
19 years ago
theli b33094e925 *) Trying to solve "Too many open files bug"
19 years ago
theli b67f008eb8 *) Trying to solve "Too many open files bug"
19 years ago
orbiter 5716f8521d bug fixes for word ordering and dht index selection
20 years ago
orbiter c796a38424 doc update
20 years ago
orbiter 40da910f41 bugfixes and automatic news-cleanup
20 years ago
orbiter e84a177c49 many bigfixes
20 years ago
orbiter 5672709ef3 several bugfixes for YaCyNews
20 years ago
orbiter 1022fbeb65 many YaCyNews fixes
20 years ago
orbiter ad90f0ad13 activated RWI distribution to DHT for senior peers (default redundancy 3), necessary now for network growth
20 years ago
orbiter 3470a72d48 fixed div by zero, set default delays, fixed release number format and display
20 years ago
orbiter 0f663bcebf added global ppm computation
20 years ago
orbiter 1d2155675b changed assortment memory cache flush
20 years ago
orbiter 19dbed7cc8 code clean-up
20 years ago
orbiter 311e627363 blocking of blacklisted urls in indexReceive and small changes
20 years ago
orbiter 858cd94299 replaced indexing ram-queue by file-based stack-queue
20 years ago
orbiter 3addf58046 enhanced snippet-loading with threads
20 years ago
orbiter 4afcf10158 added kelondroHashtable (not finished yet)
20 years ago
orbiter 1e7f062350 many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets
20 years ago
orbiter 68dc2b0c6b added kelondroArray, the basis for upcoming kelondroHash and some bug fixes
20 years ago
orbiter 5728cdf8b5 bugfix
20 years ago
orbiter a19541e563 code-enhancements after analysis with AppPerfect
20 years ago
orbiter 85075269a6 extended fail-safe memory-managament. prevents too much allocation, too often GC and should help for the 100%CPU-bug
20 years ago
orbiter e3c92818db avoiding OutOfMemoryError routines
20 years ago
orbiter 3e8ee5a46d enhanced caching in kelondroRecords and added better synchronization/finalizer
20 years ago
orbiter 3be98f194d tried to find the socket bug
20 years ago
theli 9e47ba5ad6 *) adding missing calls for function close() to avoid "too many open file" bug
20 years ago
theli 451ca6b818 *) changing reference to logger
20 years ago
orbiter e89ded9e41 bugfixes
20 years ago
orbiter 650ca3955a added flush-thread for index cache and added language-name mapping in Language_p
20 years ago
orbiter f8f8dd05db fixed "Too many open files" - bug
20 years ago
orbiter 4b01ff7548 activated assortments, removed write-queues
20 years ago
orbiter e26ac60c3e modified assortment data structures
20 years ago
orbiter 287d2e6f10 further enhanced caching (new cache flush methods)
20 years ago
orbiter ea478f3975 enhanced indexing-caching
20 years ago
theli a5fec449c8 *) setting threadnames for kelondroMap:writequeue and publishSeed
20 years ago
orbiter db1da3345d introduced singleton-database
20 years ago
orbiter a9b22647dc fixed bug in indexDump.stack - generation
20 years ago
orbiter 1d7fed87dc redesign of index caching - removed indexCache.db
20 years ago
theli 2aa5fe8f50 *) Import statements reorganized
20 years ago
orbiter c7c6aaf06e many bug-fixes
20 years ago
orbiter 995673d795 several bugfixes
20 years ago
orbiter 2de90020ed fixed caching+synchronization+brute-force-denial
20 years ago
theli 47e426ff7e *) one possible deadlock (because of nested object locks) removed in class kelondroMap
20 years ago
orbiter ba16da72b4 fixed not-working kelondroRecords-Cache
20 years ago
orbiter 7fb645b0ab enhanced crawling performance, changed memory settings, new performace options
20 years ago
orbiter 8b31f9e202 enhanced shut-down behaviour & added experimental nio-wrapper for kelondroRA (not active yet)
20 years ago
orbiter 96516fc9d8 fixed bugs (search+kelondroException, dns)
20 years ago
orbiter e374aca2cd enhanced exception handling in kelondro
20 years ago
orbiter 072052f150 fixed bugs (dns, seedDB)
20 years ago
orbiter 248077d3f0 initial load with yacy 0.36
20 years ago