Commit Graph

543 Commits (9cbfc1a1c01051182abd425b40d4ee8b9d6249e8)

Author SHA1 Message Date
Michael Peter Christen e18a4f6b74 more tolerant merge iterator
13 years ago
Michael Peter Christen 7e4e3fe5b6 free some memory after parsing html
13 years ago
Michael Peter Christen 4540174fe0 memory hacks
13 years ago
Michael Peter Christen b4409cc803 small redesign of blob column index and usage
13 years ago
Michael Peter Christen d5c1f2746e performance hack
13 years ago
Michael Peter Christen 803963aebd performance hack: better space grow in CharBuffer (speeds up html
13 years ago
Michael Peter Christen e2f8f263e8 changed storage of search words: keep order
13 years ago
Michael Peter Christen 0b67a0a5d8 added a column index for tables in blob files. This is heavily used
13 years ago
Michael Peter Christen e3bb73c3d6 serialized some database access methods
13 years ago
Michael Peter Christen 2ea585d616 fix for host navigator
13 years ago
Michael Peter Christen ef78f22ee1 performance hack
13 years ago
Michael Peter Christen a02fdf8625 better error messages
13 years ago
Michael Peter Christen c6ba44468e timeout = 5000 instead 3000
13 years ago
low012 8776b84c10 *) small fix to make password change function of reconfigureYACY.sh work
13 years ago
Michael Peter Christen 4901cee3cc suppress auto-tagged subject entries when sending out or receiving
13 years ago
sixcooler 985b78cf89 correct 'avaiable()' to use max of young / eden
13 years ago
sixcooler 4da8746275 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
sixcooler c9aaa9e00a respect non-reserved Memory in GenerationMemoryStrategy
13 years ago
Michael Peter Christen 37f2d1b3e9 replaced Thread initialization with ExecutorService pool for delete
13 years ago
Michael Peter Christen 0d6176804b emergency disabling of GenerationMemoryStrategy because of non-working
13 years ago
Michael Peter Christen 87f0210480 enriched log output to find NPE in HeapReader
13 years ago
Michael Peter Christen 254adea51c small fixes
13 years ago
Michael Peter Christen 49be60a7c8 WorkflowProcess is forced to make small pauses if shortMemoryStatus is
13 years ago
Michael Peter Christen b7bb84c0bb set a limit to CharBuffer object size to fight against bad/too large
13 years ago
Marek Otahal 72adbeae90 !Important: move from Hashtable to HashMap
13 years ago
Marek Otahal f75b5e40e0 little fix in copy()
13 years ago
Michael Christen 216a287a85 Merge commit '6d4e08ed06c5cd28c45981b2ebe31c7f7ec6fd83' into quix0r
13 years ago
Michael Christen 20962a4ed7 added metadata node stub for metadata from blobs
13 years ago
Michael Christen 575dbbaa93 enhancements in Blob retrieval: try to use less CPU resources by testing
13 years ago
Roland 'Quix0r' Haeder 6d4e08ed06 Rewrote filesize() to (hopefully) avoid a NPE, rewrote Blacklist class to concurrent classes to avoid a CME
13 years ago
Roland 'Quix0r' Haeder fa08ed5ae5 Fixed a lot CHMOD rights (no need for execute flag on *.java/*.html) and introduced local/remote crawl size ratio based check
13 years ago
Michael Christen 9e5894c784 Removed handling of components objects for URIMetadataRows.
13 years ago
Michael Christen c04bfaa51b refactoring
13 years ago
Michael Peter Christen 613ab6a69d added BEncodedHeapBag and BEncodedHeapShard which are storage container
13 years ago
Michael Christen 6fecd0db88 one more performance hack to prevent costly md5 computation
13 years ago
Michael Christen e13441b069 better digest pool size (smaller by default but unlimited)
13 years ago
Michael Christen 1f4afb4dc0 performance hacks
13 years ago
Michael Christen e9dc99fe15 added rules to set specific RWIs as private RWIs which are not
13 years ago
Michael Peter Christen 0bcef2d156 added feature as requested in
13 years ago
Michael Christen 204c29f010 small bugfixes for search result display and cache display
13 years ago
Michael Christen 078fcde0dd bad initialization
13 years ago
Michael Christen 14e45e90fd patch for a bug that I don't understand by now.
13 years ago
Michael Christen 86b3385847 fixed a deadlock during secondary remote search
13 years ago
Michael Christen 404758698a less io operations
13 years ago
Michael Christen 044f83feed added some pauses into the search process which shall produce
13 years ago
sixcooler 448656087a probably fix for http://bugs.yacy.net/view.php?id=94
13 years ago
Michael Christen d35bdc2df6 removed npe
13 years ago
Michael Christen e7e429705a - less automatic indexing after a search (needs to reset the default
13 years ago
Michael Christen 9cd469e6d6 added pull request from als plus an NPE fix
13 years ago
orbiter 83335c3b09 fix for http://bugs.yacy.net/view.php?id=78
13 years ago
orbiter 35a9e8f307 - fixed network graphic
13 years ago
Al Sutton 8993cac4d8 Initial performance improvements
13 years ago
orbiter 8895d8c1cd removed unnecessary log entries
13 years ago
orbiter bc5df0eef5 updated ranking tables (fresh computation)
13 years ago
orbiter 5a55397f99 some last-minute performance hacks
13 years ago
orbiter c9216d5adf fixed secondary remote search (the process that finds distributed join situations)
13 years ago
orbiter 0cf9ebc3b0 speed enhancements when parsing RWI rows (makes search slightly faster)
13 years ago
orbiter 709013385a fix for language fix
13 years ago
orbiter c0c6e9e7a5 fix for bad language encoding
13 years ago
orbiter 05f34a3fa7 added a full, complete, database insert, update and delete API for the tables.
13 years ago
orbiter 3a15e58e28 - increased stability when opening the robots table
13 years ago
orbiter 775b44017e refactoring
13 years ago
orbiter e914a30099 fix for npe
13 years ago
orbiter 0d858d48ec replaced String with StringBuilder in suggestion process
13 years ago
orbiter e58438c01c - added a new retry connector for solr (for cases where solr responses are slow)
13 years ago
orbiter d8d9735b4f stability bugfix
13 years ago
orbiter f121f4bb45 fix for link in Supporter and Suftipps page
13 years ago
orbiter 1b86d06d1e fix for http://bugs.yacy.net/view.php?id=62
13 years ago
orbiter eb9c9edb01 enhanced table method (used by almost all yacy api interfaces)
13 years ago
orbiter 5af9598bd1 enhanced exported row parsing during row import
14 years ago
orbiter 7598a9e26b fix for thread dump
14 years ago
orbiter 8eef8722d1 update to ThreadDump analysis: freerunner and thread state recognition
14 years ago
orbiter 1df43b137d another performance hack
14 years ago
orbiter 7df0643f0e performance hacks
14 years ago
orbiter 813f297a95 another performance hack: re-use of known host addresses for isLocal property; avoids look-up in local hash
14 years ago
orbiter 035ebfbf3b - performance hacks (should affect the crawl balancer and reduce CPU load during crawl stack re-fill)
14 years ago
orbiter b250e6466d implemented crawl restrictions for IP pattern and country lists
14 years ago
orbiter 57d5529a01 performance hacks
14 years ago
orbiter d2ea250d99 refactoring:
14 years ago
orbiter 0c6d95e57b - more tolerance against failure of table opening
14 years ago
orbiter ce2a76d603 performance hack for search process
14 years ago
orbiter 2c4a672fe2 bugfixes and performance hacks for tabe index
14 years ago
orbiter dad5b586a4 added a concurrent warmin-up of Table data structures. that should speed-up the start-up process but may also cause stronger CPU load at that time.
14 years ago
orbiter 734059d33e performance hacks
14 years ago
orbiter dd4635e323 patches
14 years ago
orbiter 2842ce30d6 added synchronization in ReferenceContainer and logging for shrinking
14 years ago
orbiter cec3836e73 added reference limitation to IndexControlRWIs_p.html servlet
14 years ago
sixcooler ecb4986b38 refactored stuff from last commit to ReferenceContainer
14 years ago
sixcooler f7c4abfdd7 limit references per blob & term to the 100.000 youngest
14 years ago
orbiter 28f5b79deb added a fast mass-deletion method
14 years ago
orbiter 44d6416e2d ensure termination of shrink()
14 years ago
orbiter 52230a6864 replaced catching of Exception with Throwable, which catches also Errors
14 years ago
orbiter e1a3d609aa moved merger object from Segment to IndexCell to enable a correct shutdown sequence. This solves a bug where yacy cannot be shut down during an index merge that appears during the shutdown phase.
14 years ago
sixcooler d40a177c05 Generation Memory Strategy fine tuning
14 years ago
sixcooler 839f407fe4 Generation Memory Strategy fine tuning:
14 years ago
orbiter a5541751a8 - added memory computation to termlist_p.xml
14 years ago
orbiter 45e497a9bd fix for term iteration
14 years ago
orbiter 2c595a6a47 added new methods to count the number of objects in RWIs. lots of refactoring was necessary to introduce new Rating class and to unify naming of methods
14 years ago
orbiter 75df87832c refactoring/better naming of methods and classes
14 years ago
sixcooler 5f8a5ca32d - not doing merge-jobs while short on Memory
14 years ago