Commit Graph

3564 Commits (453f3aaa942e17704d549b345c85d11be7590ba0)

Author SHA1 Message Date
orbiter 26978b2a25 - better memory protection in kelondro caches: computation of needed memory for cache grow
16 years ago
lotus e9e2fff47a better scaling on performance graph
16 years ago
lotus 4aad461100 added UPnP support
16 years ago
orbiter 99b9788e54 fix for possible 100% CPU caused by concurrent access of HashMap
16 years ago
orbiter be0c492ae5 fix for memory leak bug in new dht transmissions
16 years ago
hermens 2173865f92 Prevent race condition when switching timezones.
16 years ago
orbiter 40d9849aa4 - better control of chunk size in dht selection
16 years ago
orbiter 30a1de41b3 disabled the BufferedIOChunks, because I consider it as broken.
16 years ago
orbiter 411f2212f2 more memory leak fixing hacks
16 years ago
orbiter 985d421f91 found and fixed some memory leaks
16 years ago
orbiter 333489420b - fix for NPE when loading the cytag image
16 years ago
orbiter 6a32193916 - refactoring of cache naming in web index cache (no more dht semantics there)
16 years ago
orbiter 6c627dbdff update to the server core
16 years ago
orbiter 5393f356aa fix for termination problem
16 years ago
orbiter 6a876ecb88 first fixes to the DHT transmission process
16 years ago
orbiter c25c334b75 replaced old DHT transmission method with new method. Many things have changed! some of them:
16 years ago
orbiter e9a4182e6a using a concurrent hash map for the template cache
16 years ago
lotus e8ae2599fd * some refactoring/moves to consoleInterface
16 years ago
orbiter 01b97ef3f8 added new cybertag-tracking feature that was inspired by itgrl
16 years ago
borg-0300 b19bc611b0 gc: better logging
16 years ago
orbiter b1f9c00118 fix for bug in merge operator initialization
16 years ago
orbiter b57c9da1f8 - fixes to doc, ppt, xls parser: better title
16 years ago
f1ori 7936e58fe7 * sorry,previous version didn't compile
16 years ago
f1ori 76cdc59789 * added some convertions to and from UTF-8
16 years ago
orbiter 65a1de6c05 longer timeout for remote crawl queries
16 years ago
orbiter 072dd01ac8 more logging for RSS parser (to fix the remote crawl problem)
16 years ago
orbiter 9d282d2c16 - renamed interactivesearch to yacyinteractive
16 years ago
orbiter 180fe81ef7 quick hack to copy new log configuration over old one
16 years ago
orbiter d3e33fd6c1 removed strange retry logic from DHT transfer
16 years ago
orbiter db510b5d52 more exception logging
16 years ago
orbiter ef82cced01 removed default line 'P2P WEB SEARCH' if no line is given
16 years ago
orbiter 78b7361937 fixed problem with logging
16 years ago
low012 f136ddcfd4 *) this change is supposed to prevent the creation of temporary files by Apache Commons Fileupload library in cases where it is not necessary (as proposed by thq in http://forum.yacy-websuche.de/viewtopic.php?f=8&t=1806)
16 years ago
orbiter 94110df85a moved logging partially to kelondro
16 years ago
orbiter 024da2916b refactoring of logging
16 years ago
orbiter 83ce65707a (almost) completed partition of classes in kelondro
16 years ago
orbiter 7ee494fde5 more refactoring of kelondro:
16 years ago
lotus d4281b78da dynamic memory scale
16 years ago
orbiter bf93767ec6 refactoring of kelondro database classes
16 years ago
orbiter fc27bf8c4c refactoring of kelondro classes:
16 years ago
orbiter fe77fc3d62 - added new property setting 'repositoryPath'
16 years ago
orbiter 6cbca1e508 extended last fix, preventing more sorts
16 years ago
orbiter f9672d3f97 applied fix for inefficient put method as recommended by celle, see
16 years ago
apfelmaennchen 3484e55be4 - small fix for bookmarksDB
16 years ago
apfelmaennchen 6dd52422ea - added two dialogs to manage bookmark tags in YaCy-UI
16 years ago
orbiter 3154926311 some better memory protection and OOM prevention in EcoFS
16 years ago
f1ori aaafe05c02 * revert debug change
16 years ago
f1ori 5570fa817b * remove & from openBrowser command (see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1728&hilit=#p12321)
16 years ago
orbiter 419469ac27 added more methods to control the vertical DHT (not yet active .. )
16 years ago
lotus 4ef6b15eb8 limit -Xmx setting to 1999m on win32. bigger values would never work.
16 years ago
orbiter dedfc7df7f removed distinction between DHT-in and DHT-out. This is necessary to make room for the new cell data structure, which cannot use this this distinction in the first place, but will enable the same meaning with different mechanisms (segments, later)
16 years ago
orbiter b74159feb8 preparations to integrate the new 'cell' index data structure
16 years ago
orbiter d399444e49 added debug information to class loader
16 years ago
orbiter 5080fc33bf fix for http://forum.yacy-websuche.de/viewtopic.php?p=12247#p12247
16 years ago
orbiter 335d6ce8fc fix for class loading problem
16 years ago
low012 78778df464 *) this should adjust the Dev/Main detection of the updater to the new version numbers (0.7x is Dev, if x != 0)
16 years ago
orbiter b423d0a036 moved all servlets from htroot/xml to htroot/api
16 years ago
orbiter 91af105373 last changes before release
16 years ago
f1ori 7eade3f181 * fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1728
16 years ago
orbiter d1bace5e4d enhanced cleanup function
16 years ago
orbiter cb76d9e0e4 more synchronized in BLOBHeap (will not fix problem with Runtime-Error as reported in forum)
16 years ago
orbiter ff41da613e removed exception printout during load of snippets
16 years ago
orbiter 814a28775f removed thread dump writing in case of invocation target exception in httpd (looked bad, not serious)
16 years ago
orbiter bed38a5f8c fix for uncaught exception in RSSReader
16 years ago
orbiter 05c235de32 fix for npe
16 years ago
low012 7608944081 *) bugfix for REMOTE_HOST environment variable in CGI code (shows hostname of client instead of hostname of YaCy peer now)
16 years ago
orbiter a6b29cf72c reverted change of search event processing in SVN 5460. The new code did not work properly,
16 years ago
orbiter 9ef77d57f5 added an access control to the search interface using white/blacklists:
16 years ago
orbiter efe801173c better dht-in cache flush. see also:
16 years ago
orbiter 941ab78d9b better termination for blocking threads
16 years ago
apfelmaennchen 3dc208fad0 bugfix: bookmarks can now handle folder names like /news and /newspaper without getting confused...
16 years ago
orbiter e948df68ac longer timeout for queues during shutdown
16 years ago
orbiter 2b32248079 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1516&p=10545#p10545
16 years ago
low012 c1330f5743 *) added environment variable DOCUMENT_ROOT
16 years ago
low012 f26b8fcb1b *) comment mode is 'moderated' instead of 'activated' by default now (to avoid spam being visible)
16 years ago
orbiter b2a8c653ee small fixes
16 years ago
orbiter f675d47f86 better protection against database failures
16 years ago
orbiter 4f45605f04 small update for timing in search result processing
16 years ago
orbiter 9d119c6b61 migration of auto-update rules to new release strategy:
16 years ago
orbiter 4d5b401f00 try to fix some performance problems with the internal index management:
16 years ago
borg-0300 a0605325bb fixed a NullPointer Exception
16 years ago
orbiter b2b7edae18 fixed interactive search
16 years ago
lotus 2be119f0df adjusted big peer to 28M links
16 years ago
orbiter c6880ce28b removed the permanent cache flush and replaced it with a periodic cache flush
16 years ago
orbiter ef7fe537c5 fixed a cache-bug in cachedFileRA
16 years ago
orbiter 6c7e83909b - refactoring of data access methods to be prepared for new cell data structure
16 years ago
lotus c8451614f3 fix for overflow
16 years ago
orbiter c4c4c223b9 fixed a problem with attribute flags on RWI entries that prevented proper selection of index-of constraint
16 years ago
orbiter 6072831235 no cr transmission for robinson peers
16 years ago
low012 afe98bc11c *) added changes as proposed by Halborinda in http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1674
16 years ago
orbiter 07fc115e90 removed active profiling in kelondroRowSet
16 years ago
orbiter be4c458951 refactoring (implemented Iterable in kelondroRowCollection)
16 years ago
low012 bb5c2cd12e *) ISINDEX parameters will not be put on commandline anymore to prevent possible security hazards (better safe than sorry). Parmeters will have to be read from QUERY_STRING in ISINDEX case too which does not seem to be uncommon behaviour for web servers: http://vms.pdv-systeme.de/users/martinv/cgi_basics/cgi_basics.html#Datenuebergabe
16 years ago
orbiter b6bba18c37 replaced the storing procedure for the index ram cache with a method that generates BLOBHeap-compatible dumps
16 years ago
low012 db1cfae3e7 *) cleaning up after myself
16 years ago
low012 f547f9a78c *) added CGI capabilities (run Perl scripts and other software via HTTP GET and POST)
16 years ago
f1ori bdc380cd84 * add lastModified to templateCache
16 years ago
f1ori 025094675f * remove empty directory
16 years ago
f1ori c5691180cb * skip style-tags in HTML-files
16 years ago
orbiter 3567c58b18 added another filed information for BLOBHeap dumps: the gaps
16 years ago
orbiter abdd4aa414 added a index dump for blob heaps:
16 years ago
orbiter 8c3205b62e fix for OOB Exception
16 years ago
orbiter 78c568331e added test channel to /xml/feed.rss
16 years ago
orbiter e004da48d3 - added fast fingerprint computation for files (any). Will be used in new index dump method
16 years ago
f1ori 2d2ce24011 * remove all encoding-stuff from proxy
16 years ago
f1ori 73c8a0839c * abort download, when proxy connection is closed
16 years ago
orbiter bb935fdbb0 less organization overhead for DNS caching and prefetching
16 years ago
f1ori 4907697cfa * make fileuploads through proxy bigger than 65500 bytes possible
16 years ago
orbiter fc8189f3fb better self-healing of corrupted databases
16 years ago
f1ori 963da8c3f9 * updated tm-extractors to new version 1.0
16 years ago
orbiter e34ac22fbd - added new monitoring servlet at
16 years ago
lotus 449e697436 fix for null-seed in seedfile
16 years ago
orbiter d376d81fc4 replaced busy thread control of crawl stacker by blocking threads
16 years ago
orbiter f29b48d9ff patch for IndexOutOfBoundsException
16 years ago
f1ori 0881190b19 * Robots.txt: don't interpret Crawl-Delays for other robots
16 years ago
orbiter 243e73f53b removed unnecessary usage of kelondroBLOBTree
16 years ago
orbiter 8cb7170b75 - set status of kelondroTree, kelondroBLOBTree and kelondroFlexTable to deprecated
16 years ago
orbiter 7535fd7447 - refactoring of CrawlEntry and CrawlStacker
16 years ago
lotus 18513e2ee2 npe fix: http://forum.yacy-websuche.de/viewtopic.php?t=1646
16 years ago
orbiter 2802138787 - refactoring of CrawlStacker (to prepare it for new multi-Threading to remove DNS lookup bottleneck)
16 years ago
orbiter db6b3bf5a3 speed enhancement for integrated http server:
16 years ago
orbiter 7cd08bd5fb fix for NPE in BLOBCompressor
16 years ago
orbiter 5b94498643 fine-tuning of cache usage from SVN 5386 and a bug fix for overflow in available() method
16 years ago
orbiter 1779c3c507 - added a read cache to the RAFile interface to RandomAccessFile
16 years ago
orbiter e1acdb952c fix for problem with userDB and bookmarksDB which was caused by changes in kelondroRA in SVN 5376
16 years ago
orbiter 4a2dac659e more speed hacks:
16 years ago
orbiter 47292e696a more performance hacks
16 years ago
orbiter 759cef23dd fix for bug in kelondroAbstractRA.readFully
16 years ago
orbiter d39d420b39 performance hacks
16 years ago
orbiter 0b4808ba3d added new interactive search feature:
16 years ago
orbiter 74a3d86114 fixed a error response that might present classified information
16 years ago
orbiter c6525ab75f fix for NPE in seed handling
16 years ago
lotus 1951d30a62 addendum to last commit
16 years ago
lotus 325ba7bfb8 only query words with length > 2
16 years ago
low012 e423fa9846 *) added method to only get file names in directory listing which match a filter
16 years ago
orbiter 513179f404 changed interface to colletctionIndex and adopted all implementing classes:
16 years ago
orbiter 9d64693cfb reverting again the changes to new concurrent chunkIterator
16 years ago
orbiter 45ad1c3dd5 - re-activated concurrent iterator for EcoFiles
16 years ago
orbiter 2e2120046f speed enhancement for BLOBHeap opening process
16 years ago
orbiter fa26a8f25a fix for deadlock-like behavior in balancer
16 years ago
orbiter 1918a0173e added more exception handling during crawling
16 years ago
orbiter 10f5ec1040 reverted last commit (more testing needed)
16 years ago
f1ori 5af8923f37 * distribute forgotten jar-file in parser
16 years ago
orbiter b0f2003792 fast database initialization and fast start.up of yacy:
16 years ago
orbiter 0ca4bc7b79 - added reader and visualization for mediawiki-export files:
16 years ago
danielr 2e63f03ca5 copy&paste vergessen :/
16 years ago
danielr cd8082b4e3 fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1111#p11166
16 years ago
lotus 4f996a7651 fix for logparser pattern
16 years ago
f1ori d18c18971e * dirlisting in UTF-8 encoding
16 years ago
orbiter 867d0f2f56 removed some unnecessary pause delays
16 years ago