Commit Graph

1703 Commits (2a06ce5538550878beeefec0442bf1e0fe7abab8)

Author SHA1 Message Date
theli d54767f634 *) last step of removing embedded html from dir class
19 years ago
orbiter 279b1d969d Integrated new indexing data structure 'collections' into the main class
19 years ago
orbiter 4ff742e42d implemented indexCollectionRI
19 years ago
orbiter 01f95eccd3 re-write of kelondroCollectionIndex. This is the data structure that
19 years ago
orbiter ebc2233092 * implemented (finished) class indexRowSetContainer
19 years ago
orbiter 9183d21f25 renamed new index class to old name
19 years ago
orbiter c4e922885a replaced indexURLEntry by new class that uses a kelondroRow.Entry object
19 years ago
orbiter 0b7112f8b2 fix for missing topLevelClone in indexRAMCacheRI.wordContainerIterator
19 years ago
orbiter e357599f92 * fixed problem with indexContainer iteration from RAM:
19 years ago
theli 57fe5cc671 *) code cleanup
19 years ago
allo 4e9f02c8ec integration of Michaels string-extraction.
19 years ago
orbiter 8b77afd72c some fixes to new container merger
19 years ago
orbiter 830167596a bugfix for
19 years ago
theli 839806a775 *) serverPortForwardingUpnp.java: code cleanup, license header added
19 years ago
theli 03230cd887 *) removing old port forwarding classes
19 years ago
theli 6e676224d0 *) adding support for upnp
19 years ago
orbiter 417ed5102e redesign of database iterators:
19 years ago
theli 0db237467f *) bugfix for URL generation from file
19 years ago
orbiter ad692fc6c7 implemented option to extract nurls from the database
19 years ago
orbiter 7fd90ca7c8 * strict handling of NURL entry element generation, storage and stacking
19 years ago
orbiter 5f72be2a95 some redesign of EURL storage
19 years ago
orbiter 1ed3e2daef added option to extract domains and/or urls from the eurl database
19 years ago
orbiter 7e0a130fb5 new indexURLEntry class 'indexURLEntryNew', to replace old class
19 years ago
orbiter 58df8b7bbf a large collection of different changes
19 years ago
orbiter 493b1cd2bf better logging for domain extraction
19 years ago
orbiter e20ff77c10 another bugfix in new url class
19 years ago
orbiter 685430a1b5 bugfix in new URL class, better loggin for domain extraction
19 years ago
orbiter c57b78722b added some more logging to domain extraction
19 years ago
orbiter 79af283f6c better debugging in new URL class for wrong port numbers
19 years ago
orbiter cc2be7fb43 fix for genurllist in case of bad urls
19 years ago
allo 1b2ea58ee9 wrong substring invocation.
19 years ago
orbiter e4f1820b58 protection against too long authentication strings in switchboard
19 years ago
orbiter b3f7e62e03 better handling of whitespace
19 years ago
orbiter 4149939c02 better handling of whitespace for gettext quotation
19 years ago
orbiter 97fa6788a1 added gettext support:
19 years ago
theli b3c569f706 *) renaming of function getTransferedEntitySpeed to getTransferedEntrySpeed to avoid confusion
19 years ago
allo ff3f174a2d case insentive commandline options
19 years ago
orbiter 67edd80884 removed tabs
19 years ago
allo 67c486a023 some example Code, how supertemplates can be used.
19 years ago
orbiter 5214f571cd simplified method call in balancer
19 years ago
allo 7b0e2521bb Support for a supertemplate, which can do all thing, a normal template can do.
19 years ago
orbiter 4bd626572b added hashCode and compareTo to new URL class
19 years ago
orbiter abb5264929 fix for
19 years ago
allo ff39a7a0d1 Overlay for welcome.*
19 years ago
theli a70cbd959b *) further improvements for the anomic.net.url class
19 years ago
theli 8a1f1d96b3 *) Bugfix for url concatenation. Relative urls with / or http:// at the beginning
19 years ago
rramthun ca33eaa442 - Some spelling
19 years ago
allo 8795875800 dirlisting for all empty directories.
19 years ago
orbiter 7935f27038 enhanced synchronization in balancer
19 years ago
orbiter 3879a0ecd0 replaced java.net.URL usage by use of new class de.anomic.net.URL
19 years ago
orbiter 07900366ac deactivated cache-initialization for file-indexes (files in WORDS)
19 years ago
orbiter 40aa735520 fixe timing problem causing too long delay during initialization of kelondroTree objects
19 years ago
orbiter d2bb3f442e fixed timing problem causing a division by zero exception
19 years ago
allo 6acb6a4d8f tiny performance optimization
19 years ago
allo 2bdf1fc360 totalPPM
19 years ago
theli 24a02cbeef *) Bugfix for not parsable application/xhtml+xml resources if
19 years ago
orbiter b0ca5fa784 some correction algorithm for preload time computation during assortment open
19 years ago
orbiter e22cbaee97 - extended logging for preload
19 years ago
orbiter 671fd9a5c9 work towards new indexing database structure
19 years ago
orbiter 92f4cb4d73 added option to configure the start-up delay time for kelondro database files.
19 years ago
orbiter ce9dd3e76d some work in the index construction zone (no effect yet)
19 years ago
theli fe617d7e54 *) adding function to return the protocol type of a ssl connection
19 years ago
orbiter 018b3e0832 added pause option to server threads.
19 years ago
orbiter e1a52bea22 added a class stub for the new database structure:
19 years ago
orbiter 3b69b35bf2 added pre-load of node cache entries to kelondroRecords
19 years ago
orbiter 85d575e928 enhancements to kelondroRow and kelondroColumn
19 years ago
orbiter ab1ed053f5 another small correction
19 years ago
orbiter b92561fb67 removed unused code
19 years ago
orbiter eadbd56fc5 small adjustment to last commit
19 years ago
orbiter e9765ac4e6 introduced bulk read for node iterator in kelondroRecords
19 years ago
orbiter 6643da3fbd bugfix for http://www.yacy-forum.de/viewtopic.php?p=23463#23463
19 years ago
orbiter 866d53ed70 fix for DNS block bug
19 years ago
orbiter 6af70febef - added kelondroTree index option to kelondroFlexTable
19 years ago
orbiter dd2865178a major bugfix (searched a whole week for the bug) for
19 years ago
orbiter f9b9d085c4 just changed testing code
19 years ago
theli b594ee9a5a *) Adding possibility to configure if the http proxy should send the
19 years ago
orbiter ef84fc4956 added IOException to size() and row()
19 years ago
theli 7646849241 *) implementation of size() for mysql
19 years ago
orbiter 84dfd76a6a kelondroFlex bugfix
19 years ago
hydrox 53077f5835 *)fixed paths to yacy.logging
19 years ago
hydrox 8ba8e2b7d9 *) added cache for blacklists urlhashs recieved by DHT. DHT does not request URLs listed in this cache.
19 years ago
hermens 53cbcc6d6e Implement emergency break in index receive when the limit of the ramCache is exceeded by more than cacheLimit
19 years ago
orbiter e40987ecab removed default memory reservation for testing
19 years ago
orbiter 4cc6e6551f bugfix
19 years ago
orbiter 66964dc015 removed high/med/low from kelondroRecords cache control.
19 years ago
allo 6866bc2758 be quiet!
19 years ago
borg-0300 4c6083b264 network picture;
19 years ago
borg-0300 955915385a network picture;
19 years ago
borg-0300 027fa8ab1c network picture;
19 years ago
orbiter 41c4641612 added some profiling to kelondro caching classes
19 years ago
orbiter dd560e4b2f finetuning
19 years ago
orbiter a5661de880 added debug line
19 years ago
orbiter 5b1d77cd4b some enhancements to caching
19 years ago
hydrox ad03715b64 *) added fill and read functions with benchmark output every 10000 operations to dbtest.java
19 years ago
theli b20496e42b *) make DHT DoS check configurable (requested by KoH)
19 years ago
orbiter 650c7e9e55 some enhancements to caching
19 years ago
hermens d4645062bc Correct usage of vhost in wget/wput requests:
19 years ago
orbiter bde748f68f - integrated buffer in RowCollectionSet which speeds up the new
19 years ago
theli fa9712151a *) dbtest.java: bugfix for mysql test. data was not written correctly
19 years ago
theli f55d3d0d79 *) better error message if jdbc driver could not be loaded
19 years ago
theli 07aa779e6d *) dbtest: adding read and write methods for mysql
19 years ago
orbiter d083b15c4b tests/fixes
19 years ago
orbiter ce9a98ee25 experiments with buffer for collection class
19 years ago
orbiter 6aa0f6eb0f better abstraction, less synchronization
19 years ago
orbiter 1ec07fe351 better structure of the kelondro collection classes
19 years ago
allo c264cda678 support to parse gettext files and to generate updated files, where only the new strings are empty.
19 years ago
orbiter 761d3bba54 integrated kelondroRowCollection in kelondroCollectionIndex
19 years ago
orbiter 8f0c1a240a added kelondroRowCollection and kelondroRowSet which
19 years ago
theli ed2cb040d1 *) Bugfix for http connection header validation
19 years ago
allo f95c006dc2 generation of empty gettext files from yacy html-files
19 years ago
orbiter 4fa3271754 adopted memory calculation to new memory amount used by kelondroCollectionObjectMap
19 years ago
allo 0621106ef3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2214 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter 11951aed41 replaced node cache Object type in kelondroTree:
19 years ago
orbiter 12af69dd86 cosmetics
19 years ago
orbiter ea72a7c580 added new objectMap (can replace HashMap and should use less memory, but is slower)
19 years ago
allo 67a8c74be3 Fix for dynamic login with static password.
19 years ago
allo ef9eb50c3c fix for adminlogin
19 years ago
allo 6fe2fed87e cookieauth works with static Admin.
19 years ago
theli 45b39ee1be *) solving unpacking problems with to long filename by
19 years ago
theli fb090652df *) use a more compact for plasmaWordIndexAssortmentImporter.java because the long name
19 years ago
theli 4ca0857c0c *) Index transfer now considers the pause time send by busy peers during
19 years ago
orbiter e8848a3532 bugfixing for new kelondroFlexTable
19 years ago
allo b23703f260 using cookieAuth.
19 years ago
allo 7f51a43cba disabled ipAuth for _p Pages (and broken Form-Login :-() for security reasons
19 years ago
allo bd22634c44 HTML-login, logout fixed.
19 years ago
hermens 3f1ebc097e Limit the size of the DNS cache to 5000 and the age of the entries to one day.
19 years ago
allo d7a3fdb18b no white pages, when clicking cancel on the password-dialog
19 years ago
allo ec36174b7f Form-Login works now.
19 years ago
allo 11123416f3 Form-Login function.
19 years ago
allo bd13bd78ad Bugfix for broken Tags
19 years ago
orbiter 75ed507d39 some debugging of new kelondroFlexTable class
19 years ago
theli f01bd25489 *) Bugfix for OutOfMemory problem during minimizeUrlDB
19 years ago
orbiter 8a18302e84 some work on the intMap
19 years ago
orbiter 56084e9edc added a intMap, the new index management structure for kelondroFlexTables
19 years ago
orbiter e374add8cb added html tag 'area' to html parser
19 years ago
orbiter eda055e729 - enhanced kelondroCollection speed
19 years ago
orbiter 5d2cd26529 enhanced kelondroCollection performance
19 years ago
rramthun 5625937d1c Language improvements
19 years ago
orbiter 577a6e6487 some work on kelondroCollection, no effect on current YaCy functions
19 years ago
orbiter 2185a5cfb7 prevention of possible ConcurrentModificationException
19 years ago
auron_x 71228cfc56 *)added ip to Blog.xml
19 years ago
orbiter b30645305b some additions to kelondroCollection
19 years ago
orbiter 370c481fa7 bugfixes
19 years ago
orbiter 26b6cddf51 synchronized the DNS cache, because the non-synchronized version resulted in deadlocks
19 years ago
orbiter c36e9fc8d3 full integration of kelondroRow
19 years ago
orbiter 6e49721762 completed and tested kelondroFlexTable
19 years ago
orbiter b68f7dec9d added stub of new table class
19 years ago
orbiter b21824ef16 added new array interface
19 years ago
orbiter c75cacda95 added a flex-width-array: this is a table where it is
19 years ago
orbiter 4a907a570f 1st step to migrate kelondroTree to usage of kelondroRow instead of byte[][]
19 years ago
orbiter 572d53506c new kelondroRow objects now replace byte[][] objects in object cache
19 years ago
orbiter 09f780df27 more bugfixes for the new row/stack handling changes
19 years ago
orbiter 89424ff122 multiple bugfixes for new stack/row features
19 years ago
orbiter 3c3c047d0a integrated kelondroRow into kelondroStack
19 years ago
orbiter 5bb565944f integration of new kelondroRow into some parts of kelondro,
19 years ago
orbiter d580f582dc update to row/column handling
19 years ago
orbiter eaa6f012f0 refactoring: better naming for classic DB (files in WORDS)
19 years ago
orbiter 5041d330ce refactoring
19 years ago
orbiter 7b3b12888c refactoring: integrated indexContainer abstraction layer
19 years ago
orbiter cb295fbbdc refactoring
19 years ago
rramthun bc94a714b2 Better explanation for the auto-dom-filter.
19 years ago
orbiter 28ff7ec214 added missing file from last refactoring
19 years ago
orbiter 196b8abb30 refactoring
19 years ago
orbiter 24686e50a2 - fixed a caching bug
19 years ago
hermens b48327904a Don't disconnect peers that report 'busy' during index transfer.
19 years ago
orbiter 899c1a5df5 integrated cell-, and row-management classes
19 years ago
orbiter 4d8f8ba384 added cache-performance analysis for node caches
19 years ago
theli a520ab2e8c *) adding possibility to use an existing PKCS12 certificate for https
19 years ago
theli c5c5c166f0 *) fix for javadoc generation
19 years ago
orbiter 1b4a27cd99 added monitoring for new miss-cache
19 years ago
orbiter bd057b44dd - automatic setting of peer-does-not-accept-remote-crawl
19 years ago
orbiter 912116c5a7 renew cache update time if a cache-read hit happens
19 years ago
orbiter 81e79f2caf fixed new cache behaviour changes
19 years ago
orbiter 545f81b317 bugfix
19 years ago
orbiter cda087f43b - integrated cache miss storage into object cache
19 years ago
orbiter 757ec28430 refactoring: better data capsulation for indexURL
19 years ago
theli 61078b3885 *) adding support for delayed shutdown
19 years ago
theli 8b7626f8d1 *) Automatic redirection of browser if user changes port settings in ConfigBasic
19 years ago
auron_x e7199c6c7e *)fixed "Umlaute"-Bug in Blog
19 years ago
orbiter af098b815c - fix for blog/wiki error
19 years ago
orbiter 90d569d70f refactoring of index management:
19 years ago
orbiter a930be4ba3 refactoring of index management:
19 years ago
orbiter 634543121b added debug message
19 years ago
orbiter 74a78ebd78 turned back handling of map-writing into kelondro because of possible bug for testing
19 years ago
orbiter e656a00b74 removed some unused methods
19 years ago
auron_x 232ab7902b *)catched Null-Pointer-Exception
19 years ago
orbiter 82b2bc6932 patch for index-transfer DoS problem
19 years ago
hermens df7e1d9df3 Changes to plasmaURL and subclasses:
19 years ago
orbiter a474669338 start with refactoring of index management
19 years ago
orbiter 338047e056 replaced kelondroDyn write methods for properties and maps by faster version
19 years ago
orbiter b40f0edbe5 replaced property- and map-reader in AbstractRA by much faster version
19 years ago
orbiter 7f28a1a4cb another fix in kelondroDyn: construction of getDyn chunks was not clean
19 years ago
orbiter bb931c7b83 fix for some improper details in kelondroDyn
19 years ago
orbiter 19c6e67003 - added generation of news for blog entries
19 years ago
rramthun f08e33680c Added Blog-news-symbol as requested.
19 years ago
theli b4ab183518 *) Bugfix for NullpointerException if the seeds IP could not be resolved
19 years ago
theli f331def5d8 *) Bugfix for distribution. Incorrect behavior if peerCount == selectedCount
19 years ago
theli cea6e416d9 *) wrong name in header
19 years ago
theli df068cf23c *) adding first version of native SSL support for yacy
19 years ago
auron_x 55ea4cbfe6 *)reverted patch for memory-display issue
19 years ago