Commit Graph

1514 Commits (cf1186597bfcdc0bd918b07a1b8ad79b6bf0b96d)

Author SHA1 Message Date
orbiter cda087f43b - integrated cache miss storage into object cache
19 years ago
orbiter 757ec28430 refactoring: better data capsulation for indexURL
19 years ago
theli 61078b3885 *) adding support for delayed shutdown
19 years ago
theli 8b7626f8d1 *) Automatic redirection of browser if user changes port settings in ConfigBasic
19 years ago
auron_x e7199c6c7e *)fixed "Umlaute"-Bug in Blog
19 years ago
orbiter af098b815c - fix for blog/wiki error
19 years ago
orbiter 90d569d70f refactoring of index management:
19 years ago
orbiter a930be4ba3 refactoring of index management:
19 years ago
orbiter 634543121b added debug message
19 years ago
orbiter 74a78ebd78 turned back handling of map-writing into kelondro because of possible bug for testing
19 years ago
orbiter e656a00b74 removed some unused methods
19 years ago
auron_x 232ab7902b *)catched Null-Pointer-Exception
19 years ago
orbiter 82b2bc6932 patch for index-transfer DoS problem
19 years ago
hermens df7e1d9df3 Changes to plasmaURL and subclasses:
19 years ago
orbiter a474669338 start with refactoring of index management
19 years ago
orbiter 338047e056 replaced kelondroDyn write methods for properties and maps by faster version
19 years ago
orbiter b40f0edbe5 replaced property- and map-reader in AbstractRA by much faster version
19 years ago
orbiter 7f28a1a4cb another fix in kelondroDyn: construction of getDyn chunks was not clean
19 years ago
orbiter bb931c7b83 fix for some improper details in kelondroDyn
19 years ago
orbiter 19c6e67003 - added generation of news for blog entries
19 years ago
rramthun f08e33680c Added Blog-news-symbol as requested.
19 years ago
theli b4ab183518 *) Bugfix for NullpointerException if the seeds IP could not be resolved
19 years ago
theli f331def5d8 *) Bugfix for distribution. Incorrect behavior if peerCount == selectedCount
19 years ago
theli cea6e416d9 *) wrong name in header
19 years ago
theli df068cf23c *) adding first version of native SSL support for yacy
19 years ago
auron_x 55ea4cbfe6 *)reverted patch for memory-display issue
19 years ago
theli 5048b05bc6 *) Index Transfer should only restart at the beginning if the delete
19 years ago
auron_x 53d9ab6db7 *)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers
19 years ago
theli ddfe0f0e27 *) don't try to parse referer string if it's null
19 years ago
theli bcc950c533 *) Bugfix for Index Transfer
19 years ago
allo 99110e6fd2 Fixed some of the copyright headers.
19 years ago
allo a1ba7fab69 bugfix for proxy users
19 years ago
orbiter d4b4812732 extended kelondroDyn with new objectBuffer
19 years ago
auron_x 586b256627 *)fixed Blog-bug with german Umlaute
19 years ago
allo 9938c252dd better Errorhandling for proxyAccounts
19 years ago
orbiter 35995cf8c7 some enhancements to caching and kelondroRA-methods
19 years ago
orbiter 2e89477f22 undoing last change
19 years ago
orbiter a3a4525931 usage of a buffer to prevent too many cache lookups in kelondroMap
19 years ago
orbiter 015d044c25 tried to fix some problems with latest changes to httpc
19 years ago
orbiter 55c5b41bd0 modified kelondroDyn to work better with new object caches
19 years ago
orbiter 26e3216bcc update to profile fetch behavior
19 years ago
orbiter 3e31820c3d - corrections to PerformanceMemory display of object cache
19 years ago
orbiter fd7c17e624 added virtual host support:
19 years ago
orbiter 461548698c configuration of index transfer chunk size
19 years ago
orbiter 29b1b0823c added monitoring of new object cache to performanceMemory page
19 years ago
orbiter 23ced30e83 fixed a bug in new caching
19 years ago
low012 35f9418117 Fixed links and images. (http://www.yacy-forum.de/viewtopic.php?p=20908#20908)
19 years ago
orbiter bab9ee38e7 added very experimental object cache for all kelondroTree
19 years ago
theli 9104001e7c *) Better error handling for assortment import
19 years ago
low012 d40ccc5208 *) Partly undoing last commit\n*) Fixed bug that caused attributes of cells in tables not to be recognized as such.
19 years ago
low012 adcad5eae6 *) Fixed a bug that prevented the usage of tables in the wiki.
19 years ago
hermens 51e3bb576f Don't increase dhtTransferIndexCount when the last transferred index was smaller
19 years ago
low012 152745b145 *) Added some characters and their HTML-codes.
19 years ago
hermens a0ca4c5fb8 Remove a possible race condition between DHT transfer and deQueue
19 years ago
hermens 0cfba8950f Removing unnecessary and possibly dangerous synchronization of the wordIndex
19 years ago
orbiter fe4ad214f1 configuration of time-out for fetching seed-lists during bootstraping
19 years ago
allo 1179c9ffff fix for the bookmark error.
19 years ago
orbiter d6213f8a85 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19482#19482
19 years ago
orbiter e9aadb2e11 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19765#19765
19 years ago
theli 727aac4768 *) Bugfix for Transparent-Proxy-Support <-> Port Forwarding problem
19 years ago
theli cd4aeffea2 *) Bugfix: httpdFileHandler.java did not handle filenames with encoded chars correctly
19 years ago
theli a10072b5c0 *) Adding timeout to ftpc.java
19 years ago
theli 76ea16a6cb *) Removing Keep-Alive header (is also a hopByHop header)
19 years ago
orbiter b0036249c1 added some attributes to network picture
19 years ago
hermens cbcf7418ef Cleanup synchronization in plasmaWordIndex
19 years ago
orbiter 60e5aff9fc some enhancements to the remote crawl trigger
19 years ago
orbiter dbe96e6541 added hand-over of search filter and prefer ranking to yacy protocol
19 years ago
rramthun 0604203bce Updated and corrected German language file
19 years ago
low012 4639c0ac6d *) cleaned up code
19 years ago
orbiter 00a5d435e2 - fixed some bugs with domain filter
19 years ago
orbiter 14d6e476c9 tried to solve some problems with new picture viewer
19 years ago
low012 23cdf319be *) cleaning up code
19 years ago
orbiter 9324425165 fix for remote crawl reject
19 years ago
borg-0300 30e4fc39a5 HTCache extended
19 years ago
orbiter d0dd8b14d2 fixed picture tag and presentation
19 years ago
borg-0300 da6a8bafa2 rename currCacheSize -> curCacheSize;
19 years ago
borg-0300 92110aea32 nullpointer fix for profile(); other minor change;
19 years ago
orbiter f0833b0328 introduced simple search interface
19 years ago
orbiter bd283b8443 fixed bugs:
19 years ago
orbiter 47b541b2d1 added better option handling in yacysearch
19 years ago
orbiter c9e16bfd48 first try to insert image search (does not work yet)
19 years ago
orbiter f77775220b fixed parser error
19 years ago
auron_x 0bf2eb4813 *) fixed Blog updating timestamp on edit (now always keeps creation-date)
19 years ago
orbiter 22de954a57 added some log output to parser
19 years ago
orbiter 83e0e765ec redesigned some parts of the html scanner & parser
19 years ago
orbiter ac114d69c0 tried to fix some problems with time-outs during search
19 years ago
orbiter e2e8d0c188 some kind of refactoring of yacysearch:
19 years ago
orbiter 6b63e26cbb - removed search function from index.html/java, only imput left
19 years ago
orbiter bc3e80fe42 quickfix
19 years ago
orbiter d8d0ac29c3 added image-viewer servlet that can do:
19 years ago
orbiter ddc6394d9b fixed bug about auto-depth 0
19 years ago
orbiter 60351fa3f7 small fix to previous commit
19 years ago
orbiter a469874e3f added and fixed time-out behaviour during search
19 years ago
orbiter 1d0b0d6e2a synchronized local searched to prevent that several searches are performed at the same time
19 years ago
hermens 22b9d03bbf Correcting remaining time issue in getContainers
19 years ago
orbiter 5defe97ccb fixed a problem / possible bug with ordering implementation (did not rotate always)
19 years ago
orbiter d58788b753 added some synchronisation
19 years ago
orbiter e566d1d8d6 some bugfixes regarding new crawling options
19 years ago
orbiter c7f1300300 -fixes for last commit
19 years ago
orbiter f2421f6a47 some small attribut changes regarding cache flush
19 years ago
orbiter 7a650d0023 several bugfixes
19 years ago
borg-0300 245cc34d51 small fix for last commit
19 years ago
borg-0300 e2853f357d added more lowercase to url normal form generation
19 years ago
orbiter 59d52fb4a9 fixed some problems with crawl profiles
19 years ago
orbiter 4a5b5515b5 added a lowercase to url normal form generation
19 years ago
allo 44d72f06c4 more Caching
19 years ago
allo 918445a2f4 Bugfix for last commit.
19 years ago
orbiter 708cc6c8d9 fixed some bugs for auto-filter and added monitor in profile list
19 years ago
allo c58789177f bookmarkCache
19 years ago
rramthun 250864406f ...
19 years ago
rramthun 42b0b10a95 -Adding Windows Media to types which are not sended compressed
19 years ago
allo 2ed4fa96b7 tagCache
19 years ago
allo 330eb9c74f bookmarkDB cleanup
19 years ago
orbiter e82899ba57 fixed missing urls map initializer
19 years ago
orbiter 63f39ac7b5 added 3 new crawling steering options:
19 years ago
orbiter 1fc3b34be6 some pre-work (without function yet) to implement:
19 years ago
theli c9e6b5e391 *) check size of indexing-queue and crawler pool before processing remote triggered crawl jobs
19 years ago
orbiter 1509314ea6 set tighter control during DHT index and peer selection
19 years ago
hydrox fcc0683200 *) undoing last commit
19 years ago
hydrox 9411961eec *) another little fix for DHT-Transfer
19 years ago
borg-0300 77f3237de3 adapted for isListed()
19 years ago
hydrox 8b14a0c833 *) little fix for DHT-Transfer
19 years ago
orbiter 1f4412a146 adopted isListed to discussed new behavior as discussed (url, getFile)
19 years ago
orbiter 59fc55ea1e added checks to protect peers from wrong seeds
19 years ago
orbiter 063ef4660a bug?
19 years ago
orbiter 82358677a9 added another shiftK2W to flushCacheSome
19 years ago
orbiter 128e4ab199 - in serverSystem: maxPathLength is now a variable, not a method
19 years ago
orbiter a37b09e303 implemented automatic adoption of chunk-read-ahead in kelondroTree to needed chunk size
19 years ago
orbiter 30e3e3a0fd adopted MAXPATHLENGTH to host system capabilities
19 years ago
borg-0300 d808765087 something Javadoc
19 years ago
borg-0300 85bb8e32a1 Bugfix for last commit
19 years ago
borg-0300 3fe402069f try to fix
19 years ago
orbiter f16f1f15cd bugfix for 100% CPU bug; thanks to Matthias for analysis
19 years ago
borg-0300 254a13efd9 MAXPATHLENGTH used
19 years ago
borg-0300 8865948e4e Cleanup;
19 years ago
orbiter 6c70f4a0cf renamed wordHashes for a word hash set generation to wordHashSet
19 years ago
orbiter d5f8f40c31 removed correcting iterator
19 years ago
orbiter 526407f32e adoptions, fixes for last commit
19 years ago
orbiter 488a0ed580 replaced old keyIterator and rowIterator by buffered iterators
19 years ago
hermens 4e9a8f41fd rwiDBCleaner + dbImporter: Iterate over small excerpts of
19 years ago
hermens 474379ae63 remove TABs from plasmaDbImporter.java
19 years ago
orbiter dba02f399f starting of re-design of kelondroTree iterator
19 years ago
orbiter f02b426073 made kelondroTree.nodeIterator private
19 years ago
borg-0300 5f6fdf1786 Bugfix for getCachePath(URL url)
19 years ago
orbiter 303b6463a8 added debug line to URL storage for testing
19 years ago
orbiter 431a4f3609 eliminated correcting iterator in kelondroTree
19 years ago
orbiter 91dca2cd8d fixed a bug in last commit: LURL entries cannot be written,
19 years ago
orbiter 3286b1f498 re-organisation of lurl-creation and -stacking
19 years ago
orbiter 9cca36a107 no more strict comparator checking in map exclude method if not needed
19 years ago
orbiter 0b903c5317 removed usage of kelondroNaturalOrder from plasmaCondenser to experimental
19 years ago
orbiter 4239db0d1c fixed new ordering for backup iterator TreeSet
19 years ago
borg-0300 399538b7de Bugfix: wrongly compared
19 years ago
orbiter 33eba5ecb8 temporary disabling last change, does not work (cannot debug right now)
19 years ago
orbiter f0464042fc fix for latest iterator-replacement-fix:
19 years ago
borg-0300 ec21c585cb try to fix path too long
19 years ago
orbiter a6a3f4b694 fix for svn 1888
19 years ago
hydrox 8da13088e9 *)removed multiple DHT_Distribution_Threads
19 years ago
orbiter 283a7181c6 try to fix new 100% cpu bug, possibly caused by iterator method
19 years ago
theli 34c075c1c7 testcommit with subversive
19 years ago
orbiter f588c0724f removed cache flush in case of DHT receive
19 years ago
orbiter e94b374d56 update to cache flush method
19 years ago
orbiter bcd99fe83e introduced a second RAM cache for DHT transfer
19 years ago
hydrox 360a460da8 *)URL-Cleaner: moved logging-statement to correct position
19 years ago
orbiter 02f9765013 quickfix for time problem during cache restore
19 years ago
orbiter 69d26045eb quick-fix for http://www.yacy-forum.de/viewtopic.php?p=18805#18805
19 years ago
allo b3df5ce2b8 another local iprange
19 years ago
hermens ad119f06af *) Don't overwrite new entries with older ones
19 years ago
orbiter be88687d8c fixed some problems with new cache flush karenz
19 years ago
theli d3da7c9a08 *) Adding support for robots Allow directive
19 years ago
theli 734d18f283 *) more correct robots.txt validation
19 years ago
hydrox f046e1814a *fix or last commit
19 years ago
hydrox c55c51e2a8 *)added keywords to IndexCleaner_p.java
19 years ago
theli f0ad0d2b2b *) better robots.txt support
19 years ago
orbiter ddbeda738e added minimum age of word in cache to performance menu
19 years ago
orbiter f188611fc6 apply blacklist on rwis during dht receive
19 years ago
theli 915812f597 *) Undoing robots parser policy changes from svn rev. 1421
19 years ago
orbiter 0ec28b8f8e added DBCleaner from Hydrox
19 years ago
theli 5ee0125046 *) adding possibility to configure the server port for seed uploading via scp.
19 years ago
allo 2065138a41 reverted last Commit.
19 years ago
allo 7afa5c1b8e staticIP fix
19 years ago
theli fb4100d47b *) undoing last commit.
19 years ago
theli a84cc71218 *) removing getTotalRuntime
19 years ago
low012 1965a8cf70 *) bugfix for previous commit
19 years ago
low012 1c3b415c35 *) nicer anchors (TOC)
19 years ago
low012 6000a38a05 *) changed anchors (TOC) according to thelis request in http://www.yacy-forum.de/viewtopic.php?t=1987
19 years ago
auron_x dce08771d1 *) Fix for wrong estimated and elapsed times when import was paused
19 years ago
hermens b34713324a DBImport: remove words from source index even if nothing has been added to home index
19 years ago
orbiter 3237fe1cc7 added IOException for httpc client error
19 years ago
orbiter 520b60f15b fix for http://www.yacy-forum.de/viewtopic.php?p=18610#18610
19 years ago
theli c7ececbfb2 *) httpd.mime: adding jar mimetype
19 years ago
orbiter ae536c4608 fixed soap service: index.soap -> yacysearch.soap
19 years ago
orbiter bae3783d38 added a snippet marking
19 years ago
orbiter f0a38873eb * added yacysearch page with better view on search results
19 years ago
orbiter f0041d504d remove of several results from a single domain is stopped if the result set is smaller than the wanted number of results
19 years ago
auron_x b92a00172e *) modified Blog
19 years ago
allo 68ec572df0 bugfix for staticIP
19 years ago
theli 89286478e7 *) removing thread pool eviction for now. Not needed at the moment
19 years ago
theli 759800f543 *) Bugfix for storeHTCache problem
19 years ago
orbiter a4682e2810 fixed problems in basic config and added language setting
19 years ago
orbiter a8548c0484 * several bugfixes regarding basic configuration
19 years ago
orbiter 1b9b8922d9 * fixed problems with new basic 1-2-3 configuration (now authentication required)
19 years ago
auron_x 8c6f38fe70 *) added Blog to YaCy (atm not reachable through interface) -> Blog.html
19 years ago
orbiter c51603a405 added two new kelondro classes that will handle the new index data structures (not used yet)
19 years ago
orbiter ce5274c194 yacybot user agent
19 years ago
allo 3b7e66ab48 staticIP should now work
19 years ago
theli 8558000bd9 *) better handling of port forwarding
19 years ago
allo 32d4c3e4c6 static IP is proper
19 years ago
orbiter f96238e9be cosmetic
19 years ago
low012 d6cc0ec3d8 *) Fixed a bug: Images in tables were not displayed if alt or align attributes were added.
19 years ago
hermens 351bd0a678 *) dbImport: convert cacheSize to kb when creating plasma* objects
19 years ago
orbiter eaffcfefe2 * added more ranking attributes (without function; this will be added later)
19 years ago
orbiter 87e90b9d8c refinements in ram cache flush procedure and default timing
19 years ago
orbiter d31a4e0b4f some small enhancements with cache flushing parameters and data structures
19 years ago
orbiter 3703f76866 - fixed re-search bug: after a search with several words, a second search could not
19 years ago
theli fbbbf5f411 *) remote trigger for proxy-crawl
19 years ago
low012 f31b633b2e *) Fixed yet another small bug in the wiki. (no blank between image URLs, align and alt)
19 years ago
low012 8bdbf0dfff *) Fixed a bug in code for tables and hopefully eliminated XSS vulnarability which Allo pointed out to me.
19 years ago
theli dc9174c809 *) Implementing snippet fetching via ajax
19 years ago
theli 468ca5b0e6 *) Bugfix for url.toString problem in yacyClient crawlOrder
19 years ago
low012 62d0f7a334 *) added TOC for pages in wiki as requested in http://www.yacy-forum.de/viewtopic.php?t=1987
19 years ago
orbiter 1d8ca6e082 serialized dhtChunk deletion with indexing
19 years ago
allo ff476c19a5 tuning User.html
19 years ago
low012 2e8221050a *) removed redundancy, no changes in functionality
19 years ago
theli 2336f0f013 *) allow pausing/resuming of crawlJob Threads separately
19 years ago
allo af1da090bb blogRight in UserDB.
19 years ago
borg-0300 2ee5796e76 added keywords, properties;
19 years ago
orbiter 60dac4325e serialized indexing with dht selection
19 years ago
orbiter a840755964 moved parts of index transfer logic back to switchboard
19 years ago
orbiter 134253a603 fixed bug with cache flush
19 years ago
borg-0300 149409ba5c move description -> javadoc
19 years ago
borg-0300 00975359c5 added keywords, properties
19 years ago
orbiter c2d863855d different flush limit
19 years ago
borg-0300 64441b1f78 ADDED: yacy.badwords list to filter the topwords
19 years ago
allo d7da273d7e using ArrayList instead of Vector
19 years ago
allo d6f7bd44ae fix for public tags
19 years ago
orbiter f9063e2040 added some synchronization to avoid that several tasks can trigger a cache flush simultanously
19 years ago
orbiter 2c4e4ae6a2 further refactoring of dht selection, transfer and flushing
19 years ago
orbiter 73dad68cf1 outsourced thelis DHT flush class into own file
19 years ago
allo aa4b04e3dd reverted last change
19 years ago
allo 467216d4c7 bugfix for umlaute and html-specialchars in wikiCode
19 years ago
allo 4b0dae8fcf added a possiblity to get the ranking values for an url.
19 years ago
orbiter 85ac7d8386 * moved DHT transfer thread to own class file, needed for further modularization
19 years ago
orbiter 34341a868e code cleanup
19 years ago
orbiter 7df2e6e571 bugfix for last commit
19 years ago
orbiter cd41e9a0eb moved DHT index selection to new object that holds indexes to be send away to other peer.
19 years ago
allo e3dd67bba0 bookmarks import.
19 years ago
allo dda143df79 We NEED this here for the XML-Files
19 years ago
theli 42a5f56723 *) Bugfix for broken dht thread configuration
19 years ago
allo bfd37e34aa using other XML Parser
19 years ago
theli aa87df35e1 *) To avoid confusion location will now also be displayed for own peer
19 years ago