Commit Graph

2614 Commits (501a7aae90dad76e474c72528444462b4d49f163)

Author SHA1 Message Date
orbiter 985fd807cc bugfixing in collection methods
19 years ago
theli c7bea4addb *) soap api
19 years ago
theli ee4d4e8567 *) Soap-handler: bugfix. wrong content-length was send when using content-encoding
19 years ago
orbiter d3431433b0 more anonymization in logging
19 years ago
orbiter e6044e5198 bugfix for
19 years ago
theli 4d19d94348 *) bugfix for nullpointerexception
19 years ago
theli 532c23b5c7 *) soap handler
19 years ago
(no author) 5141fa5942 combinedVersionString2PrettyString(..) renamd to combined2prettyVersion(..), new parameter "computerName" added to indentify the source of problems
19 years ago
orbiter 78b7f6f7fd bugfix for index remove bug,
19 years ago
(no author) 0e79f2fd7e name of the file to tranlate apears ahead its translation
19 years ago
orbiter ebd2d629d8 added missing file for last commit
19 years ago
orbiter 147d88cf23 re-design of database caching
19 years ago
orbiter 4e363108e1 - removed bad debug code that caused a large and unnecessary delay during global search
19 years ago
orbiter f21ede312e bugfixes for internals of database organization
19 years ago
orbiter eb4bfb0e9d fixed problem with cache.profile()
19 years ago
orbiter 2a9d868f6d - removed object cache from kelondroTree
19 years ago
theli 7299dc30e3 *) new soap service to manage the yacy file-share
19 years ago
theli 777e39cea0 *) new template to display the dir-listing in xml format.
19 years ago
theli 9e8942a064 *) adding method to implement blacklist from file
19 years ago
theli 4d1f933ea1 *) avoid reading of content body into memory
19 years ago
theli 88cfdecd38 *) Bugfix: calling close must not close the wrapped input stream, otherwise
19 years ago
theli d38ef0493d *) be more tolerant against missing ports in url
19 years ago
theli cfe54fedc7 *) Bugfix for resolveBackpath problem with tailing /..
19 years ago
orbiter dc056fabf3 small bugfix
19 years ago
orbiter 278d8c3c7e - more asserts
19 years ago
allo 5a6488256d catch the "username too short" exception
19 years ago
orbiter 2d3f1a53fd handling of Missing byte-order mark exception
19 years ago
theli ac13fa763a *) bugfix for blacklist remove (blacklist was not informed about remove)
19 years ago
karlchenofhell c5a5a9eb1c - patch for NullPointerException by Fuchs: see http://www.yacy-forum.de/viewtopic.php?p=27033#27033
19 years ago
allo 8a5c2d0a19 fix for supertemplates, too.
19 years ago
allo c35793fb46 fix for last commit
19 years ago
theli 3e0516446b *) new soap function to get the current queue status
19 years ago
allo a831c83025 create servletProperties, with the servlet specific funktions from serverObjects
19 years ago
orbiter 1825540020 another fix for url-db migration
19 years ago
orbiter 83a0efc65a better assert statements and fixes
19 years ago
karlchenofhell d13b381f83 - added mint-green skin
19 years ago
orbiter 2025e885d6 a fix for problems with remove situations in kelondroFlexSplitTable
19 years ago
theli b12da510f3 *) adding optional libraries for needed for soap attachments
19 years ago
orbiter 11843bba7f fix for Malformed URL Exception in url migration
19 years ago
theli 9eecc9a888 *) libs added to classpath
19 years ago
theli a1acc9c389 *) new function to configure distributed crawling
19 years ago
theli 0996e550e7 *) deploy soap peer admin service
19 years ago
orbiter 3ffc5b8793 fixed problem with serverCharBuffer.append(char)
19 years ago
orbiter 8b56887676 removed unused code
19 years ago
orbiter 06854988da - full integration of new LURL database in INDEX
19 years ago
(no author) 02c66c04f2 *) Missing file from last commit
19 years ago
octoate e4a3574b77 StringBuffer now resets every time the parser is called
19 years ago
theli ef912811f1 *) adding new soap service for peer administration
19 years ago
karlchenofhell ce237aefad - assortment-sizes table from PerformanceQueues_p.html is not shown if not used
19 years ago
theli 68204ff729 *) Suppressing for bad client requests.
19 years ago
theli c1dff41f99 *) adding possibility to deploy custom SOAP services
19 years ago
theli df49724f28 *) better error handling for seed upload - test download - problems
19 years ago
theli a5b9b514c1 *) retry crawling without content-encoding if the content-encoding header was not correct
19 years ago
theli 52466067d8 *) Bugfix for ArrayIndexOutOfBoundsExceptions which occure because SimpleDateFormat is not thread-safe
19 years ago
theli b357a13e9a *) adding synchronization block because SimpleDateFormat is not thread-safe
19 years ago
theli 92f774edd1 *) Better charset encoding detection
19 years ago
orbiter b79e06615d - added new LURL.Entry class for next database migration
19 years ago
octoate cc24dde5e0 First version of a MS Excel parser based on Apache POI
19 years ago
karlchenofhell 4c63129136 - stupid mistake...
19 years ago
karlchenofhell b14a500b88 - removed debug output from PerformanceMemory_p
19 years ago
karlchenofhell ebf0da2a45 - now the fix http://www.yacy-forum.de/viewtopic.php?t=2974 works
19 years ago
theli 09337c9751 *) Bugfix wrong chars in soap search result document
19 years ago
theli 3d152bfe43 *) Logging message added
19 years ago
karlchenofhell b5e40e2fa2 - fix for http://www.yacy-forum.de/viewtopic.php?t=2974 (no cache-sizes for new db)
19 years ago
theli 96f45e9b15 *) Bugfix wrong chars in soap search result document
19 years ago
theli da2ac6fa23 *) adding new ant target to allow generation of client stub classes for yacy soap api
19 years ago
theli a9cc6df21b *) adding wsdl files to generate client stub classes with ant
19 years ago
orbiter 77a59a115d refactoring of indexing methods
19 years ago
orbiter 14490f0a83 added missing flush statement
19 years ago
orbiter 688cbfb776 - bugfixing for flextable bug
19 years ago
allo a29b4d4fb5 extended Supertemplates for Headerincludes.
19 years ago
theli a7e11ada50 *) suppressing stacktrace for "server has closed connection"
19 years ago
allo 72cc082ebe created password generator for scripts.
19 years ago
theli 5b114249ce *) Bugfix for ViewLog problem with multiline logging messages
19 years ago
theli de5e233766 *) Bugfix for GuiHandler sorting problem
19 years ago
theli fd94aa4bef *) Bugfix for IndexOutOfBound in GuiHandler
19 years ago
orbiter 29a1318ef9 bugfixes for wrong database access that do not consider deleted entries
19 years ago
theli cbb1e710b9 *) removing old class
19 years ago
orbiter c6d46f7ebd null pointer bugfix
19 years ago
theli decb09df6d *) Trying to be more tolerant against wrong charset names
19 years ago
theli e9afe39cbb *) Trying to be more tolerant against wrong charset names
19 years ago
theli 7526c831a8 *) Suppressing stracktrace
19 years ago
orbiter 50f2578c55 - some bugfixing and code cleanup
19 years ago
orbiter bdf4c7c51e added missing files for last commit
19 years ago
orbiter a5dd0d41af - refactoring of plasmaCrawlLURL.Entry to prepare new Entry format
19 years ago
orbiter 130cc76927 loop detection and termination in deletedHandles method
19 years ago
octoate 1c4076da8a First version of the MS Powerpoint parser based on Apache POI
19 years ago
theli 5b75d64d7d *) bugfix for last commit
19 years ago
theli 71ed104bc7 *) adding additional rpm mimetype (used by packman)
19 years ago
borg-0300 76d959122b new constants, finals, Stringbuffer, cleanup
19 years ago
rramthun 581dd2ec72 *)Proper arrow-function on Network.html, but ordering is still broken. Perhaps someone could fix that?
19 years ago
orbiter 6396f5971e bugfixes and migration attempt toward new kelondroFlex db
19 years ago
hermens 48f81acc0e reverse SVN 2744, it is not needed
19 years ago
hermens 1da9aece12 Repair DNS prefetch during cacheScan
19 years ago
orbiter 918b59dc5e - bugfix for snippet profile (no delete button)
19 years ago
orbiter 2bb529cedb added peer tags for peers in robinson mode
19 years ago
orbiter afbb547f3d extended options for abstracts generation in remote search interface
19 years ago
theli 22649408ad *) Better errorhandling for charset encoding problem during content parsing
19 years ago
theli a9c7e3f061 *) Bugfix for NoSuchElementException
19 years ago
orbiter f25f61d9d3 documentation of compile problem. See
19 years ago
orbiter c8f3a7d363 added snippet-url re-indexing
19 years ago
low012 2cfd4633ac *) even better handling of searchwords in snippets, words can consist of letters and numbers now
19 years ago
orbiter b062847797 fix for
19 years ago
orbiter e17fea7015 files in htcache are now stored in different hash/tree subdirectories
19 years ago
orbiter 661f005214 fix for seed upload build script
19 years ago
low012 2d3b7251a4 *) better handling of searchwords in snippets (see http://www.yacy-forum.de/viewtopic.php?t=2891 for details)
19 years ago
orbiter ddf8f220f6 fix for build fail
19 years ago
orbiter 25ae3d3161 generalized definition of hexhash
19 years ago
orbiter 86047f439d removed very bad bug that prevented production of any remote search result
19 years ago
orbiter f0d747c723 removed deprecated method
19 years ago
orbiter 5ff77612ac bugfix for old WORDS storage method
19 years ago
orbiter 0f10bdde22 more generic cache methods
19 years ago
orbiter 72482b1426 fixed scraper
19 years ago
hermens 6557112d8f small fix for plasmaURLPool.getURL() needed for new alternative htcache layout
19 years ago
hermens 440c6ee657 Implement alternative htcache layout
19 years ago
allo 226f2c5b2c first version, of the Serverlet Debugger
19 years ago
orbiter adf1f74ab2 bugfix for java 1.5 compile problem with serverCharBuffer.append(char)
19 years ago
orbiter fd61209797 lines inside tags without punctuation are extended by a single dot.
19 years ago
allo 1d0c0edda3 first version of posts/get from the del.icio.us api
19 years ago
orbiter 1969522dc1 removed lowercase of snippets (and other things):
19 years ago
orbiter 43614f1b36 bugfix in collection index. the index for collections was not created correctly
19 years ago
orbiter 1dfab1abe3 more control for seed receive
19 years ago
theli 1c0e65f55f *) Bugfix for problems with charset detection
19 years ago
orbiter db294687ea enhanced logging
19 years ago
theli a9a0f51303 *) suppressing InterruptedException errormessage
19 years ago
theli ce7ee74316 *) better errorhandling in filehandler (try catch block now starts before argument parsing)
19 years ago
theli 1d4fb680ce *) CrawlWorker.java: only keep content in memory if size is equal or less than 5MB
19 years ago
theli 1586d57187 *) odtParser: better handling of large files
19 years ago
theli f17ce28b6d *) plasmaHTCache:
19 years ago
orbiter 630a955674 read snippets from cache in case they are not provided in RAM
19 years ago
orbiter bcf2b800b4 applied UTF-8 encoding parameter to yacy-internal protocol communication
19 years ago
orbiter c40fca08a2 fixed bad handling of string separation
19 years ago
orbiter 5a40ea7866 refactoring of wget string list generation
19 years ago
orbiter dbc2e039bb added time-out option parameter to call hierarchy
19 years ago
orbiter d4c239e4be - fixed problem in collection index with deletion of single url references
19 years ago
orbiter 00746ca232 identified and fixed search performance problem caused by
19 years ago
orbiter b033a80750 better control of failure in node seek of kelondroTree
19 years ago
orbiter 310f1c41cd added option to see ranking scores in surftipps
19 years ago
theli a2e3095044 *) Bugfix. Add missing plasmaParserDocument.close() calls
19 years ago
theli cd5f349666 *) Better handling of large files during parsing
19 years ago
theli 8b2ceddb91 *) Displaying servere and warning logging messages in different colors on ViewLog_p.html
19 years ago
low012 f8ac694e51 *) fixed a bug where searchword in snippets were not displayed bold in front of a punctuation mark (see http://www.yacy-forum.de/viewtopic.php?p=25998)
19 years ago
orbiter df1629b05a - code cleanup
19 years ago
theli c665f6cddb *) handling of quotes in charset string
19 years ago
theli b73efd5565 *) missing changes needed because of last commit
19 years ago
theli 140ddba93f *) adding soap functions to pause and resume the crawler
19 years ago
orbiter 2463e5624a 'quick' release 0.47
19 years ago
theli 49fbb688df *) SOAP: old urlInfo renamed to urlInfoByHash, new urlInfo Function added.
19 years ago
theli 8f143d516b *) make snippet fetcher accessible via soap api
19 years ago
theli 97615af406 *) Restructuring of YaCy SOAP services
19 years ago
theli 241b881560 *) Redesign of YaCy SOAP handler
19 years ago
theli 009a33170b *) Content-Location header added
19 years ago
theli 1aa07a52cd *) Bugfix for UnsupportedEncodingException if the media type contains multiple parameters
19 years ago
theli 625c2ce6b1 *) bugfix for snippet fetching problem if content but not http header is available in cache
19 years ago
theli 813a8a8179 *) migration of mimeTypeParser to jmimemagic 0.1
19 years ago
hermens 3f5a4153a0 Make Peers more receptible to transferred indexes
19 years ago
theli 57415b6889 *) Bugfix for surftipps UTF-8 problem
19 years ago
allo b0a4fcce8c fix from theli
19 years ago
theli b6c7b91582 *) Parser now throws an ParserException instead of returning null on parsing errors (e.g. needed by snippet fetcher)
19 years ago
theli 64b2ef5aae *) Trying to bugfix shutdown problem
19 years ago
orbiter e03427871e enhanced surftipps:
19 years ago
theli 1dc12d6659 *) Bugfix for shutdown problem caused by cacheScan thread
19 years ago
borg-0300 42173462f5 rename cutUrlText to shortenURLString;
19 years ago
borg-0300 af1d89e381 check url == null added;
19 years ago
theli cc667b0aa5 *) htmlFilterContentScraper.java: adding support for link tag
19 years ago
theli 26dfbb7499 *) Bugfix for UTF-8: url names are now stored properly in stackcrawl, crawler, indexing queue and should be displayed correct on the gui
19 years ago
theli cf6acff2c2 *) Bugfix. htmlFilterInputStream document analysis did not work properly for documents smaller than the
19 years ago
borg-0300 f18304ddd3 unused/not needed imports removes;
19 years ago
orbiter ec031eb993 first version of surftipps
19 years ago
borg-0300 b174fbd0ca "import ...*" removed;
19 years ago
orbiter 807756150e patch for strange bug reported by email
19 years ago
theli 5c6251bced *) some improvements for extended html document charset support
19 years ago
theli 33f0f703c0 *) reinserting type cast again
19 years ago
orbiter 8c11a543dc fixed line ending coding
19 years ago
theli b690597275 *) adding casts to avoid compatibility problems between java 1.4 and java 1.5 writer class usage
19 years ago
theli 5afb0cbce8 *) setting default charset (for unkown documents) to iso-8859-1
19 years ago
orbiter f453c14b5d removed unreacheable catch blocks and unused imports
19 years ago
theli ad7f600f25 *) Bugfix. re-enabling inheritance of serverCharBuffer from writer class
19 years ago
theli 97d2a08ef1 *) restructuring needed to support parsing of documents using various charsets
19 years ago
theli fc594e8eda *) adding httpContentLengthInputStream.java class to allow reading of http response bodies
19 years ago
low012 cd636eb00e *) Fix for the fix...
19 years ago
low012 f9a5b55a9e *) Fixed bug described in http://www.yacy-forum.de/viewtopic.php?p=25448#25448
19 years ago
orbiter 3aac5b26da - added automatic tag generation when a web page from the search results is added
19 years ago
low012 8a30c5343d *) Fixed bug where exclamation marks could get lost between [=...=] and <pre>...</pre>
19 years ago
low012 d8f4b17e31 *) Hopefully fixed bug described in http://www.yacy-forum.de/viewtopic.php?t=2825.
19 years ago
theli 0e84a969d6 *) Bugfix for serverCharBuffer read from file operation
19 years ago
theli 90ef19d778 *) first version of a serverCharBuffer
19 years ago
orbiter d374ef2bbe bugfix for tryRemoveURLs
19 years ago
orbiter f644a1c3a7 better evaluation of index abstracts
19 years ago
orbiter 1b48473bc5 bugfix to utf8 recognition
19 years ago
orbiter 90f7241b59 serverByteBuffer.trim() can now recognize utf-8 characters
19 years ago
allo 2fd610b556 http://www.yacy-forum.de/viewtopic.php?p=25611#25611
19 years ago
theli e34d9b3fec *) charset aware headlines (after the serverByteBuffer.trim problem is solved)
19 years ago
theli 8115ac47b5 *) charset aware metadata parsing
19 years ago
theli 3ac30bdf22 *) some todo markers added for additional charset support
19 years ago
theli 06fa891152 *) htmlFilterContentScraper.java: using proper charset for document title
19 years ago
theli 74c3e7cf29 *) storing document charset into plasmaParserDocument object (is needed later by the condenser)
19 years ago
theli c5d3020941 *) better errorhandling for last commit
19 years ago
theli d0a5a53789 *) changes needed for multi-language support
19 years ago
orbiter d82875c72b removed removal of 'funny symbols' that may have caused utf-8 problems
19 years ago
orbiter 26ab1fa885 fixed null pointer exception
19 years ago
theli b0e8ff6eda *) some TODO makers for UTF-8 problem
19 years ago
orbiter 41e27b85b7 fix for crawler condition
19 years ago
orbiter 0ee7e45413 bugfix for merge method (caused by bad refactoring)
19 years ago
orbiter 40965e183e bugfix for minimizeurldb and urldbcleanup
19 years ago
orbiter 5c2f30eaca adjustments to dhtInCache write
19 years ago
theli 9ecf7f0da2 *) some TODO makers for UTF-8 problem
19 years ago
theli e2f8339827 *) some bugfixes for UTF-8 related problems
19 years ago
orbiter c89d8142bb replaced old 'kCache' by a full-controlled cache
19 years ago
orbiter 6e2907135a bugfixes for remote search server part
19 years ago
orbiter cf9884e22b first attempt to implement a secondary search
19 years ago
theli 2a06ce5538 *) next bugfix for UTF-8
19 years ago
theli bdc51591ae *) UTF-8 Bug solved (hopefully)
19 years ago
theli ef751b9d33 *) removing all string operations from the template engine
19 years ago
orbiter 7ef80c1026 more debugging
19 years ago
orbiter b251076e64 avoid ConcurrentModificationException
19 years ago
orbiter 75b198bc02 - updated references to indexContainer
19 years ago
orbiter 0bed3b9ac3 removed superfluous interface
19 years ago
orbiter b7e7808ea6 wordmigration now works also for new index database
19 years ago
theli a0ddf2ec11 *) AbstractCrawlWorker.java: delete already downloaded data on crawling error
19 years ago
orbiter 4f9e42d5ed more changes towards better join-search
19 years ago
auron_x 005400a137 *) reverted last commit
19 years ago
orbiter a7281a9b4d fix for last commit
19 years ago
orbiter 82a6054275 - fixed bug with new indexAbstract generation
19 years ago
theli fded1f4a5d *) better handling of maximum file size limit in crawler
19 years ago
orbiter 416b4e5c6b ups
19 years ago
orbiter 309accb983 memory control for ymage generation:
19 years ago
orbiter 74d1dea30b changes towards better join-search
19 years ago
auron_x 045ffebbd8 *) added debugline to versionstring-processing to find a possible bug in versiongeneration
19 years ago
orbiter ae4e8ce03e - cut for 'probably last html-interface version': version number update
19 years ago
orbiter 64bed59ee8 enhancements to ranking
19 years ago
theli 63893003be *) Adding settings page for the crawler which allows to specify a file size limit and the timeout to use.
19 years ago
auron_x 06b1365066 *) fixed existing protection against divbyzero and removed the new one
19 years ago
orbiter 94d7ced900 fix for last ranking commit
19 years ago
orbiter cc97a3e9c6 fixed possibly bug with indexOutOfBoundsException
19 years ago
orbiter 03835c2ee8 enhanced search result computation
19 years ago
orbiter 809960ddc6 avoid division by zero
19 years ago
orbiter ac3419b65f better debugging for indexOutOfBoundException bug
19 years ago
orbiter 75b03a4580 fix for new ArrayIndexOutOfBoundException
19 years ago
orbiter a8bc768206 enhancements to ranking evaluation
19 years ago
auron_x a82e926c5d *) fix for wrong totalPPM-calculation
19 years ago
theli 33898ae7e9 *) ResourceInfoFactory.java: Bugfix for classNotFoundException
19 years ago
theli 406e170e25 *) more verbose error message
19 years ago
theli b298474e22 *) Bugfix needed because of changed plasmaCrawlLURL.load behavior
19 years ago
orbiter c2e6cc8c6b small part of Bosts patch
19 years ago
orbiter 96c6e4e322 - enhancements to detailed search page
19 years ago
orbiter 9340dbb501 fixed all possible problems with nullpointer exception for LURLs
19 years ago
theli a5ed86105b *) bugfix for handling of ResourceInfo object in proxy
19 years ago
hermens ff4362b02d some more fixes for new plasmaCrawlLURL.load behavior
19 years ago
hermens 7aeadbe7cc another NullPointerException in http.ResourceInfo
19 years ago
orbiter 141f9e5bb4 fix for new plasmaCrawlLURL.load behavior
19 years ago
orbiter 1e7fd48afd added size method to ftpc
19 years ago
hermens 087f7511f8 prevent NullPointerException in http.ResourceInfo
19 years ago
orbiter a2525072f2 bugfix for kelondroRow - property generation
19 years ago
hydrox 59a5511dbb *) added missing static Strings as requested by theli
19 years ago
theli 6578564c9a *) Ignore more hop by hop http headers
19 years ago
theli b44514242a *) crawler/ftp/CrawlWorker.java: better errorhandling
19 years ago
theli 7d7f30139c *) crawler/ftp/CrawlWorker.java: delete old cache file
19 years ago
theli 4ae0f122f8 *) ResourceInfo.java: License header added
19 years ago
theli 043edfa4d8 *) ftp/ResourceInfo.java ResourceInfo object for ftp resources added
19 years ago
orbiter 4866868c0e added write cache for LURLs
19 years ago
orbiter 8a0e35618b enhancements to search result preparation
19 years ago
theli 5c1bb53d2a Missing description for last commit
19 years ago
theli dae763d8e3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2495 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli 4825bfaaf3 *) Bugfix for PrintWriter Problem
19 years ago
orbiter d4c5e2af01 html-dirlist can now also be generated from existing connections
19 years ago
theli 7930839594 *) URL.java: userinfo was not taken over when generating a new url from a base url and a rel. path
19 years ago
orbiter 17ba468165 added html dirlisting generation in ftpc.java:
19 years ago
theli 7a35b8e237 *) direct access to responseheaders of sbQueue.Entry removed to make it more http independent
19 years ago
theli ffbf416e76 *) direct access to requestheader of htCache.Entry removed to make it more http independent
19 years ago
theli 3870d615e3 *) setting htCache.Entry fields to private
19 years ago
theli 393a7d10be *) setting htCache.Entry fields to private
19 years ago
theli ab5a9bee66 *) adding some copyright headers
19 years ago
theli 5847492537 *) next step of restructuring for new crawlers
19 years ago
orbiter 6cce47e217 test of ftp-urls in URL class
19 years ago
theli fce9e7741b *) next step of restructuring for new crawlers
19 years ago
theli e3f0136606 *) next step of restructuring for new crawlers
19 years ago
theli 9ded4e8d5a *) Bugfix for name resolution in proxy mode
19 years ago
theli 1c8300fcec *) Bugfix for name resolution in proxy mode
19 years ago
theli 4e2a950ac9 *) next step of restructuring for new crawlers
19 years ago
theli 09b106eb04 *) next step of restructuring for new crawlers
19 years ago
theli eb9b138986 *) next step of restructuring for new crawlers
19 years ago
theli 1395aae742 *) starting restructuring which is needed to add crawlers for additional protocols
19 years ago
theli b4acbdaa97 *) better handling of server shutdown
19 years ago
theli f3ac4dbbb9 *) better handling of server shutdown
19 years ago
theli 959b779aba *) avoid performance loss if log level is greater than 'fine'
19 years ago
auron_x b515d49f87 *) fix for new combinedVersionString2PrettyString by bost
19 years ago
auron_x 24316ba937 *) improved implementation of combinedVersionString2PrettyString by bost
19 years ago
auron_x 57dda1a92c *)again fixing for wrong version display, now totally working with double instead of float
19 years ago
auron_x 479b74e1dd *) fix for stupid mistake in new ppm-calc which caused decimal digits beeing written to seedinfo
19 years ago
auron_x 5e558fbaae *) hopefully fixed the wrong display of yacy-version
19 years ago
auron_x 348258a557 *) changed PPM-calculation to be much more accurate
19 years ago
orbiter 18b6876860 new cache flush configuration settings
19 years ago
hermens f0278b4092 Bugfix for / by zero when the AssortmentCluster is empty
19 years ago
orbiter 14e0bb0dcf allow more references per word for new db
19 years ago
orbiter 985dcbde7f changed some parameters that may cause better memory usage and more indexing speed
19 years ago
orbiter b7f4a1521b added options to switch on or off the kelondroFlexTable for NURL, EURL and PreNURL
19 years ago
orbiter c26da4893b turned back NURL usage of kelondroTree, kelondroFlexTable has still problems with deleted entries
19 years ago
orbiter db1eae0227 * simplified initialization of database objects
19 years ago
hermens 0b73f2b132 Repair DNS prefetch during cacheScan
19 years ago
orbiter 27a159b401 * documentation update
19 years ago
theli f80f776b89 *) Trying to solve NullpointerException problem in function addURLtoErrorDB
19 years ago
orbiter d78b824e85 fixed problem with default path after first start-up
19 years ago
hydrox 1c99b5a484 *)fixed logging for urldbcleanup
19 years ago
orbiter 135e019883 removed one superfluous line from last commit
19 years ago
orbiter 1591a55963 added object cache miss-cache use for remove method
19 years ago
orbiter 8f3f4ab0eb enhanced synchronisation in plasmaWordIndex
19 years ago
orbiter f933f00f09 another patch to URL protocol handling for 'news', 'nntp' etc:
19 years ago
orbiter 4c6e00d80a more bugfixes for URL class, see:
19 years ago
orbiter 23dd972608 fixed memory calculation in performanceMemory web page
19 years ago
orbiter b7dc251948 fixed bugs in url class:
19 years ago
orbiter 1ce3c22761 better memory control:
19 years ago
orbiter 39b4c26bdc more memory control:
19 years ago
orbiter 3e9d509c39 some small fixes
19 years ago
orbiter 276225d79e fix for URL class
19 years ago
orbiter eb633c0a4f server threads must now supply a method that can be called in case
19 years ago
orbiter f5720cb2fa removed most synchronization in wordIndex (for testing)
19 years ago
orbiter 0187c60010 because of a bug in the JRE 1.4.2 there was no memory protection
19 years ago
auron_x 4eca0f8830 *) fixed PPM calculation for multiple indexer-threads
19 years ago
orbiter cfb51fdef1 less synchronization in plasmaWordIndex
19 years ago
orbiter d6a928c2da quickfix for http://www.yacy-forum.de/viewtopic.php?t=2705
19 years ago
orbiter 6ad471ef96 * applied many compiler warning recommendations
19 years ago
allo cf1186597b utf fix from theli
19 years ago
hydrox 9da3aa74d3 silly me, fix for the fix as advised by theli
19 years ago
hydrox bb3d9a5582 *) e.getMessage().indexOf() can only be used if there is actually an ExceptionMessage.
19 years ago
hydrox 7a54010a9c *) Iterators can't be casted to IndexContainer
19 years ago
theli 5e0b6f8f83 *) sorting peer name list on Blacklist_p.html
19 years ago
orbiter cd5f7e137c fixed problem with NURL-generation upon first startup
19 years ago
orbiter 8418af141a added several consistency checks and small changes
19 years ago
theli 9d13aeca13 *) removing class. does not work so far
19 years ago
theli 95a84ae469 *) adding missing classes
19 years ago
theli eee44be602 *) adding an interface for customized blacklist classes
19 years ago
orbiter 6d2f15971a there is a very strange error that causes that the kelondroRecords structure
19 years ago
theli d2e8e76218 *) now it's possible to configure the yacy blacklist separately for dht, search, proxy, crawler
19 years ago
orbiter 9ae9062bd3 * disabled new kelondroFlex table for NURLs
19 years ago
orbiter 689bbcf9cd replaced kelondroTree db for NURLs by new kelondroFlexTable
19 years ago
orbiter 7fbba41962 synchronization fixes
19 years ago
orbiter 328f9859a5 more synchronization in plasmaWordIndex
19 years ago
orbiter f43c90fa98 fixed handling of null referer in crawlOrder
19 years ago
orbiter 130e6d4719 generalized index object for eurl, nurl and lurl to prepare move
19 years ago
orbiter acdf24877f more synchronization against outOfMemoryError in wordIndex
19 years ago
orbiter 95160d7f2c fixed size computation of index elements from the collection index
19 years ago
orbiter 26116cabde added missing rowdef assignment
19 years ago
orbiter cfbacbbf08 reverted change in robotsParser
19 years ago
orbiter abf22f6e60 removed url normalform computation from htmlFilterContentScraper.
19 years ago
orbiter 740d49751d * strict type and size check in kelondroRow handling
19 years ago
orbiter 314021453f * more logging
19 years ago
allo a52f36787f better templatedebugging
19 years ago
allo 3480d36417 added some debug code
19 years ago
orbiter 61b151b083 * added another auto-fix for collection index inconsitency check
19 years ago
orbiter 0bbbd129ef small fix for exception message
19 years ago
orbiter 718fbc2dae enhancements in kelondroCollectionIndex:
19 years ago
orbiter f58283def2 better control of index flush
19 years ago
orbiter 4be21a3cab ups
19 years ago
orbiter 80b6c90d54 enhancements to prevent blocking during dht transfer receive
19 years ago
theli 9f298083cd *) adding more urls to the error url
19 years ago
hermens d56f06401e - Cache known URLs during indexReceive to avoid getting blocked during loadedURL.exists() whenever possible
19 years ago
theli c09f734d06 *) offer router configuration on ConfigBasic.html
19 years ago
hermens dcbb4d0a6b Display the size of HashBlacklistedCache on PerformanceMemory page.
19 years ago
orbiter d799622da1 better flush limit for index collections
19 years ago
orbiter d468d665c9 some changes that may help to prevent deadlocks that cause an OutOfMemoryError
19 years ago
theli d54767f634 *) last step of removing embedded html from dir class
19 years ago
orbiter 279b1d969d Integrated new indexing data structure 'collections' into the main class
19 years ago
orbiter 4ff742e42d implemented indexCollectionRI
19 years ago
orbiter 01f95eccd3 re-write of kelondroCollectionIndex. This is the data structure that
19 years ago
orbiter ebc2233092 * implemented (finished) class indexRowSetContainer
19 years ago
orbiter 9183d21f25 renamed new index class to old name
19 years ago
orbiter c4e922885a replaced indexURLEntry by new class that uses a kelondroRow.Entry object
19 years ago
orbiter 0b7112f8b2 fix for missing topLevelClone in indexRAMCacheRI.wordContainerIterator
19 years ago
orbiter e357599f92 * fixed problem with indexContainer iteration from RAM:
19 years ago
theli 57fe5cc671 *) code cleanup
19 years ago
allo 4e9f02c8ec integration of Michaels string-extraction.
19 years ago
orbiter 8b77afd72c some fixes to new container merger
19 years ago
orbiter 830167596a bugfix for
19 years ago
theli 839806a775 *) serverPortForwardingUpnp.java: code cleanup, license header added
19 years ago
theli 03230cd887 *) removing old port forwarding classes
19 years ago
theli 6e676224d0 *) adding support for upnp
19 years ago
orbiter 417ed5102e redesign of database iterators:
19 years ago
theli 0db237467f *) bugfix for URL generation from file
19 years ago
orbiter ad692fc6c7 implemented option to extract nurls from the database
19 years ago
orbiter 7fd90ca7c8 * strict handling of NURL entry element generation, storage and stacking
19 years ago
orbiter 5f72be2a95 some redesign of EURL storage
19 years ago
orbiter 1ed3e2daef added option to extract domains and/or urls from the eurl database
19 years ago
orbiter 7e0a130fb5 new indexURLEntry class 'indexURLEntryNew', to replace old class
19 years ago
orbiter 58df8b7bbf a large collection of different changes
19 years ago
orbiter 493b1cd2bf better logging for domain extraction
19 years ago
orbiter e20ff77c10 another bugfix in new url class
19 years ago
orbiter 685430a1b5 bugfix in new URL class, better loggin for domain extraction
19 years ago
orbiter c57b78722b added some more logging to domain extraction
19 years ago
orbiter 79af283f6c better debugging in new URL class for wrong port numbers
19 years ago
orbiter cc2be7fb43 fix for genurllist in case of bad urls
19 years ago
allo 1b2ea58ee9 wrong substring invocation.
19 years ago
orbiter e4f1820b58 protection against too long authentication strings in switchboard
19 years ago
orbiter b3f7e62e03 better handling of whitespace
19 years ago
orbiter 4149939c02 better handling of whitespace for gettext quotation
19 years ago
orbiter 97fa6788a1 added gettext support:
19 years ago
theli b3c569f706 *) renaming of function getTransferedEntitySpeed to getTransferedEntrySpeed to avoid confusion
19 years ago
allo ff3f174a2d case insentive commandline options
19 years ago
orbiter 67edd80884 removed tabs
19 years ago
allo 67c486a023 some example Code, how supertemplates can be used.
19 years ago
orbiter 5214f571cd simplified method call in balancer
19 years ago
allo 7b0e2521bb Support for a supertemplate, which can do all thing, a normal template can do.
19 years ago
orbiter 4bd626572b added hashCode and compareTo to new URL class
19 years ago
orbiter abb5264929 fix for
19 years ago
allo ff39a7a0d1 Overlay for welcome.*
19 years ago
theli a70cbd959b *) further improvements for the anomic.net.url class
19 years ago
theli 8a1f1d96b3 *) Bugfix for url concatenation. Relative urls with / or http:// at the beginning
19 years ago
rramthun ca33eaa442 - Some spelling
19 years ago
allo 8795875800 dirlisting for all empty directories.
19 years ago
orbiter 7935f27038 enhanced synchronization in balancer
19 years ago
orbiter 3879a0ecd0 replaced java.net.URL usage by use of new class de.anomic.net.URL
19 years ago
orbiter 07900366ac deactivated cache-initialization for file-indexes (files in WORDS)
19 years ago
orbiter 40aa735520 fixe timing problem causing too long delay during initialization of kelondroTree objects
19 years ago
orbiter d2bb3f442e fixed timing problem causing a division by zero exception
19 years ago
allo 6acb6a4d8f tiny performance optimization
19 years ago
allo 2bdf1fc360 totalPPM
19 years ago
theli 24a02cbeef *) Bugfix for not parsable application/xhtml+xml resources if
19 years ago
orbiter b0ca5fa784 some correction algorithm for preload time computation during assortment open
19 years ago
orbiter e22cbaee97 - extended logging for preload
19 years ago
orbiter 671fd9a5c9 work towards new indexing database structure
19 years ago
orbiter 92f4cb4d73 added option to configure the start-up delay time for kelondro database files.
19 years ago
orbiter ce9dd3e76d some work in the index construction zone (no effect yet)
19 years ago
theli fe617d7e54 *) adding function to return the protocol type of a ssl connection
19 years ago
orbiter 018b3e0832 added pause option to server threads.
19 years ago
orbiter e1a52bea22 added a class stub for the new database structure:
19 years ago
orbiter 3b69b35bf2 added pre-load of node cache entries to kelondroRecords
19 years ago
orbiter 85d575e928 enhancements to kelondroRow and kelondroColumn
19 years ago
orbiter ab1ed053f5 another small correction
19 years ago
orbiter b92561fb67 removed unused code
19 years ago
orbiter eadbd56fc5 small adjustment to last commit
19 years ago
orbiter e9765ac4e6 introduced bulk read for node iterator in kelondroRecords
19 years ago
orbiter 6643da3fbd bugfix for http://www.yacy-forum.de/viewtopic.php?p=23463#23463
19 years ago
orbiter 866d53ed70 fix for DNS block bug
19 years ago
orbiter 6af70febef - added kelondroTree index option to kelondroFlexTable
19 years ago
orbiter dd2865178a major bugfix (searched a whole week for the bug) for
19 years ago
orbiter f9b9d085c4 just changed testing code
19 years ago
theli b594ee9a5a *) Adding possibility to configure if the http proxy should send the
19 years ago
orbiter ef84fc4956 added IOException to size() and row()
19 years ago
theli 7646849241 *) implementation of size() for mysql
19 years ago
orbiter 84dfd76a6a kelondroFlex bugfix
19 years ago
hydrox 53077f5835 *)fixed paths to yacy.logging
19 years ago
hydrox 8ba8e2b7d9 *) added cache for blacklists urlhashs recieved by DHT. DHT does not request URLs listed in this cache.
19 years ago
hermens 53cbcc6d6e Implement emergency break in index receive when the limit of the ramCache is exceeded by more than cacheLimit
19 years ago
orbiter e40987ecab removed default memory reservation for testing
19 years ago
orbiter 4cc6e6551f bugfix
19 years ago
orbiter 66964dc015 removed high/med/low from kelondroRecords cache control.
19 years ago
allo 6866bc2758 be quiet!
19 years ago
borg-0300 4c6083b264 network picture;
19 years ago
borg-0300 955915385a network picture;
19 years ago
borg-0300 027fa8ab1c network picture;
19 years ago
orbiter 41c4641612 added some profiling to kelondro caching classes
19 years ago
orbiter dd560e4b2f finetuning
19 years ago
orbiter a5661de880 added debug line
19 years ago
orbiter 5b1d77cd4b some enhancements to caching
19 years ago
hydrox ad03715b64 *) added fill and read functions with benchmark output every 10000 operations to dbtest.java
19 years ago
theli b20496e42b *) make DHT DoS check configurable (requested by KoH)
19 years ago
orbiter 650c7e9e55 some enhancements to caching
19 years ago
hermens d4645062bc Correct usage of vhost in wget/wput requests:
19 years ago
orbiter bde748f68f - integrated buffer in RowCollectionSet which speeds up the new
19 years ago
theli fa9712151a *) dbtest.java: bugfix for mysql test. data was not written correctly
19 years ago
theli f55d3d0d79 *) better error message if jdbc driver could not be loaded
19 years ago
theli 07aa779e6d *) dbtest: adding read and write methods for mysql
19 years ago
orbiter d083b15c4b tests/fixes
19 years ago
orbiter ce9a98ee25 experiments with buffer for collection class
19 years ago
orbiter 6aa0f6eb0f better abstraction, less synchronization
19 years ago
orbiter 1ec07fe351 better structure of the kelondro collection classes
19 years ago
allo c264cda678 support to parse gettext files and to generate updated files, where only the new strings are empty.
19 years ago
orbiter 761d3bba54 integrated kelondroRowCollection in kelondroCollectionIndex
19 years ago
orbiter 8f0c1a240a added kelondroRowCollection and kelondroRowSet which
19 years ago
theli ed2cb040d1 *) Bugfix for http connection header validation
19 years ago
allo f95c006dc2 generation of empty gettext files from yacy html-files
19 years ago
orbiter 4fa3271754 adopted memory calculation to new memory amount used by kelondroCollectionObjectMap
19 years ago
allo 0621106ef3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2214 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter 11951aed41 replaced node cache Object type in kelondroTree:
19 years ago
orbiter 12af69dd86 cosmetics
19 years ago
orbiter ea72a7c580 added new objectMap (can replace HashMap and should use less memory, but is slower)
19 years ago
allo 67a8c74be3 Fix for dynamic login with static password.
19 years ago
allo ef9eb50c3c fix for adminlogin
19 years ago
allo 6fe2fed87e cookieauth works with static Admin.
19 years ago
theli 45b39ee1be *) solving unpacking problems with to long filename by
19 years ago
theli fb090652df *) use a more compact for plasmaWordIndexAssortmentImporter.java because the long name
19 years ago
theli 4ca0857c0c *) Index transfer now considers the pause time send by busy peers during
19 years ago
orbiter e8848a3532 bugfixing for new kelondroFlexTable
19 years ago
allo b23703f260 using cookieAuth.
19 years ago
allo 7f51a43cba disabled ipAuth for _p Pages (and broken Form-Login :-() for security reasons
19 years ago
allo bd22634c44 HTML-login, logout fixed.
19 years ago
hermens 3f1ebc097e Limit the size of the DNS cache to 5000 and the age of the entries to one day.
19 years ago
allo d7a3fdb18b no white pages, when clicking cancel on the password-dialog
19 years ago
allo ec36174b7f Form-Login works now.
19 years ago
allo 11123416f3 Form-Login function.
19 years ago
allo bd13bd78ad Bugfix for broken Tags
19 years ago
orbiter 75ed507d39 some debugging of new kelondroFlexTable class
19 years ago
theli f01bd25489 *) Bugfix for OutOfMemory problem during minimizeUrlDB
19 years ago
orbiter 8a18302e84 some work on the intMap
19 years ago
orbiter 56084e9edc added a intMap, the new index management structure for kelondroFlexTables
19 years ago
orbiter e374add8cb added html tag 'area' to html parser
19 years ago
orbiter eda055e729 - enhanced kelondroCollection speed
19 years ago
orbiter 5d2cd26529 enhanced kelondroCollection performance
19 years ago
rramthun 5625937d1c Language improvements
19 years ago
orbiter 577a6e6487 some work on kelondroCollection, no effect on current YaCy functions
19 years ago
orbiter 2185a5cfb7 prevention of possible ConcurrentModificationException
19 years ago
auron_x 71228cfc56 *)added ip to Blog.xml
19 years ago
orbiter b30645305b some additions to kelondroCollection
19 years ago
orbiter 370c481fa7 bugfixes
19 years ago
orbiter 26b6cddf51 synchronized the DNS cache, because the non-synchronized version resulted in deadlocks
19 years ago
orbiter c36e9fc8d3 full integration of kelondroRow
19 years ago
orbiter 6e49721762 completed and tested kelondroFlexTable
19 years ago
orbiter b68f7dec9d added stub of new table class
19 years ago
orbiter b21824ef16 added new array interface
19 years ago
orbiter c75cacda95 added a flex-width-array: this is a table where it is
19 years ago
orbiter 4a907a570f 1st step to migrate kelondroTree to usage of kelondroRow instead of byte[][]
19 years ago
orbiter 572d53506c new kelondroRow objects now replace byte[][] objects in object cache
19 years ago
orbiter 09f780df27 more bugfixes for the new row/stack handling changes
19 years ago
orbiter 89424ff122 multiple bugfixes for new stack/row features
19 years ago
orbiter 3c3c047d0a integrated kelondroRow into kelondroStack
19 years ago
orbiter 5bb565944f integration of new kelondroRow into some parts of kelondro,
19 years ago
orbiter d580f582dc update to row/column handling
19 years ago
orbiter eaa6f012f0 refactoring: better naming for classic DB (files in WORDS)
19 years ago
orbiter 5041d330ce refactoring
19 years ago
orbiter 7b3b12888c refactoring: integrated indexContainer abstraction layer
19 years ago
orbiter cb295fbbdc refactoring
19 years ago
rramthun bc94a714b2 Better explanation for the auto-dom-filter.
19 years ago
orbiter 28ff7ec214 added missing file from last refactoring
19 years ago
orbiter 196b8abb30 refactoring
19 years ago
orbiter 24686e50a2 - fixed a caching bug
19 years ago
hermens b48327904a Don't disconnect peers that report 'busy' during index transfer.
19 years ago
orbiter 899c1a5df5 integrated cell-, and row-management classes
19 years ago
orbiter 4d8f8ba384 added cache-performance analysis for node caches
19 years ago
theli a520ab2e8c *) adding possibility to use an existing PKCS12 certificate for https
19 years ago
theli c5c5c166f0 *) fix for javadoc generation
19 years ago
orbiter 1b4a27cd99 added monitoring for new miss-cache
19 years ago
orbiter bd057b44dd - automatic setting of peer-does-not-accept-remote-crawl
19 years ago
orbiter 912116c5a7 renew cache update time if a cache-read hit happens
19 years ago
orbiter 81e79f2caf fixed new cache behaviour changes
19 years ago
orbiter 545f81b317 bugfix
19 years ago
orbiter cda087f43b - integrated cache miss storage into object cache
19 years ago
orbiter 757ec28430 refactoring: better data capsulation for indexURL
19 years ago
theli 61078b3885 *) adding support for delayed shutdown
19 years ago
theli 8b7626f8d1 *) Automatic redirection of browser if user changes port settings in ConfigBasic
19 years ago
auron_x e7199c6c7e *)fixed "Umlaute"-Bug in Blog
19 years ago
orbiter af098b815c - fix for blog/wiki error
19 years ago
orbiter 90d569d70f refactoring of index management:
19 years ago
orbiter a930be4ba3 refactoring of index management:
19 years ago
orbiter 634543121b added debug message
19 years ago
orbiter 74a78ebd78 turned back handling of map-writing into kelondro because of possible bug for testing
19 years ago
orbiter e656a00b74 removed some unused methods
19 years ago
auron_x 232ab7902b *)catched Null-Pointer-Exception
19 years ago
orbiter 82b2bc6932 patch for index-transfer DoS problem
19 years ago
hermens df7e1d9df3 Changes to plasmaURL and subclasses:
19 years ago
orbiter a474669338 start with refactoring of index management
19 years ago
orbiter 338047e056 replaced kelondroDyn write methods for properties and maps by faster version
19 years ago
orbiter b40f0edbe5 replaced property- and map-reader in AbstractRA by much faster version
19 years ago
orbiter 7f28a1a4cb another fix in kelondroDyn: construction of getDyn chunks was not clean
19 years ago
orbiter bb931c7b83 fix for some improper details in kelondroDyn
19 years ago
orbiter 19c6e67003 - added generation of news for blog entries
19 years ago
rramthun f08e33680c Added Blog-news-symbol as requested.
19 years ago
theli b4ab183518 *) Bugfix for NullpointerException if the seeds IP could not be resolved
19 years ago
theli f331def5d8 *) Bugfix for distribution. Incorrect behavior if peerCount == selectedCount
19 years ago
theli cea6e416d9 *) wrong name in header
19 years ago
theli df068cf23c *) adding first version of native SSL support for yacy
19 years ago
auron_x 55ea4cbfe6 *)reverted patch for memory-display issue
19 years ago
theli 5048b05bc6 *) Index Transfer should only restart at the beginning if the delete
19 years ago
auron_x 53d9ab6db7 *)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers
19 years ago
theli ddfe0f0e27 *) don't try to parse referer string if it's null
19 years ago
theli bcc950c533 *) Bugfix for Index Transfer
19 years ago
allo 99110e6fd2 Fixed some of the copyright headers.
19 years ago
allo a1ba7fab69 bugfix for proxy users
19 years ago
orbiter d4b4812732 extended kelondroDyn with new objectBuffer
19 years ago
auron_x 586b256627 *)fixed Blog-bug with german Umlaute
19 years ago
allo 9938c252dd better Errorhandling for proxyAccounts
19 years ago
orbiter 35995cf8c7 some enhancements to caching and kelondroRA-methods
19 years ago
orbiter 2e89477f22 undoing last change
19 years ago
orbiter a3a4525931 usage of a buffer to prevent too many cache lookups in kelondroMap
19 years ago
orbiter 015d044c25 tried to fix some problems with latest changes to httpc
19 years ago
orbiter 55c5b41bd0 modified kelondroDyn to work better with new object caches
19 years ago
orbiter 26e3216bcc update to profile fetch behavior
19 years ago
orbiter 3e31820c3d - corrections to PerformanceMemory display of object cache
19 years ago
orbiter fd7c17e624 added virtual host support:
19 years ago
orbiter 461548698c configuration of index transfer chunk size
19 years ago
orbiter 29b1b0823c added monitoring of new object cache to performanceMemory page
19 years ago
orbiter 23ced30e83 fixed a bug in new caching
19 years ago
low012 35f9418117 Fixed links and images. (http://www.yacy-forum.de/viewtopic.php?p=20908#20908)
19 years ago
orbiter bab9ee38e7 added very experimental object cache for all kelondroTree
19 years ago
theli 9104001e7c *) Better error handling for assortment import
19 years ago
low012 d40ccc5208 *) Partly undoing last commit\n*) Fixed bug that caused attributes of cells in tables not to be recognized as such.
19 years ago
low012 adcad5eae6 *) Fixed a bug that prevented the usage of tables in the wiki.
19 years ago
hermens 51e3bb576f Don't increase dhtTransferIndexCount when the last transferred index was smaller
19 years ago
low012 152745b145 *) Added some characters and their HTML-codes.
19 years ago
hermens a0ca4c5fb8 Remove a possible race condition between DHT transfer and deQueue
19 years ago
hermens 0cfba8950f Removing unnecessary and possibly dangerous synchronization of the wordIndex
19 years ago
orbiter fe4ad214f1 configuration of time-out for fetching seed-lists during bootstraping
19 years ago
allo 1179c9ffff fix for the bookmark error.
19 years ago
orbiter d6213f8a85 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19482#19482
19 years ago
orbiter e9aadb2e11 quickfix for http://www.yacy-forum.de/viewtopic.php?p=19765#19765
19 years ago
theli 727aac4768 *) Bugfix for Transparent-Proxy-Support <-> Port Forwarding problem
19 years ago
theli cd4aeffea2 *) Bugfix: httpdFileHandler.java did not handle filenames with encoded chars correctly
19 years ago
theli a10072b5c0 *) Adding timeout to ftpc.java
19 years ago
theli 76ea16a6cb *) Removing Keep-Alive header (is also a hopByHop header)
19 years ago
orbiter b0036249c1 added some attributes to network picture
19 years ago
hermens cbcf7418ef Cleanup synchronization in plasmaWordIndex
19 years ago
orbiter 60e5aff9fc some enhancements to the remote crawl trigger
19 years ago
orbiter dbe96e6541 added hand-over of search filter and prefer ranking to yacy protocol
19 years ago
hydrox 49f3b56526 *) URLCache in minizimeURLDB can be changed now (standart is 4mb)
19 years ago
rramthun 0604203bce Updated and corrected German language file
19 years ago
low012 4639c0ac6d *) cleaned up code
19 years ago
orbiter 00a5d435e2 - fixed some bugs with domain filter
19 years ago
orbiter 14d6e476c9 tried to solve some problems with new picture viewer
19 years ago
low012 23cdf319be *) cleaning up code
19 years ago
orbiter 9324425165 fix for remote crawl reject
19 years ago
borg-0300 30e4fc39a5 HTCache extended
19 years ago
orbiter d0dd8b14d2 fixed picture tag and presentation
19 years ago
borg-0300 da6a8bafa2 rename currCacheSize -> curCacheSize;
19 years ago
borg-0300 92110aea32 nullpointer fix for profile(); other minor change;
19 years ago
orbiter f0833b0328 introduced simple search interface
19 years ago
orbiter bd283b8443 fixed bugs:
19 years ago
orbiter 47b541b2d1 added better option handling in yacysearch
19 years ago
orbiter c9e16bfd48 first try to insert image search (does not work yet)
19 years ago
orbiter f77775220b fixed parser error
19 years ago
auron_x 0bf2eb4813 *) fixed Blog updating timestamp on edit (now always keeps creation-date)
19 years ago
orbiter 22de954a57 added some log output to parser
19 years ago
orbiter 83e0e765ec redesigned some parts of the html scanner & parser
19 years ago
orbiter ac114d69c0 tried to fix some problems with time-outs during search
19 years ago
orbiter e2e8d0c188 some kind of refactoring of yacysearch:
19 years ago
orbiter 6b63e26cbb - removed search function from index.html/java, only imput left
19 years ago
orbiter bc3e80fe42 quickfix
19 years ago
orbiter d8d0ac29c3 added image-viewer servlet that can do:
19 years ago
orbiter ddc6394d9b fixed bug about auto-depth 0
19 years ago
orbiter 60351fa3f7 small fix to previous commit
19 years ago
orbiter a469874e3f added and fixed time-out behaviour during search
19 years ago
orbiter 1d0b0d6e2a synchronized local searched to prevent that several searches are performed at the same time
19 years ago
hermens 22b9d03bbf Correcting remaining time issue in getContainers
19 years ago
orbiter 5defe97ccb fixed a problem / possible bug with ordering implementation (did not rotate always)
19 years ago
orbiter d58788b753 added some synchronisation
19 years ago
orbiter e566d1d8d6 some bugfixes regarding new crawling options
19 years ago
orbiter c7f1300300 -fixes for last commit
19 years ago
orbiter f2421f6a47 some small attribut changes regarding cache flush
19 years ago
orbiter 7a650d0023 several bugfixes
19 years ago
borg-0300 245cc34d51 small fix for last commit
19 years ago
borg-0300 e2853f357d added more lowercase to url normal form generation
19 years ago
orbiter 59d52fb4a9 fixed some problems with crawl profiles
19 years ago
orbiter 4a5b5515b5 added a lowercase to url normal form generation
19 years ago
allo 44d72f06c4 more Caching
19 years ago
allo 918445a2f4 Bugfix for last commit.
19 years ago
orbiter 0c9b61820e enhanced re-crawl settings
19 years ago
orbiter 708cc6c8d9 fixed some bugs for auto-filter and added monitor in profile list
19 years ago
allo c58789177f bookmarkCache
19 years ago
rramthun 250864406f ...
19 years ago
rramthun 42b0b10a95 -Adding Windows Media to types which are not sended compressed
19 years ago
allo 2ed4fa96b7 tagCache
19 years ago
allo 330eb9c74f bookmarkDB cleanup
19 years ago
orbiter e82899ba57 fixed missing urls map initializer
19 years ago
orbiter 63f39ac7b5 added 3 new crawling steering options:
19 years ago
orbiter 1fc3b34be6 some pre-work (without function yet) to implement:
19 years ago
theli c9e6b5e391 *) check size of indexing-queue and crawler pool before processing remote triggered crawl jobs
19 years ago
orbiter 1509314ea6 set tighter control during DHT index and peer selection
19 years ago
hydrox fcc0683200 *) undoing last commit
19 years ago
hydrox 9411961eec *) another little fix for DHT-Transfer
19 years ago
borg-0300 77f3237de3 adapted for isListed()
19 years ago
hydrox 8b14a0c833 *) little fix for DHT-Transfer
19 years ago
orbiter 1f4412a146 adopted isListed to discussed new behavior as discussed (url, getFile)
19 years ago
orbiter 59fc55ea1e added checks to protect peers from wrong seeds
19 years ago
orbiter 063ef4660a bug?
19 years ago
orbiter 82358677a9 added another shiftK2W to flushCacheSome
19 years ago
orbiter 128e4ab199 - in serverSystem: maxPathLength is now a variable, not a method
19 years ago
orbiter a37b09e303 implemented automatic adoption of chunk-read-ahead in kelondroTree to needed chunk size
19 years ago
orbiter 30e3e3a0fd adopted MAXPATHLENGTH to host system capabilities
19 years ago
borg-0300 d808765087 something Javadoc
19 years ago
borg-0300 85bb8e32a1 Bugfix for last commit
19 years ago
borg-0300 3fe402069f try to fix
19 years ago
orbiter f16f1f15cd bugfix for 100% CPU bug; thanks to Matthias for analysis
19 years ago
borg-0300 254a13efd9 MAXPATHLENGTH used
19 years ago
borg-0300 8865948e4e Cleanup;
19 years ago
rramthun 9c85820d35 added MIME-type for wmv and rm
19 years ago
orbiter 6c70f4a0cf renamed wordHashes for a word hash set generation to wordHashSet
19 years ago
orbiter d5f8f40c31 removed correcting iterator
19 years ago
orbiter 526407f32e adoptions, fixes for last commit
19 years ago
orbiter 488a0ed580 replaced old keyIterator and rowIterator by buffered iterators
19 years ago
hermens 4e9a8f41fd rwiDBCleaner + dbImporter: Iterate over small excerpts of
19 years ago
hermens 474379ae63 remove TABs from plasmaDbImporter.java
19 years ago
allo 2b31f51896 bugfix for last commit
19 years ago
orbiter dba02f399f starting of re-design of kelondroTree iterator
19 years ago
allo d2f34a2e94 skin in DATA/HTDOCS (works after upgrade, works when only DATA is writable).
19 years ago
orbiter f02b426073 made kelondroTree.nodeIterator private
19 years ago
borg-0300 5f6fdf1786 Bugfix for getCachePath(URL url)
19 years ago
orbiter 303b6463a8 added debug line to URL storage for testing
19 years ago
orbiter 431a4f3609 eliminated correcting iterator in kelondroTree
19 years ago
orbiter 91dca2cd8d fixed a bug in last commit: LURL entries cannot be written,
19 years ago
orbiter 3286b1f498 re-organisation of lurl-creation and -stacking
19 years ago
orbiter 9cca36a107 no more strict comparator checking in map exclude method if not needed
19 years ago
orbiter 0b903c5317 removed usage of kelondroNaturalOrder from plasmaCondenser to experimental
19 years ago
orbiter 4239db0d1c fixed new ordering for backup iterator TreeSet
19 years ago
borg-0300 399538b7de Bugfix: wrongly compared
19 years ago
orbiter 33eba5ecb8 temporary disabling last change, does not work (cannot debug right now)
19 years ago
orbiter f0464042fc fix for latest iterator-replacement-fix:
19 years ago
borg-0300 ec21c585cb try to fix path too long
19 years ago
orbiter a6a3f4b694 fix for svn 1888
19 years ago
hydrox 8da13088e9 *)removed multiple DHT_Distribution_Threads
19 years ago
orbiter 283a7181c6 try to fix new 100% cpu bug, possibly caused by iterator method
19 years ago
theli 34c075c1c7 testcommit with subversive
19 years ago
orbiter f588c0724f removed cache flush in case of DHT receive
19 years ago
orbiter e94b374d56 update to cache flush method
19 years ago
rramthun 9f979d4fa5 Domain-lists gzip-compressable and sendable via cr-send/receive
19 years ago
orbiter bcd99fe83e introduced a second RAM cache for DHT transfer
19 years ago
hydrox 360a460da8 *)URL-Cleaner: moved logging-statement to correct position
19 years ago
orbiter 02f9765013 quickfix for time problem during cache restore
19 years ago
orbiter 69d26045eb quick-fix for http://www.yacy-forum.de/viewtopic.php?p=18805#18805
19 years ago
allo b3df5ce2b8 another local iprange
19 years ago
hermens ad119f06af *) Don't overwrite new entries with older ones
19 years ago
orbiter be88687d8c fixed some problems with new cache flush karenz
19 years ago
theli d3da7c9a08 *) Adding support for robots Allow directive
19 years ago
theli 734d18f283 *) more correct robots.txt validation
19 years ago
hydrox f046e1814a *fix or last commit
19 years ago
hydrox c55c51e2a8 *)added keywords to IndexCleaner_p.java
19 years ago
theli f0ad0d2b2b *) better robots.txt support
19 years ago
orbiter ddbeda738e added minimum age of word in cache to performance menu
19 years ago
orbiter f188611fc6 apply blacklist on rwis during dht receive
19 years ago
theli 915812f597 *) Undoing robots parser policy changes from svn rev. 1421
19 years ago
orbiter 0ec28b8f8e added DBCleaner from Hydrox
19 years ago
theli 5ee0125046 *) adding possibility to configure the server port for seed uploading via scp.
19 years ago
allo 2065138a41 reverted last Commit.
19 years ago
allo 7afa5c1b8e staticIP fix
19 years ago
allo f6452879d5 prevent nullpointer
19 years ago
theli fb4100d47b *) undoing last commit.
19 years ago
theli a84cc71218 *) removing getTotalRuntime
19 years ago
low012 1965a8cf70 *) bugfix for previous commit
19 years ago
low012 1c3b415c35 *) nicer anchors (TOC)
19 years ago
low012 6000a38a05 *) changed anchors (TOC) according to thelis request in http://www.yacy-forum.de/viewtopic.php?t=1987
19 years ago
auron_x dce08771d1 *) Fix for wrong estimated and elapsed times when import was paused
19 years ago
hermens b34713324a DBImport: remove words from source index even if nothing has been added to home index
19 years ago
orbiter 3237fe1cc7 added IOException for httpc client error
19 years ago
orbiter 520b60f15b fix for http://www.yacy-forum.de/viewtopic.php?p=18610#18610
19 years ago
theli c7ececbfb2 *) httpd.mime: adding jar mimetype
19 years ago
orbiter ae536c4608 fixed soap service: index.soap -> yacysearch.soap
19 years ago
allo a8fa9990aa default skins support
19 years ago
orbiter bae3783d38 added a snippet marking
19 years ago
orbiter f0a38873eb * added yacysearch page with better view on search results
19 years ago
orbiter 3173b5c9b3 fixed port parsing during shutdown for extended port format
19 years ago
orbiter f0041d504d remove of several results from a single domain is stopped if the result set is smaller than the wanted number of results
19 years ago
auron_x b92a00172e *) modified Blog
19 years ago
allo 68ec572df0 bugfix for staticIP
19 years ago
theli 89286478e7 *) removing thread pool eviction for now. Not needed at the moment
19 years ago
theli 759800f543 *) Bugfix for storeHTCache problem
19 years ago
orbiter a4682e2810 fixed problems in basic config and added language setting
19 years ago
orbiter a8548c0484 * several bugfixes regarding basic configuration
19 years ago
orbiter 1b9b8922d9 * fixed problems with new basic 1-2-3 configuration (now authentication required)
19 years ago
auron_x 8c6f38fe70 *) added Blog to YaCy (atm not reachable through interface) -> Blog.html
19 years ago
orbiter c51603a405 added two new kelondro classes that will handle the new index data structures (not used yet)
19 years ago
orbiter ce5274c194 yacybot user agent
19 years ago
allo 3b7e66ab48 staticIP should now work
19 years ago
theli 8558000bd9 *) better handling of port forwarding
19 years ago