Commit Graph

2450 Commits (87afdfc2a789a73b50072ecde4b22b9f0bf575ec)

Author SHA1 Message Date
theli 81b4598487 *) peer profile can now be displayed as vcard
18 years ago
orbiter 3688ec33e5 release 0.51
18 years ago
theli 1f61c13697 *) RSS-parser extracts the author tags now
18 years ago
orbiter 602ac42010 fix for OOM case when a kelondroTree Node cache grows
18 years ago
theli b374812f01 *) adding rpm packager as author
18 years ago
orbiter beb772d6cd fixed problem with broken notifier image, occurred only at initial start-up
18 years ago
theli 40ce33e664 *) adding RSS feed for yacy news
18 years ago
theli 589cbd8cbf *) replacing all yacy-news-category strings with corresponding constants
18 years ago
allo f4af360f7c bugfix
18 years ago
orbiter 7af188ff9a fix for http://www.yacy-forum.de/viewtopic.php?p=33089#33089
18 years ago
orbiter 5bbf010107 removed synchronization of size() method from numerous classes to avoid thread locking
18 years ago
orbiter 6b9eea3932 - removed differentiation between longTitle and shortTitle; this cannot be used for search results,
18 years ago
orbiter a738b57b31 added author tag to indexing content
18 years ago
orbiter 6be57983a8 another update to the crawl balancer
18 years ago
orbiter 91cdc1493f removed query to NAT or responder in case that no other peer is there.
18 years ago
orbiter 4783a30910 - fixed a flush problem in balancer
18 years ago
theli 91c2a042a7 *) bugfix for wrong proxy traffic accounting
18 years ago
orbiter 861f41e67e redesigned NURL-handling:
18 years ago
hydrox 9b5fb3908d *) a peer-message are now created when a blog-comment is written
18 years ago
orbiter 581db87237 more debug code for
18 years ago
orbiter 81c4cc6bf7 better debugging of balancer failure
18 years ago
orbiter dd06d4cada more logging to better trace bug
18 years ago
orbiter 96b79bf86d redesigned remove method in kelondroRowSet
18 years ago
orbiter 9f929b5438 better snippet handling in case of snippet load fail
18 years ago
auron_x d451ad48d3 *) improved peerloadgraphic:
18 years ago
orbiter a5d668c0c6 added speed-buttons for easy performance setting
18 years ago
orbiter 5b0a84ce09 fix for synchronization deadlock with flushMissNameCache.
18 years ago
karlchenofhell e2ac5f62bd - Code hübscher machen [von NNs TODO]
18 years ago
allo f04097c3dd integrated tor-patch for crawling, if yacyDebugMode is set.
18 years ago
auron_x 22fe14f292 *) first version of Peerload-graphic
18 years ago
orbiter 432d7d4e9c better catch
18 years ago
orbiter 8f7e8b6ee2 auto-delete for not-fixable db error in crawl stacker.
18 years ago
orbiter 7a52b07fcc better memory protection during freemen cycle
18 years ago
orbiter 6faa262259 fix for NURL-fix
18 years ago
orbiter 909d7a8ae9 fixed wrong implemented row iterator in kelomdroFlexSplitTables
18 years ago
orbiter a1fb8358b2 lets make a well-formed http link so that other crawlers don't have a problem to follow this link :-)
18 years ago
orbiter 4edb70f68b added yacybot info-page from Roland
18 years ago
orbiter 3ef77d2030 fix for http://www.yacy-forum.de/viewtopic.php?p=29878#29878
18 years ago
orbiter 3bb3df3fc0 fix for http://www.yacy-forum.de/viewtopic.php?p=32298#32298
18 years ago
orbiter 243a2f831b fixed problem with not found NURL-hashes
18 years ago
orbiter 6ad39bae1e fixed shutdown problem
18 years ago
orbiter 38b93f8cb8 bugfix for my last commit:
18 years ago
karlchenofhell 264a82eec8 - fix for http://www.yacy-forum.de/viewtopic.php?t=3657
18 years ago
orbiter d755a8026d - better OOM protection
18 years ago
orbiter 23338d2070 small fix for RAM computation
18 years ago
orbiter 33f97cff7a changed startup initialization sequence slightly
18 years ago
orbiter 4e8eb1dbe3 some minor changes here and there
18 years ago
karlchenofhell 03c5906ae7 - minor bugfixes for url-fetcher & http://www.yacy-forum.de/viewtopic.php?t=3646
18 years ago
orbiter 3499a364ef a little bit better memory protection
18 years ago
orbiter 313f6a7680 fix for http://www.yacy-forum.de/viewtopic.php?p=31553#31553
18 years ago
orbiter 958ebea5c5 fix for http://www.yacy-forum.de/viewtopic.php?p=32470#32470
18 years ago
orbiter 5d5e6ebfcc fix for http://www.yacy-forum.de/viewtopic.php?p=32631#32631
18 years ago
orbiter 1cba31de43 redesigned ram organization for database caches
18 years ago
theli 26450a1d9a *) avoid nullpointerException on seed.getAddress() (reported by netbude)
18 years ago
orbiter db235f2d61 added some memory protection in collection index multiple merge
18 years ago
theli c72605ecab *) adding a function to determine if a given URL is bookmarkt
18 years ago
theli bd03c6b874 *) bugfix in bookmarksDB:
18 years ago
orbiter b466baa574 added some memory protection
18 years ago
low012 ce360ef43e *) no more HTML in plasmaCrawlProfile.java anymore
18 years ago
karlchenofhell 88245e44d8 - improved version of robots.txt (delete your old htroot/robots.txt before updating):
18 years ago
karlchenofhell 9623bf7bbe - removed call of java 1.5 method
18 years ago
orbiter 51e12049fa third generation of R/W head path optimization
18 years ago
karlchenofhell a1d68fe092 - use .class rather than Class.forName for classes in class-path
18 years ago
orbiter 10a3c20b8d some more enhancements to R/W Head path optimization
18 years ago
orbiter f4cfd19835 second Generation of collection R/W head path optimization:
18 years ago
orbiter 1fda50fd3c correct R/W head positioning in kelondroFlex
18 years ago
orbiter 304412a049 first generation of collection index R/W head path optimization
18 years ago
hydrox 54fef3574f *) missing files for last commit
18 years ago
hydrox cb89c74d52 *) added blog-comments
18 years ago
karlchenofhell 6fbe31425a - some code-cleanup (no more syntax-warnings here)
18 years ago
orbiter 32867580ee update to kelondroRecords needed fo last commit
18 years ago
orbiter e3480d4ad3 fix for warning in crawl balancer
18 years ago
orbiter 8668ac5d91 preparations for collection index cache flush optimization
18 years ago
karlchenofhell 39a2000d8b - added support for [[Bookmark:$bookmarkTag|description]]-link-listings (requested by theli) to wiki-parser
18 years ago
karlchenofhell 619653c054 - fix for last commit
18 years ago
karlchenofhell 26f5757b40 - added support for multiple paths per domain to default-blacklist
18 years ago
karlchenofhell a5a36d9252 - hopefully last fix fo 1.5 methods (sorry for that, eclipse isn't that helpful in identifying those methods)
18 years ago
karlchenofhell e97b6f0458 - we still use Java 1.4 ...
18 years ago
karlchenofhell 0c7b8cf632 - added first version of new wiki-parser
18 years ago
orbiter f7803a6ce4 enhanced crawl balancer
18 years ago
low012 801eea8849 *) Fixed bug where pairReplace() got caught in infinite recursion. (http://www.yacy-forum.de/viewtopic.php?t=3466)
18 years ago
orbiter c3e8c23f5d fix for 'CANNOT FETCH ENTRY: hash is null' bug
18 years ago
orbiter badab8d924 fixed some more bugs in new db handling
18 years ago
orbiter e72d253577 fixed problem with initial cache load
18 years ago
orbiter 2d8e472cfd emergeny bugfix for last commit
18 years ago
orbiter dc0c06e43d PLEASE MAKE A BACK-UP OF YOUR COMPLETE DATA DIRECTORY BEFORE USING THIS
18 years ago
karlchenofhell c016fcb10f - added streaming-support to CrawlURLFetchStack_p servlet
18 years ago
karlchenofhell d114a0136e - crawl profile: don't add null-values
18 years ago
karlchenofhell b2a9d32f29 why do I always forget some lines? sorry...
18 years ago
theli e1edb23689 *) Bugfix for IllegalMonitorStateException
18 years ago
orbiter bf69a721cb more protection against mis-use of YaCyHop interface:
18 years ago
orbiter a15963ff98 better balancing: if element from top would force a busy waiting,
18 years ago
orbiter dda24fcb85 ups
18 years ago
orbiter 8c1d2e0227 protection against crawl balancer failure:
18 years ago
orbiter 1f1f398bfa enhanced speed of RAM cache flush by factor 20 (twenty times faster)
18 years ago
orbiter 30d79d69a6 fix for wrong display of search statistics
18 years ago
orbiter daf2e15f59 some storage process enhancements (write without preceding read)
18 years ago
orbiter 9c2101a852 small enhancement to cache dump
18 years ago
orbiter c464157a6e replaced some toString()
18 years ago
orbiter 7673f0869b minor enhancements
18 years ago
orbiter b4aa195c27 added user-agent check for yacy-hop proxy authentication
18 years ago
orbiter 2d7f7da7ce fix for null pointer exception
18 years ago
orbiter d25caa07bf redesigned some parts of http authentication
18 years ago
hydrox 9184113284 *) fixed News deletion. News are now removed if they are no longer in a news-stack. This does not effect News-entires in the news-db that have no stack-entries.
18 years ago
(no author) e218940293 The copyright sign "\u00A9" is already replaced by "©". String "(C)" is not a unicode sequence!
18 years ago
low012 1bc4d8d470 *) If there is more than one pair of patterns in a line, all of them (and not only one pair) will be replaced.
18 years ago
low012 ea7a8cf7aa *) <hr> and <br> tags are XHTML compliant now.
18 years ago
orbiter d03cd41266 fix for http://www.yacy-forum.de/viewtopic.php?t=3411
18 years ago
karlchenofhell f2e6f19b90 - added versioning to Wiki
18 years ago
orbiter 10ebcb5e1e fixed bug in disconnection time
18 years ago
karlchenofhell 02a73dce87 - added Diff-class for wiki-versioning (forthcoming, first need suitable serverObjects.put() for it)
18 years ago
karlchenofhell 2401e748a3 - fixed wrong replacement of POST-parameters in httpd ('<' and '>' are still replaced, don't know why): http://www.yacy-forum.de/viewtopic.php?t=3466
18 years ago
orbiter b2f4087400 redesign of last-seen fieln inside seed:
18 years ago
karlchenofhell e68cdeeeb3 - reverted parseArg(String) to use a byte-array to handle correct UTF-8 parsing
18 years ago
orbiter e00e850a98 removed constants (no connection with yacySeed.dna identifier)
18 years ago
orbiter fcc11391a8 some redesign attempts because sorting of lastseen does not work correctly
18 years ago
orbiter c2d6edf21d integrated number of remote targets as 'partitions' into remote search protocol
18 years ago
orbiter f696d3c1eb added double computation to kelondroMapObjects
18 years ago
orbiter 819ff21c92 fixed QPM output
18 years ago
auron_x 89e7af037a *) used more switchboard-vars instead of config-vars
18 years ago
orbiter 306c50ac40 QPM (queries per minute) statistic stub
18 years ago
orbiter 7598e1243e removed unused variables/imports
18 years ago
hydrox 27e4429645 *) fixed minimizeurldb-function
18 years ago
orbiter 47ab83a7c0 added flag for YaCyHop - proxy access for all paths that start with /yacy/
18 years ago
karlchenofhell 9f74b128dd - added many more commented constants (please use constants rather than i.e. config-setting strings directly)
18 years ago
orbiter e4910f03d1 tag storage fix
18 years ago
orbiter 991182b29b more space for bookmarks
18 years ago
orbiter 88fa764b64 implemented new kelondroObjects into bookmarkDB
18 years ago
orbiter 9c05e2a820 re-design ob kelondroMap
18 years ago
allo 669c21db05 first version of abstracted kelondroMap Cache.
18 years ago
allo 98cb777e18 abstract wikiCode in putWiki
18 years ago
orbiter f25c0e98d1 - replaced String by StringBuffer in condenser
18 years ago
allo 14f2068daf some more bookmark changes towards multiuser bookmarks
18 years ago
allo 25c7d4e25e fix for form (cookie) login
18 years ago
allo ff79c52fc0 bookmark users can now edit bookmarks.
18 years ago
theli 49972b6193 *) SOAP: getPeerHash returns the proper value now
18 years ago
karlchenofhell 15f0334cd3 - fixed IllegalThreadStateException in LogParser
18 years ago
allo f40169fcd7 preparing multiuser bookmarks
18 years ago
hydrox 814a09a0ed *) reversed r3250 and parts of r3252 (nanotime() is an java1.5 function)
18 years ago
karlchenofhell d311e258f8 - adjusted LogStatistics to nano-seconds
18 years ago
hydrox f7623f5d24 *) added missing measuring points for Parser-Runtime
18 years ago
orbiter f3f99b19c6 extended search statistics
18 years ago
orbiter c0851ee943 refactoring: moved and renamed de.anomic.data.searchResults to plasma package
18 years ago
allo c39dda2374 finished refactoring of searchtemplates.
18 years ago
allo 35039982da refactoring of search process: store results in a searchResults structure. At the moment, its just stored in it, and read from it again.
18 years ago
orbiter 76fab83395 fixed bugs in seach statistics
18 years ago
karlchenofhell 139810d504 - truncate attributes of new newsRecords if too long
18 years ago
karlchenofhell 3c43e605ba - don't accept malformed bookmarks, fix for: http://www.yacy-forum.de/viewtopic.php?t=3414 (first report)
18 years ago
orbiter d07b132a0d - fixed colors of network grafic
18 years ago
karlchenofhell 5d540b219e - LogalizerHandler skips interfaces again
18 years ago
allo e1fb3550ab fix for profile
18 years ago
hydrox 6faf9b70b7 *) LogParserPLASMA now counts its total runtime.
18 years ago
hydrox e5f854bc37 *) added LogalizerHandler-settings to yacy.logging.
18 years ago
karlchenofhell 7c40197e42 - fixed error pages and <label>s for index.html
18 years ago
allo 29aa7031d3 workaround for the snippets
18 years ago
allo b4457763e5 fix for putSafeXML and supertemplates.
18 years ago
karlchenofhell 77b73aa7a8 - log-entries 'Indexed' are parsed correctly now
18 years ago
karlchenofhell aea199cb7b - IndexTransfer is working again
18 years ago
karlchenofhell 71112b1fe6 - added LogStatistics_p.html servlet based on the logalizer (indexing values not functional yet due to charset/regex problems)
18 years ago
allo 0c81bd39d4 XSS-safe put as default.
18 years ago
karlchenofhell bdda9e802f - added some commented string constants to ease use of the result-table
18 years ago
orbiter 5515571950 redesign of ymage classes
18 years ago
orbiter 52c6461e6b some bugfix for statistics
18 years ago
(no author) fe72b772cf added a monitor page for search requests
18 years ago
karlchenofhell b3a2c79fec - fix for last fix
18 years ago
karlchenofhell 4b23e79f51 - quick-fix for http://www.yacy-forum.de/viewtopic.php?t=3358
18 years ago
karlchenofhell 4dce5ec261 - if mem is too low but former GCs helped, the word-cache limit is only decreased now, if a subsequent GC doesn't
18 years ago
hydrox c27e88104c *) getResults() should now work and compile properly with Java 1.4
18 years ago
hydrox a2fb54afff *) Quickfix for http://www.yacy-forum.de/viewtopic.php?p=29973#29973 getResults() used a java 1.5 function (Output is temporally disabled until a sulution with 1.4 functions is implemented)
18 years ago
karlchenofhell b873ad51ab - fix for http://www.yacy-forum.de/viewtopic.php?t=3369
18 years ago
auron_x 7fb30de8a4 *) made combined2prettyversion less restrictive and made it again easier to read
18 years ago
hydrox 3acd90033c *) added functions to get results from log-parsers (not documented yet)
18 years ago
borg-0300 1aa74bbd2b update for last commit
18 years ago
borg-0300 23e613b2ab CPU & IO reduce (Index Distribution)
18 years ago
(no author) c67d22116e added exists-check based only on RAM index lookup:
18 years ago
(no author) 37e53b4a6a replaced tree database structure for seed db by flex data structure
18 years ago
karlchenofhell 340dc52a9d - ConfigProfile_p.html now transmits usable encoding for other than 7-bit ASCII charset, see TODO in httpd.parseArg(String)
18 years ago
karlchenofhell 35fb671721 - updated DetailedSearch and ViewFile
18 years ago
karlchenofhell 00aa9472d6 - added decode of HTML-entities in request lines
18 years ago
theli d157201e08 *) IfesL for "Unexpected end of ZLIB" error message
18 years ago
karlchenofhell 0336480a3e - the maxMemory-fix for the Sun JVM 1.4.2 wrongly also applied to 1.6, thx to NN
18 years ago
borg-0300 735c1f87b1 restart re-activated (windows)
18 years ago
hydrox 2c01508ada *) fix for http://www.yacy-forum.de/viewtopic.php?p=29575#29575
18 years ago
allo 6ff8359b98 possibility to use anonther bindPort than the externally reachable port.
18 years ago
borg-0300 d2be3c674d wrong cache values fixed
18 years ago
karlchenofhell df6281ba1f - removed JS from DetailedSearch => valid
18 years ago
hydrox fb1d8b91af *) changed Startpoints of IndexCleaner and IndexTransfer from ------------ to AAAAAAAAAAAA.
18 years ago
karlchenofhell d6eb699e8e - fix for last commit (didn't know that the paragraph sign has an UTF-8-specific location)
18 years ago
karlchenofhell 41bc31d2c2 - ConfigAdvanced_p => XHTML (no invalid IDs)
18 years ago
orbiter 9b726ac366 release 0.50
18 years ago
orbiter 036a0c828e fix for auto-configuration of crawler thread memory
18 years ago
orbiter 16f88c49d9 applied patch from http://www.yacy-forum.de/viewtopic.php?p=27392#27392
18 years ago
orbiter 2aa6f978c2 fix for http://www.yacy-forum.de/viewtopic.php?p=29125#29125
18 years ago
orbiter a4e90bc1dc fix + debug-code for http://www.yacy-forum.de/viewtopic.php?p=29126#29126
18 years ago
borg-0300 6b5f28b746 answer for last commit: no
18 years ago
borg-0300 d98ba7bc33 fix for memory limit computation ?
18 years ago
orbiter 49ffedfd8b patch from Fuchs against deadlock,
18 years ago
borg-0300 a4f63d187d better map2string and NullPointer fix
18 years ago
orbiter c48374d14a new memory limit computation for indexing queue
18 years ago
theli a9f1d3a065 *) SOAP: adding function to get the local peer hash
18 years ago
borg-0300 9659c004c3 fix for wrong date (Lotus-1 Peer)
18 years ago
orbiter 08ac4c5ed0 bugfix for http://www.yacy-forum.de/viewtopic.php?p=29045#29045
18 years ago
orbiter 8e3bd17554 adopted DetailedSearch page to new ranking options
18 years ago
orbiter 93a7e88245 more ranking parameter usage
18 years ago
orbiter 2dbea612c9 fixed display bug for image search preview
18 years ago
orbiter 0a050bc043 enhanced ranking
18 years ago
orbiter d0c32c6aeb better protection against fraud peers
18 years ago
orbiter 61798f0ae6 added option to distinguish between text crawl and media crawl
18 years ago
karlchenofhell be941c4475 - "javascript:"-URLs are recognized as well (as intended formerly I assume)
18 years ago
karlchenofhell a619ba3f49 - fix for String index out of range during URL parsing
18 years ago
orbiter febe6b114a design update of crawler monitor
18 years ago
orbiter 40049e0635 fixed media search snippet flow
18 years ago
karlchenofhell 5763d20795 - added DATA/yacy.running file to indicate whether YaCy is running or not. Helpful for i.e. the updater and linux init-scripts
18 years ago
borg-0300 05d0464377 only do 16 checks if "address" starts with "172.";
18 years ago
rramthun 1a525710c1 *) cursor jumps now to searchbox on searchpages again
18 years ago
karlchenofhell e17591acc3 - parse HTML arguments as UTF-8 strings
18 years ago
karlchenofhell d30932c7d8 - fix for fix... sry
18 years ago
karlchenofhell 6118fb73ec - added decode of UTF-16 escapes in url-arguments (%u0123), bugfix for http://www.yacy-forum.de/viewtopic.php?t=2762
18 years ago
allo 782db9099d version independent name for commons-pool lib
18 years ago
orbiter 7ff86d6ba6 - image search now shows thumbnails (in bad order, but it works)
18 years ago
orbiter ee3d91cb6b print-out of links that result from contraint-filtering
18 years ago
borg-0300 f4737eebd6 Properties
18 years ago
borg-0300 1fc75c0f67 better logging
18 years ago
orbiter e4570bffaf -implemented a specialized snippet-fetch for media content
18 years ago
low012 694a6e4f44 *) better text snipptes: any possible searchword (welt, linux, tag) in welt-linux-tag will be marked correctly now
18 years ago
orbiter bddc197453 reverted by-mistake removed change from low012/SVN 3068
18 years ago
orbiter 1377c53aa3 extraction of media links from search results
18 years ago
low012 586add4c6c *) Better snippets: words like GNU/Linux will not prevent Linux or GNU from being marked if they are searchword (see http://www.yacy-forum.de/viewtopic.php?t=2891)
18 years ago
borg-0300 29922d5dd2 changed writeMap
18 years ago
borg-0300 5b00a04359 changed writeMap
18 years ago
karlchenofhell 52abbd4131 - fix for wrong public IP if no hostname was set and IP was from range 192.168.*.*
18 years ago
borg-0300 8b7c543885 NullPointer fix
18 years ago
orbiter 937ccd4e76 fix for snippet-generation
18 years ago
orbiter 559f41a001 fix for http://www.yacy-forum.de/viewtopic.php?p=28607#28607
18 years ago
auron_x c086c71f17 *) fixed ArrayIndexOutOfBoundsException
18 years ago
orbiter c93cfdc23a fix for http://www.yacy-forum.de/viewtopic.php?p=28564#28564
18 years ago
orbiter 93a5ace330 fix for http://www.yacy-forum.de/viewtopic.php?p=28544#28544
18 years ago
orbiter bf0d820659 - added correct flagging of word properties
18 years ago
orbiter 10d888e70c - added a media search for images, audio, video and applications
18 years ago
orbiter a603c4d5e8 more code simplifications
18 years ago
orbiter 9a85f5abc3 cleanup
18 years ago
borg-0300 fbe1ee402b plasmaCrawlLURL$kiter cleanup
18 years ago
orbiter 773ba1e91a - generalized object order handling
18 years ago
borg-0300 15381cbf73 other bugfix
18 years ago
borg-0300 ad65cc9d2f NullPointer fixes
18 years ago
borg-0300 d33745a7ea NullPointer
18 years ago
orbiter 3a4933b63c bugfix for
18 years ago
orbiter 109ed0a0bb - cleaned up code; removed methods to write the old data structures
18 years ago
orbiter 052f28312a removed assortments from indexing data structures
18 years ago
orbiter 2372b4fe0c release 0.49
18 years ago