boxtec
/
yacy_search_server
mirror of https://github.com/yacy/yacy_search_server
4
1
Fork 0
Code Issues Projects Releases Wiki Activity
4082 Commits
1 Branch
20 Tags
1023 MiB
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'cbefc651ac'
${ noResults }
Commit Graph

2625 Commits (cbefc651ac5afb860dc492e51aa23bd389579527)

Author SHA1 Message Date
orbiter 6e7340ef52 added exclusion search
18 years ago
orbiter e4734a8b6b fix for fix in SVN 3537
18 years ago
orbiter 356033aceb fixed bug with continuous reset of balancer file index
18 years ago
orbiter ba2c307ab3 optimized memory allocation in kelondroRow.Entry
18 years ago
theli 24ea4ca631 *) adding first version of postscript parser
18 years ago
theli def0d6124e *) trying to solve SecurityManager problem during init of soap engine
18 years ago
theli 75eb65028a *) adding a test if a seucrity manager is active
18 years ago
orbiter 210ede8230 added a class for byte-array management. This was the result of a very large experiment
18 years ago
theli 1b7fda12ee *) SOAP: separate function to get the active/passive/potential peer list
18 years ago
orbiter 6488ec8a80 no deletions in index in case that snippet-loading fails and there is no network connection
18 years ago
orbiter 847349358b less memory usage during collectionIndex-rebuild
18 years ago
auron_x 8ef3ad12a7 *) fix for rare bug in PPM-calc
18 years ago
auron_x 00bc0c1b47 *) new logging for PPM-Calculation
18 years ago
auron_x 5941577076 *) added some logging to PPM-Calculation to find a rare bug
18 years ago
orbiter 5c3afb3202 added option to configure a path to a secondary index location.
18 years ago
theli c2e6afbd69 *) bugfix: setting mimeType properly for dir listing with e.g. "?format=xml"
18 years ago
orbiter 242c19b480 completed TLD categorization
18 years ago
hydrox b99f9d870d *) fixed double selection of peers for the same DHT-chunk.
18 years ago
theli f20b596dc0 *) adding servlet to display all deployed SOAP Services
18 years ago
theli 75d90834a2 *) adding additional file extension for powerpoint
18 years ago
orbiter 2cb16824e3 removed support for old database structures.
18 years ago
theli 81b4598487 *) peer profile can now be displayed as vcard
18 years ago
orbiter 3688ec33e5 release 0.51
18 years ago
theli 1f61c13697 *) RSS-parser extracts the author tags now
18 years ago
orbiter 602ac42010 fix for OOM case when a kelondroTree Node cache grows
18 years ago
theli b374812f01 *) adding rpm packager as author
18 years ago
theli 40ce33e664 *) adding RSS feed for yacy news
18 years ago
theli 589cbd8cbf *) replacing all yacy-news-category strings with corresponding constants
18 years ago
allo f4af360f7c bugfix
18 years ago
orbiter 7af188ff9a fix for http://www.yacy-forum.de/viewtopic.php?p=33089#33089
18 years ago
orbiter 5bbf010107 removed synchronization of size() method from numerous classes to avoid thread locking
18 years ago
orbiter 6b9eea3932 - removed differentiation between longTitle and shortTitle; this cannot be used for search results,
18 years ago
orbiter a738b57b31 added author tag to indexing content
18 years ago
orbiter 6be57983a8 another update to the crawl balancer
18 years ago
orbiter 91cdc1493f removed query to NAT or responder in case that no other peer is there.
18 years ago
orbiter 4783a30910 - fixed a flush problem in balancer
18 years ago
theli 91c2a042a7 *) bugfix for wrong proxy traffic accounting
18 years ago
orbiter 861f41e67e redesigned NURL-handling:
18 years ago
hydrox 9b5fb3908d *) a peer-message are now created when a blog-comment is written
18 years ago
orbiter 581db87237 more debug code for
18 years ago
orbiter 81c4cc6bf7 better debugging of balancer failure
18 years ago
orbiter dd06d4cada more logging to better trace bug
18 years ago
orbiter 96b79bf86d redesigned remove method in kelondroRowSet
18 years ago
orbiter 9f929b5438 better snippet handling in case of snippet load fail
18 years ago
auron_x d451ad48d3 *) improved peerloadgraphic:
18 years ago
orbiter a5d668c0c6 added speed-buttons for easy performance setting
18 years ago
orbiter 5b0a84ce09 fix for synchronization deadlock with flushMissNameCache.
18 years ago
karlchenofhell e2ac5f62bd - Code hübscher machen [von NNs TODO]
18 years ago
allo f04097c3dd integrated tor-patch for crawling, if yacyDebugMode is set.
18 years ago
auron_x 22fe14f292 *) first version of Peerload-graphic
18 years ago
orbiter 432d7d4e9c better catch
18 years ago
orbiter 8f7e8b6ee2 auto-delete for not-fixable db error in crawl stacker.
18 years ago
orbiter 7a52b07fcc better memory protection during freemen cycle
18 years ago
orbiter 6faa262259 fix for NURL-fix
18 years ago
orbiter 909d7a8ae9 fixed wrong implemented row iterator in kelomdroFlexSplitTables
18 years ago
orbiter a1fb8358b2 lets make a well-formed http link so that other crawlers don't have a problem to follow this link :-)
18 years ago
orbiter 4edb70f68b added yacybot info-page from Roland
18 years ago
orbiter 3ef77d2030 fix for http://www.yacy-forum.de/viewtopic.php?p=29878#29878
18 years ago
orbiter 3bb3df3fc0 fix for http://www.yacy-forum.de/viewtopic.php?p=32298#32298
18 years ago
orbiter 243a2f831b fixed problem with not found NURL-hashes
18 years ago
orbiter 6ad39bae1e fixed shutdown problem
18 years ago
orbiter 38b93f8cb8 bugfix for my last commit:
18 years ago
karlchenofhell 264a82eec8 - fix for http://www.yacy-forum.de/viewtopic.php?t=3657
18 years ago
orbiter d755a8026d - better OOM protection
18 years ago
orbiter 23338d2070 small fix for RAM computation
18 years ago
orbiter 33f97cff7a changed startup initialization sequence slightly
18 years ago
orbiter 4e8eb1dbe3 some minor changes here and there
18 years ago
karlchenofhell 03c5906ae7 - minor bugfixes for url-fetcher & http://www.yacy-forum.de/viewtopic.php?t=3646
18 years ago
orbiter 3499a364ef a little bit better memory protection
18 years ago
orbiter 313f6a7680 fix for http://www.yacy-forum.de/viewtopic.php?p=31553#31553
18 years ago
orbiter 958ebea5c5 fix for http://www.yacy-forum.de/viewtopic.php?p=32470#32470
18 years ago
orbiter 5d5e6ebfcc fix for http://www.yacy-forum.de/viewtopic.php?p=32631#32631
18 years ago
orbiter 1cba31de43 redesigned ram organization for database caches
18 years ago
theli 26450a1d9a *) avoid nullpointerException on seed.getAddress() (reported by netbude)
18 years ago
orbiter db235f2d61 added some memory protection in collection index multiple merge
18 years ago
theli c72605ecab *) adding a function to determine if a given URL is bookmarkt
18 years ago
theli bd03c6b874 *) bugfix in bookmarksDB:
18 years ago
orbiter b466baa574 added some memory protection
18 years ago
low012 ce360ef43e *) no more HTML in plasmaCrawlProfile.java anymore
18 years ago
karlchenofhell 88245e44d8 - improved version of robots.txt (delete your old htroot/robots.txt before updating):
18 years ago
karlchenofhell 9623bf7bbe - removed call of java 1.5 method
18 years ago
orbiter 51e12049fa third generation of R/W head path optimization
18 years ago
karlchenofhell a1d68fe092 - use .class rather than Class.forName for classes in class-path
18 years ago
orbiter 10a3c20b8d some more enhancements to R/W Head path optimization
18 years ago
orbiter f4cfd19835 second Generation of collection R/W head path optimization:
18 years ago
orbiter 1fda50fd3c correct R/W head positioning in kelondroFlex
18 years ago
orbiter 304412a049 first generation of collection index R/W head path optimization
18 years ago
hydrox 54fef3574f *) missing files for last commit
18 years ago
hydrox cb89c74d52 *) added blog-comments
18 years ago
karlchenofhell 6fbe31425a - some code-cleanup (no more syntax-warnings here)
18 years ago
orbiter 32867580ee update to kelondroRecords needed fo last commit
18 years ago
orbiter e3480d4ad3 fix for warning in crawl balancer
18 years ago
orbiter 8668ac5d91 preparations for collection index cache flush optimization
18 years ago
karlchenofhell 39a2000d8b - added support for [[Bookmark:$bookmarkTag|description]]-link-listings (requested by theli) to wiki-parser
18 years ago
karlchenofhell 619653c054 - fix for last commit
18 years ago
karlchenofhell 26f5757b40 - added support for multiple paths per domain to default-blacklist
18 years ago
karlchenofhell a5a36d9252 - hopefully last fix fo 1.5 methods (sorry for that, eclipse isn't that helpful in identifying those methods)
18 years ago
karlchenofhell e97b6f0458 - we still use Java 1.4 ...
18 years ago
karlchenofhell 0c7b8cf632 - added first version of new wiki-parser
18 years ago
orbiter f7803a6ce4 enhanced crawl balancer
18 years ago
low012 801eea8849 *) Fixed bug where pairReplace() got caught in infinite recursion. (http://www.yacy-forum.de/viewtopic.php?t=3466)
18 years ago
orbiter c3e8c23f5d fix for 'CANNOT FETCH ENTRY: hash is null' bug
18 years ago
orbiter badab8d924 fixed some more bugs in new db handling
18 years ago
orbiter e72d253577 fixed problem with initial cache load
18 years ago
orbiter 2d8e472cfd emergeny bugfix for last commit
18 years ago
orbiter dc0c06e43d PLEASE MAKE A BACK-UP OF YOUR COMPLETE DATA DIRECTORY BEFORE USING THIS
18 years ago
karlchenofhell c016fcb10f - added streaming-support to CrawlURLFetchStack_p servlet
18 years ago
karlchenofhell d114a0136e - crawl profile: don't add null-values
18 years ago
karlchenofhell b2a9d32f29 why do I always forget some lines? sorry...
18 years ago
theli e1edb23689 *) Bugfix for IllegalMonitorStateException
18 years ago
orbiter bf69a721cb more protection against mis-use of YaCyHop interface:
18 years ago
orbiter a15963ff98 better balancing: if element from top would force a busy waiting,
18 years ago
orbiter dda24fcb85 ups
18 years ago
orbiter 8c1d2e0227 protection against crawl balancer failure:
18 years ago
orbiter 1f1f398bfa enhanced speed of RAM cache flush by factor 20 (twenty times faster)
18 years ago
orbiter 30d79d69a6 fix for wrong display of search statistics
18 years ago
orbiter daf2e15f59 some storage process enhancements (write without preceding read)
18 years ago
orbiter 9c2101a852 small enhancement to cache dump
18 years ago
orbiter c464157a6e replaced some toString()
18 years ago
orbiter 7673f0869b minor enhancements
18 years ago
orbiter b4aa195c27 added user-agent check for yacy-hop proxy authentication
18 years ago
orbiter 2d7f7da7ce fix for null pointer exception
18 years ago
orbiter d25caa07bf redesigned some parts of http authentication
18 years ago
hydrox 9184113284 *) fixed News deletion. News are now removed if they are no longer in a news-stack. This does not effect News-entires in the news-db that have no stack-entries.
18 years ago
(no author) e218940293 The copyright sign "\u00A9" is already replaced by "©". String "(C)" is not a unicode sequence!
18 years ago
low012 1bc4d8d470 *) If there is more than one pair of patterns in a line, all of them (and not only one pair) will be replaced.
18 years ago
low012 ea7a8cf7aa *) <hr> and <br> tags are XHTML compliant now.
18 years ago
orbiter d03cd41266 fix for http://www.yacy-forum.de/viewtopic.php?t=3411
18 years ago
karlchenofhell f2e6f19b90 - added versioning to Wiki
18 years ago
orbiter 10ebcb5e1e fixed bug in disconnection time
18 years ago
karlchenofhell 02a73dce87 - added Diff-class for wiki-versioning (forthcoming, first need suitable serverObjects.put() for it)
18 years ago
karlchenofhell 2401e748a3 - fixed wrong replacement of POST-parameters in httpd ('<' and '>' are still replaced, don't know why): http://www.yacy-forum.de/viewtopic.php?t=3466
18 years ago
orbiter b2f4087400 redesign of last-seen fieln inside seed:
18 years ago
karlchenofhell e68cdeeeb3 - reverted parseArg(String) to use a byte-array to handle correct UTF-8 parsing
18 years ago
orbiter e00e850a98 removed constants (no connection with yacySeed.dna identifier)
18 years ago
orbiter fcc11391a8 some redesign attempts because sorting of lastseen does not work correctly
18 years ago
orbiter c2d6edf21d integrated number of remote targets as 'partitions' into remote search protocol
18 years ago
orbiter f696d3c1eb added double computation to kelondroMapObjects
18 years ago
orbiter 819ff21c92 fixed QPM output
18 years ago
auron_x 89e7af037a *) used more switchboard-vars instead of config-vars
18 years ago
orbiter 306c50ac40 QPM (queries per minute) statistic stub
18 years ago
orbiter 7598e1243e removed unused variables/imports
18 years ago
orbiter 47ab83a7c0 added flag for YaCyHop - proxy access for all paths that start with /yacy/
18 years ago
karlchenofhell 9f74b128dd - added many more commented constants (please use constants rather than i.e. config-setting strings directly)
18 years ago
orbiter e4910f03d1 tag storage fix
18 years ago
orbiter 991182b29b more space for bookmarks
18 years ago
orbiter 88fa764b64 implemented new kelondroObjects into bookmarkDB
18 years ago
orbiter 9c05e2a820 re-design ob kelondroMap
18 years ago
allo 669c21db05 first version of abstracted kelondroMap Cache.
18 years ago
allo 98cb777e18 abstract wikiCode in putWiki
18 years ago
orbiter f25c0e98d1 - replaced String by StringBuffer in condenser
18 years ago
allo 14f2068daf some more bookmark changes towards multiuser bookmarks
18 years ago
allo 25c7d4e25e fix for form (cookie) login
18 years ago
allo ff79c52fc0 bookmark users can now edit bookmarks.
18 years ago
theli 49972b6193 *) SOAP: getPeerHash returns the proper value now
18 years ago
karlchenofhell 15f0334cd3 - fixed IllegalThreadStateException in LogParser
18 years ago
allo f40169fcd7 preparing multiuser bookmarks
18 years ago
hydrox 814a09a0ed *) reversed r3250 and parts of r3252 (nanotime() is an java1.5 function)
18 years ago
karlchenofhell d311e258f8 - adjusted LogStatistics to nano-seconds
18 years ago
hydrox f7623f5d24 *) added missing measuring points for Parser-Runtime
18 years ago
orbiter f3f99b19c6 extended search statistics
18 years ago
orbiter c0851ee943 refactoring: moved and renamed de.anomic.data.searchResults to plasma package
18 years ago
allo c39dda2374 finished refactoring of searchtemplates.
18 years ago
allo 35039982da refactoring of search process: store results in a searchResults structure. At the moment, its just stored in it, and read from it again.
18 years ago
orbiter 76fab83395 fixed bugs in seach statistics
18 years ago
karlchenofhell 139810d504 - truncate attributes of new newsRecords if too long
18 years ago
karlchenofhell 3c43e605ba - don't accept malformed bookmarks, fix for: http://www.yacy-forum.de/viewtopic.php?t=3414 (first report)
18 years ago
orbiter d07b132a0d - fixed colors of network grafic
18 years ago
karlchenofhell 5d540b219e - LogalizerHandler skips interfaces again
18 years ago
allo e1fb3550ab fix for profile
18 years ago
hydrox 6faf9b70b7 *) LogParserPLASMA now counts its total runtime.
18 years ago
hydrox e5f854bc37 *) added LogalizerHandler-settings to yacy.logging.
18 years ago
karlchenofhell 7c40197e42 - fixed error pages and <label>s for index.html
18 years ago
allo 29aa7031d3 workaround for the snippets
18 years ago
allo b4457763e5 fix for putSafeXML and supertemplates.
18 years ago
karlchenofhell 77b73aa7a8 - log-entries 'Indexed' are parsed correctly now
18 years ago
karlchenofhell aea199cb7b - IndexTransfer is working again
18 years ago
karlchenofhell 71112b1fe6 - added LogStatistics_p.html servlet based on the logalizer (indexing values not functional yet due to charset/regex problems)
18 years ago
allo 0c81bd39d4 XSS-safe put as default.
18 years ago
karlchenofhell bdda9e802f - added some commented string constants to ease use of the result-table
18 years ago
orbiter 5515571950 redesign of ymage classes
18 years ago
orbiter 52c6461e6b some bugfix for statistics
18 years ago
(no author) fe72b772cf added a monitor page for search requests
18 years ago
karlchenofhell b3a2c79fec - fix for last fix
18 years ago
karlchenofhell 4b23e79f51 - quick-fix for http://www.yacy-forum.de/viewtopic.php?t=3358
18 years ago
karlchenofhell 4dce5ec261 - if mem is too low but former GCs helped, the word-cache limit is only decreased now, if a subsequent GC doesn't
18 years ago
hydrox c27e88104c *) getResults() should now work and compile properly with Java 1.4
18 years ago
hydrox a2fb54afff *) Quickfix for http://www.yacy-forum.de/viewtopic.php?p=29973#29973 getResults() used a java 1.5 function (Output is temporally disabled until a sulution with 1.4 functions is implemented)
18 years ago
karlchenofhell b873ad51ab - fix for http://www.yacy-forum.de/viewtopic.php?t=3369
18 years ago
hydrox 3acd90033c *) added functions to get results from log-parsers (not documented yet)
18 years ago
borg-0300 1aa74bbd2b update for last commit
18 years ago
borg-0300 23e613b2ab CPU & IO reduce (Index Distribution)
18 years ago
(no author) c67d22116e added exists-check based only on RAM index lookup:
18 years ago
(no author) 37e53b4a6a replaced tree database structure for seed db by flex data structure
18 years ago
karlchenofhell 340dc52a9d - ConfigProfile_p.html now transmits usable encoding for other than 7-bit ASCII charset, see TODO in httpd.parseArg(String)
18 years ago
karlchenofhell 35fb671721 - updated DetailedSearch and ViewFile
18 years ago
karlchenofhell 00aa9472d6 - added decode of HTML-entities in request lines
18 years ago
theli d157201e08 *) IfesL for "Unexpected end of ZLIB" error message
18 years ago
karlchenofhell 0336480a3e - the maxMemory-fix for the Sun JVM 1.4.2 wrongly also applied to 1.6, thx to NN
18 years ago
hydrox 2c01508ada *) fix for http://www.yacy-forum.de/viewtopic.php?p=29575#29575
18 years ago
allo 6ff8359b98 possibility to use anonther bindPort than the externally reachable port.
18 years ago
borg-0300 d2be3c674d wrong cache values fixed
18 years ago
karlchenofhell df6281ba1f - removed JS from DetailedSearch => valid
18 years ago
hydrox fb1d8b91af *) changed Startpoints of IndexCleaner and IndexTransfer from ------------ to AAAAAAAAAAAA.
18 years ago
karlchenofhell d6eb699e8e - fix for last commit (didn't know that the paragraph sign has an UTF-8-specific location)
18 years ago
karlchenofhell 41bc31d2c2 - ConfigAdvanced_p => XHTML (no invalid IDs)
18 years ago
orbiter 9b726ac366 release 0.50
18 years ago
orbiter 036a0c828e fix for auto-configuration of crawler thread memory
18 years ago
orbiter 16f88c49d9 applied patch from http://www.yacy-forum.de/viewtopic.php?p=27392#27392
18 years ago
orbiter 2aa6f978c2 fix for http://www.yacy-forum.de/viewtopic.php?p=29125#29125
18 years ago
orbiter a4e90bc1dc fix + debug-code for http://www.yacy-forum.de/viewtopic.php?p=29126#29126
18 years ago
borg-0300 6b5f28b746 answer for last commit: no
18 years ago
borg-0300 d98ba7bc33 fix for memory limit computation ?
18 years ago
orbiter 49ffedfd8b patch from Fuchs against deadlock,
18 years ago
borg-0300 a4f63d187d better map2string and NullPointer fix
18 years ago
orbiter c48374d14a new memory limit computation for indexing queue
18 years ago
theli a9f1d3a065 *) SOAP: adding function to get the local peer hash
18 years ago
borg-0300 9659c004c3 fix for wrong date (Lotus-1 Peer)
18 years ago
orbiter 08ac4c5ed0 bugfix for http://www.yacy-forum.de/viewtopic.php?p=29045#29045
18 years ago
orbiter 8e3bd17554 adopted DetailedSearch page to new ranking options
18 years ago
orbiter 93a7e88245 more ranking parameter usage
18 years ago
orbiter 2dbea612c9 fixed display bug for image search preview
18 years ago
orbiter 0a050bc043 enhanced ranking
18 years ago
orbiter d0c32c6aeb better protection against fraud peers
18 years ago
orbiter 61798f0ae6 added option to distinguish between text crawl and media crawl
18 years ago
karlchenofhell be941c4475 - "javascript:"-URLs are recognized as well (as intended formerly I assume)
18 years ago
karlchenofhell a619ba3f49 - fix for String index out of range during URL parsing
18 years ago
orbiter febe6b114a design update of crawler monitor
18 years ago
orbiter 40049e0635 fixed media search snippet flow
18 years ago
borg-0300 05d0464377 only do 16 checks if "address" starts with "172.";
18 years ago
rramthun 1a525710c1 *) cursor jumps now to searchbox on searchpages again
18 years ago
karlchenofhell e17591acc3 - parse HTML arguments as UTF-8 strings
18 years ago
karlchenofhell d30932c7d8 - fix for fix... sry
18 years ago
karlchenofhell 6118fb73ec - added decode of UTF-16 escapes in url-arguments (%u0123), bugfix for http://www.yacy-forum.de/viewtopic.php?t=2762
18 years ago
allo 782db9099d version independent name for commons-pool lib
18 years ago
orbiter 7ff86d6ba6 - image search now shows thumbnails (in bad order, but it works)
18 years ago
orbiter ee3d91cb6b print-out of links that result from contraint-filtering
18 years ago
borg-0300 f4737eebd6 Properties
18 years ago
borg-0300 1fc75c0f67 better logging
18 years ago
orbiter e4570bffaf -implemented a specialized snippet-fetch for media content
18 years ago
low012 694a6e4f44 *) better text snipptes: any possible searchword (welt, linux, tag) in welt-linux-tag will be marked correctly now
18 years ago
orbiter bddc197453 reverted by-mistake removed change from low012/SVN 3068
18 years ago
orbiter 1377c53aa3 extraction of media links from search results
18 years ago
low012 586add4c6c *) Better snippets: words like GNU/Linux will not prevent Linux or GNU from being marked if they are searchword (see http://www.yacy-forum.de/viewtopic.php?t=2891)
18 years ago
borg-0300 29922d5dd2 changed writeMap
18 years ago
borg-0300 5b00a04359 changed writeMap
18 years ago
karlchenofhell 52abbd4131 - fix for wrong public IP if no hostname was set and IP was from range 192.168.*.*
18 years ago
borg-0300 8b7c543885 NullPointer fix
18 years ago
orbiter 937ccd4e76 fix for snippet-generation
18 years ago
orbiter 559f41a001 fix for http://www.yacy-forum.de/viewtopic.php?p=28607#28607
18 years ago
auron_x c086c71f17 *) fixed ArrayIndexOutOfBoundsException
18 years ago
orbiter c93cfdc23a fix for http://www.yacy-forum.de/viewtopic.php?p=28564#28564
18 years ago
orbiter 93a5ace330 fix for http://www.yacy-forum.de/viewtopic.php?p=28544#28544
18 years ago
orbiter bf0d820659 - added correct flagging of word properties
18 years ago
orbiter 10d888e70c - added a media search for images, audio, video and applications
18 years ago
orbiter a603c4d5e8 more code simplifications
18 years ago
orbiter 9a85f5abc3 cleanup
18 years ago
borg-0300 fbe1ee402b plasmaCrawlLURL$kiter cleanup
18 years ago
orbiter 773ba1e91a - generalized object order handling
18 years ago
borg-0300 15381cbf73 other bugfix
18 years ago
borg-0300 ad65cc9d2f NullPointer fixes
18 years ago
borg-0300 d33745a7ea NullPointer
18 years ago
orbiter 3a4933b63c bugfix for
18 years ago
orbiter 109ed0a0bb - cleaned up code; removed methods to write the old data structures
18 years ago
orbiter 052f28312a removed assortments from indexing data structures
18 years ago
orbiter 2372b4fe0c release 0.49
18 years ago
orbiter f8efb3c948 fixed a null pointer exception problem reported in the forum.
18 years ago
orbiter ad1e4aa88e added selection of audio, video, image and application resources
18 years ago
orbiter fb7902aa68 fix for http://www.yacy-forum.de/viewtopic.php?p=26142#26142
18 years ago
orbiter 7cc4cec9c9 bugfix for assertion bugs documented in
18 years ago
orbiter 97596af843 patch for wrong old RWI entries
18 years ago
hydrox 2c69cc969a *) more special chars removed
18 years ago
hydrox ebb42906f8 *) removed special characters
18 years ago
theli 954db729db *) Bugfix for ArrayIndexOutOfBoundsException during SSL detection
18 years ago
orbiter 5afd2f283c fix for http://www.yacy-forum.de/viewtopic.php?p=27633#27633
18 years ago
orbiter 9dfae90da8 better control of sortBound; should help to avoid an indexOutOfBound Exception
18 years ago
orbiter 4ce590622f - more asserts
18 years ago
orbiter 7dbcd358b4 fix for http://www.yacy-forum.de/viewtopic.php?p=28231#28231
18 years ago
orbiter 86394e7a56 fix for cache-delete problem:
18 years ago
orbiter ceb9e3aa17 - enhanced parser: collection of audio, video, image and application links
18 years ago
orbiter 984285bdd6 better organisation of dns hit/miss cache flush
18 years ago
orbiter 73c63578ad - activated the dns miss cache
18 years ago
theli eb20ec3837 *) soap-service: adding function to check if a specific url is blacklisted
18 years ago
orbiter 0b9370a9dc fix for http://www.yacy-forum.de/viewtopic.php?p=28108#28108
18 years ago
orbiter b5a29e9651 - fix for snippets that are too short
18 years ago
orbiter 13868ebb3e reverted IP-patch in yacySeed
18 years ago
allo 4cb688018d wikiAdmin Recht
18 years ago
low012 29fa17bd40 *) simplified some code in wikiCode.java
18 years ago
orbiter f1528672b1 filtering of non-index pages during index-of search
18 years ago
orbiter 0a0c3edeb6 fixed a bug in index transfer
18 years ago
orbiter 8e7215475b - extended ViewFile to use is as debugging-tool: you can now use the
18 years ago
orbiter 30888e7a2f implementation of search constraints
18 years ago
orbiter 49a83f99d9 - fix for wrong DHT ordering in DHT selection
18 years ago
orbiter e55ef0df28 - automatic migration of old RWI entries to new format during remote search
18 years ago
orbiter f4b547dc13 limited index transfer to peer with version 0.486
18 years ago
orbiter 10a4ab5195 disabled some (more) write caches
18 years ago
orbiter 09bcc10344 bugfix for some problems of last change with assortments
18 years ago
orbiter e3d75f42bd final version of collection entry type definition
18 years ago
theli 58d79a9ac1 *) more error logging
18 years ago
theli 73552db482 *) bugfix adding missing lib names to copy and zip commands
18 years ago
theli 5c0669429e *) soap: adding function to query the peer list
18 years ago
orbiter c9364246cc introduced new RWI-Object.
18 years ago
hydrox f442af956c *) first version of build-in logalizer
18 years ago
theli 9ea9a9f157 *) bugfix for bookmark service: get didn't work when using date=null
18 years ago
orbiter b94ee53958 some enhancements to url retrieval
18 years ago
theli 203f2bde9a *) adding function to query the pause/resume state of the crawling queues
18 years ago
orbiter d34f10c63d some tests with reverse dns lookup
18 years ago
(no author) 24ac4e8860 Bugfix to "-UNRESOLVED_PATTERN- bei Hostname-Änderung" (http://www.yacy-forum.de/viewtopic.php?t=3093)
18 years ago
orbiter e628d34e16 patches for bad data
18 years ago
orbiter 497428c8ec refactoring
18 years ago
(no author) a51417d86b Bugfix: language of ConfigLanguage_p.html was not changed properly when a different language was choosen here
18 years ago
theli 4147c9f490 *) better error logging on soap engine initialization
18 years ago
orbiter 76fceb9997 refactoring
18 years ago
theli f77d624b94 *) bugfix for persistent connection support on transfer-encoded requests
18 years ago
orbiter eeda881553 bugfix for last commit
18 years ago
orbiter bb7d4b5d5e refactoring to prepare new RWI entry object
18 years ago
orbiter 6412c926bc new url entry interface
18 years ago
orbiter bdc9216366 - more asserts
18 years ago
low012 b18273bbb2 *) YaCy will extract URLs from <embed> tags now.
18 years ago
orbiter 1751a799ac - deactivated all write buffers
19 years ago
orbiter ba967c4875 - bugfixes and debug code
19 years ago
orbiter eaad91d84f fixed wrong RAM calculation
19 years ago
orbiter ee4715a21c - more asserts
19 years ago
orbiter 114a76a86e - added flag to urlhash that shows that domain is a local domain
19 years ago
orbiter eafb5ecd22 - better usage of memory resources for kelondroFlexSplit
19 years ago
orbiter b2d51be33c bugfix for latest changes to entry generalization
19 years ago
(no author) e59ff8b657 Bugfix: language of ConfigBasic.html was not changed properly when a different language was choosen here. Note: there's a similair bug on ConfigLanguage_p.html
19 years ago
theli 892b9f2fc4 *) additional soap function to query peer status
19 years ago
theli bd3710a974 *) new xml template to view peer profile as xml
19 years ago
theli d1afe1ce6b *) adding xml template to get the message list as xml
19 years ago
orbiter d454ca44ee update of cache logging
19 years ago
hermens 8385557672 Small fix for the Cache Monitor when using proxyCacheLayout=hash
19 years ago
theli f37e2041e8 *) adding soap function to import yacy bookmarks from xml or html (transfered via soap attachments)
19 years ago
orbiter f1ed55a5fc bugfix for last commit
19 years ago
orbiter 8fdefd5c68 generalization of payload definition of index storage
19 years ago
theli 29a1f132ec *) some strings replaced by constants
19 years ago
theli 4a3ec63e34 *) new soap service to manage yacy bookmarks
19 years ago
(no author) 9b3fd2b9e5 *) removing doctype definition to avoid problems with xml parser
19 years ago
(no author) c64d5018b4 *) Bugfix. Problem in XML Parser
19 years ago
theli 5e57e0814d *) new soap function to display log
19 years ago
theli ad248d61ca *) more verbose exception
19 years ago
hydrox 7e8669b15c *) added possibility to "recycle" a DHTChunk that failed to transfer.
19 years ago
low012 4feaa91890 *) Added additional MIME-Type.
19 years ago
low012 89af433879 *) Deleted parts of WebCat that were not needed for parsing SWFs.
19 years ago
orbiter 46a712e195 - more asserts
19 years ago
low012 8c9bc7e341 *) extracting urls works now
19 years ago
orbiter fc2936d500 bugfix for internal index entry generation
19 years ago
low012 493391e42d *) new flash parser, still experimental
19 years ago
orbiter 215c4e65f1 code cleanup
19 years ago
orbiter bd4f43cd66 - fixed a null pointer exception bug
19 years ago
auron_x 194d42b6a7 *) changed PPM-calculation to be more accurate
19 years ago
orbiter fe8afaf426 switched off usage of write cache for imprortant databases
19 years ago
orbiter 985fd807cc bugfixing in collection methods
19 years ago
theli c7bea4addb *) soap api
19 years ago
theli ee4d4e8567 *) Soap-handler: bugfix. wrong content-length was send when using content-encoding
19 years ago
orbiter d3431433b0 more anonymization in logging
19 years ago
orbiter e6044e5198 bugfix for
19 years ago
theli 4d19d94348 *) bugfix for nullpointerexception
19 years ago
theli 532c23b5c7 *) soap handler
19 years ago
orbiter 78b7f6f7fd bugfix for index remove bug,
19 years ago
(no author) 0e79f2fd7e name of the file to tranlate apears ahead its translation
19 years ago
orbiter ebd2d629d8 added missing file for last commit
19 years ago
orbiter 147d88cf23 re-design of database caching
19 years ago
orbiter 4e363108e1 - removed bad debug code that caused a large and unnecessary delay during global search
19 years ago
orbiter f21ede312e bugfixes for internals of database organization
19 years ago
orbiter eb4bfb0e9d fixed problem with cache.profile()
19 years ago
orbiter 2a9d868f6d - removed object cache from kelondroTree
19 years ago
theli 7299dc30e3 *) new soap service to manage the yacy file-share
19 years ago
theli 777e39cea0 *) new template to display the dir-listing in xml format.
19 years ago
theli 9e8942a064 *) adding method to implement blacklist from file
19 years ago
theli 4d1f933ea1 *) avoid reading of content body into memory
19 years ago
theli 88cfdecd38 *) Bugfix: calling close must not close the wrapped input stream, otherwise
19 years ago
theli d38ef0493d *) be more tolerant against missing ports in url
19 years ago
theli cfe54fedc7 *) Bugfix for resolveBackpath problem with tailing /..
19 years ago
orbiter dc056fabf3 small bugfix
19 years ago
orbiter 278d8c3c7e - more asserts
19 years ago
allo 5a6488256d catch the "username too short" exception
19 years ago
orbiter 2d3f1a53fd handling of Missing byte-order mark exception
19 years ago
theli ac13fa763a *) bugfix for blacklist remove (blacklist was not informed about remove)
19 years ago
allo 8a5c2d0a19 fix for supertemplates, too.
19 years ago
allo c35793fb46 fix for last commit
19 years ago
theli 3e0516446b *) new soap function to get the current queue status
19 years ago
allo a831c83025 create servletProperties, with the servlet specific funktions from serverObjects
19 years ago
orbiter 83a0efc65a better assert statements and fixes
19 years ago
karlchenofhell d13b381f83 - added mint-green skin
19 years ago
orbiter 2025e885d6 a fix for problems with remove situations in kelondroFlexSplitTable
19 years ago
theli b12da510f3 *) adding optional libraries for needed for soap attachments
19 years ago
theli 9eecc9a888 *) libs added to classpath
19 years ago
theli a1acc9c389 *) new function to configure distributed crawling
19 years ago
theli 0996e550e7 *) deploy soap peer admin service
19 years ago
orbiter 3ffc5b8793 fixed problem with serverCharBuffer.append(char)
19 years ago
orbiter 8b56887676 removed unused code
19 years ago
orbiter 06854988da - full integration of new LURL database in INDEX
19 years ago
(no author) 02c66c04f2 *) Missing file from last commit
19 years ago
octoate e4a3574b77 StringBuffer now resets every time the parser is called
19 years ago
theli ef912811f1 *) adding new soap service for peer administration
19 years ago
karlchenofhell ce237aefad - assortment-sizes table from PerformanceQueues_p.html is not shown if not used
19 years ago
theli 68204ff729 *) Suppressing for bad client requests.
19 years ago
theli c1dff41f99 *) adding possibility to deploy custom SOAP services
19 years ago
theli df49724f28 *) better error handling for seed upload - test download - problems
19 years ago
theli a5b9b514c1 *) retry crawling without content-encoding if the content-encoding header was not correct
19 years ago
theli 52466067d8 *) Bugfix for ArrayIndexOutOfBoundsExceptions which occure because SimpleDateFormat is not thread-safe
19 years ago
theli b357a13e9a *) adding synchronization block because SimpleDateFormat is not thread-safe
19 years ago
theli 92f774edd1 *) Better charset encoding detection
19 years ago
orbiter b79e06615d - added new LURL.Entry class for next database migration
19 years ago
octoate cc24dde5e0 First version of a MS Excel parser based on Apache POI
19 years ago
karlchenofhell 4c63129136 - stupid mistake...
19 years ago
karlchenofhell b14a500b88 - removed debug output from PerformanceMemory_p
19 years ago
karlchenofhell ebf0da2a45 - now the fix http://www.yacy-forum.de/viewtopic.php?t=2974 works
19 years ago
theli 09337c9751 *) Bugfix wrong chars in soap search result document
19 years ago
theli 3d152bfe43 *) Logging message added
19 years ago
karlchenofhell b5e40e2fa2 - fix for http://www.yacy-forum.de/viewtopic.php?t=2974 (no cache-sizes for new db)
19 years ago
theli 96f45e9b15 *) Bugfix wrong chars in soap search result document
19 years ago
theli da2ac6fa23 *) adding new ant target to allow generation of client stub classes for yacy soap api
19 years ago
theli a9cc6df21b *) adding wsdl files to generate client stub classes with ant
19 years ago
orbiter 77a59a115d refactoring of indexing methods
19 years ago
orbiter 14490f0a83 added missing flush statement
19 years ago
orbiter 688cbfb776 - bugfixing for flextable bug
19 years ago
allo a29b4d4fb5 extended Supertemplates for Headerincludes.
19 years ago
theli a7e11ada50 *) suppressing stacktrace for "server has closed connection"
19 years ago
theli 5b114249ce *) Bugfix for ViewLog problem with multiline logging messages
19 years ago
theli de5e233766 *) Bugfix for GuiHandler sorting problem
19 years ago
theli fd94aa4bef *) Bugfix for IndexOutOfBound in GuiHandler
19 years ago
orbiter 29a1318ef9 bugfixes for wrong database access that do not consider deleted entries
19 years ago
theli cbb1e710b9 *) removing old class
19 years ago
orbiter c6d46f7ebd null pointer bugfix
19 years ago
theli decb09df6d *) Trying to be more tolerant against wrong charset names
19 years ago
theli e9afe39cbb *) Trying to be more tolerant against wrong charset names
19 years ago
theli 7526c831a8 *) Suppressing stracktrace
19 years ago
orbiter 50f2578c55 - some bugfixing and code cleanup
19 years ago
orbiter bdf4c7c51e added missing files for last commit
19 years ago
orbiter a5dd0d41af - refactoring of plasmaCrawlLURL.Entry to prepare new Entry format
19 years ago
orbiter 130cc76927 loop detection and termination in deletedHandles method
19 years ago
octoate 1c4076da8a First version of the MS Powerpoint parser based on Apache POI
19 years ago
theli 5b75d64d7d *) bugfix for last commit
19 years ago
theli 71ed104bc7 *) adding additional rpm mimetype (used by packman)
19 years ago
borg-0300 76d959122b new constants, finals, Stringbuffer, cleanup
19 years ago
orbiter 6396f5971e bugfixes and migration attempt toward new kelondroFlex db
19 years ago
hermens 48f81acc0e reverse SVN 2744, it is not needed
19 years ago
hermens 1da9aece12 Repair DNS prefetch during cacheScan
19 years ago
orbiter 918b59dc5e - bugfix for snippet profile (no delete button)
19 years ago
orbiter 2bb529cedb added peer tags for peers in robinson mode
19 years ago
orbiter afbb547f3d extended options for abstracts generation in remote search interface
19 years ago
theli 22649408ad *) Better errorhandling for charset encoding problem during content parsing
19 years ago
theli a9c7e3f061 *) Bugfix for NoSuchElementException
19 years ago
orbiter f25f61d9d3 documentation of compile problem. See
19 years ago
orbiter c8f3a7d363 added snippet-url re-indexing
19 years ago
low012 2cfd4633ac *) even better handling of searchwords in snippets, words can consist of letters and numbers now
19 years ago
orbiter b062847797 fix for
19 years ago
orbiter e17fea7015 files in htcache are now stored in different hash/tree subdirectories
19 years ago
orbiter 661f005214 fix for seed upload build script
19 years ago
low012 2d3b7251a4 *) better handling of searchwords in snippets (see http://www.yacy-forum.de/viewtopic.php?t=2891 for details)
19 years ago
orbiter ddf8f220f6 fix for build fail
19 years ago
orbiter 25ae3d3161 generalized definition of hexhash
19 years ago
orbiter 86047f439d removed very bad bug that prevented production of any remote search result
19 years ago
orbiter f0d747c723 removed deprecated method
19 years ago
orbiter 5ff77612ac bugfix for old WORDS storage method
19 years ago
orbiter 0f10bdde22 more generic cache methods
19 years ago
orbiter 72482b1426 fixed scraper
19 years ago
hermens 6557112d8f small fix for plasmaURLPool.getURL() needed for new alternative htcache layout
19 years ago
hermens 440c6ee657 Implement alternative htcache layout
19 years ago
allo 226f2c5b2c first version, of the Serverlet Debugger
19 years ago
orbiter adf1f74ab2 bugfix for java 1.5 compile problem with serverCharBuffer.append(char)
19 years ago
orbiter fd61209797 lines inside tags without punctuation are extended by a single dot.
19 years ago
allo 1d0c0edda3 first version of posts/get from the del.icio.us api
19 years ago
orbiter 1969522dc1 removed lowercase of snippets (and other things):
19 years ago
orbiter 43614f1b36 bugfix in collection index. the index for collections was not created correctly
19 years ago
orbiter 1dfab1abe3 more control for seed receive
19 years ago
theli 1c0e65f55f *) Bugfix for problems with charset detection
19 years ago
orbiter db294687ea enhanced logging
19 years ago
theli a9a0f51303 *) suppressing InterruptedException errormessage
19 years ago
theli ce7ee74316 *) better errorhandling in filehandler (try catch block now starts before argument parsing)
19 years ago
theli 1d4fb680ce *) CrawlWorker.java: only keep content in memory if size is equal or less than 5MB
19 years ago
theli 1586d57187 *) odtParser: better handling of large files
19 years ago
theli f17ce28b6d *) plasmaHTCache:
19 years ago
orbiter 630a955674 read snippets from cache in case they are not provided in RAM
19 years ago
orbiter bcf2b800b4 applied UTF-8 encoding parameter to yacy-internal protocol communication
19 years ago
orbiter c40fca08a2 fixed bad handling of string separation
19 years ago
orbiter 5a40ea7866 refactoring of wget string list generation
19 years ago
orbiter dbc2e039bb added time-out option parameter to call hierarchy
19 years ago
orbiter d4c239e4be - fixed problem in collection index with deletion of single url references
19 years ago
orbiter 00746ca232 identified and fixed search performance problem caused by
19 years ago
orbiter b033a80750 better control of failure in node seek of kelondroTree
19 years ago
orbiter 310f1c41cd added option to see ranking scores in surftipps
19 years ago
theli a2e3095044 *) Bugfix. Add missing plasmaParserDocument.close() calls
19 years ago
theli cd5f349666 *) Better handling of large files during parsing
19 years ago
theli 8b2ceddb91 *) Displaying servere and warning logging messages in different colors on ViewLog_p.html
19 years ago
low012 f8ac694e51 *) fixed a bug where searchword in snippets were not displayed bold in front of a punctuation mark (see http://www.yacy-forum.de/viewtopic.php?p=25998)
19 years ago
orbiter df1629b05a - code cleanup
19 years ago
theli c665f6cddb *) handling of quotes in charset string
19 years ago
theli b73efd5565 *) missing changes needed because of last commit
19 years ago
theli 140ddba93f *) adding soap functions to pause and resume the crawler
19 years ago
orbiter 2463e5624a 'quick' release 0.47
19 years ago
theli 49fbb688df *) SOAP: old urlInfo renamed to urlInfoByHash, new urlInfo Function added.
19 years ago
theli 8f143d516b *) make snippet fetcher accessible via soap api
19 years ago
theli 97615af406 *) Restructuring of YaCy SOAP services
19 years ago
theli 241b881560 *) Redesign of YaCy SOAP handler
19 years ago
theli 009a33170b *) Content-Location header added
19 years ago
theli 1aa07a52cd *) Bugfix for UnsupportedEncodingException if the media type contains multiple parameters
19 years ago
theli 625c2ce6b1 *) bugfix for snippet fetching problem if content but not http header is available in cache
19 years ago