Commit Graph

2710 Commits (af3a696fc446e401e111daa232e4b475b83f5951)

Author SHA1 Message Date
orbiter 1b8d346b4c fixes in connection with transiton to byte[] hashes
16 years ago
orbiter e7559f3234 fix for http://forum.yacy-websuche.de/viewtopic.php?p=13977#p13977
16 years ago
orbiter fa3adbbfc6 added domain checks to surrogate reader and RWI transfer receiver to prevent spaming using surrogates
16 years ago
low012 31c6934df2 *) fix for r5832
16 years ago
lotus 616a4d724f high-end favicon with 2 versions:
16 years ago
low012 d1116c049f *) added new method "contains()" to Blacklist interface
16 years ago
f1ori 94a6c83256 * rewrite code without using java 1.6 features
16 years ago
orbiter 29e96c1a60 bugfixes and performance hacks
16 years ago
f1ori 44daec7936 * introduce signatures to autoupdate
16 years ago
orbiter e16c25ddf7 (peak-) performance hacks
16 years ago
orbiter 63cd152969 fixes
16 years ago
orbiter 870066ab35 another fix
16 years ago
orbiter b15b059c0d fix for latest commit
16 years ago
orbiter c8624903c6 full redesign of index access data model:
16 years ago
f1ori dd6b5005ff * fix missing charset handling in getpageinfo_p
16 years ago
orbiter bd5f4c78d8 - added default profile for surrogate indexing
16 years ago
orbiter ad78e3a59f - less lines in rssTerminal
16 years ago
orbiter 12d81e98eb - fixed bad search results when searching for empty string
16 years ago
orbiter 8a24350036 - fix for join method with new generalized RWI data structure (caused by latest commit)
16 years ago
orbiter 89ec3acb3e - full abstraction of index content type: the kelondro full text index may now also contain indexes about other content than text, i.e. navigation indexes or reverse linking indexes.
16 years ago
orbiter dc2af61bc9 allow up to 50 results from remote peers
16 years ago
low012 6504b21cea *) fix for http://forum.yacy-websuche.de/viewtopic.php?t=1976
16 years ago
orbiter 601d63ef48 removed comment tag (no use at this point)
16 years ago
low012 0c8fd811dc *) first and very limited version of XML import, does not use benefits provided by XML yet
16 years ago
orbiter c08f9b36a4 refactoring of wiki parser.
16 years ago
apfelmaennchen faeff21012 - fix for display of automatic ReCrawls in surftips
16 years ago
orbiter 44e01afa5b - refactoring
16 years ago
orbiter c2359f20dd refactoring: better abstraction of reference and metadata prototypes.
16 years ago
orbiter a29a11e526 added evaluation of incoming links in webstructure api
16 years ago
orbiter f21a8c9e9c a different naming scheme for BLOBArray files. This may be necessary if blobs are written more often than once in a second.
16 years ago
orbiter 7ba078daa1 - added fast site-operator
16 years ago
orbiter bd409fb7ba added web structure analysis for a special domain that can be requested from the api.
16 years ago
orbiter 587838bd09 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5758 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter 96eaecda3e - added migration class to go from index collections to the index cell data structure.
16 years ago
apfelmaennchen 9ab009b16b fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1890#p13476
16 years ago
apfelmaennchen eb65990f85 small fix for opera in yacyui-portalsearch
16 years ago
apfelmaennchen 695c420bcd small fix for yacyui-portalsearch
16 years ago
apfelmaennchen 95885a263a - added default properies to yacyui-portalsearch
16 years ago
apfelmaennchen c001a020a9 - small modifications to yacyui-portalsearch
16 years ago
apfelmaennchen 34a825f90d small fix for yacyui-portaltest.html
16 years ago
apfelmaennchen 9f9d7f875d small fix
16 years ago
apfelmaennchen 453f3aaa94 RichClient: further clean-up
16 years ago
apfelmaennchen e888c9a934 RichClient:
16 years ago
apfelmaennchen 42c5f930c8 reverted an accidental commit
16 years ago
apfelmaennchen b5e6232f8d small correction of font-size for portal search
16 years ago
apfelmaennchen 7425c6c3ca added an ajax loading graph to portal search
16 years ago
apfelmaennchen a975ae4a7e Added YaCy portal search: http://localhost:8080/yacy/ui/yacyui-portaltest.html
16 years ago
apfelmaennchen b57a1820bd small fix for jquery-faviconize-1.0.js to handle https properly
16 years ago
apfelmaennchen 075b58a0a9 minor fixes for RichClient search
16 years ago
borg-0300 8c494afcfe svn attributes added
16 years ago
orbiter 67aaffc0a2 - added Latency control to the crawler:
16 years ago
orbiter 61f9dbf0cc - fixed a display problem in watch crawler
16 years ago
orbiter b3f75e48fa - enhanced balancer: auto-solving of waiting-deadlocks
16 years ago
orbiter 83792d9233 more refactoring
16 years ago
orbiter 474aac65af more refactoring
16 years ago
orbiter 209f25f5f5 refactoring to integrate indexCell data structures
16 years ago
orbiter 7dff1cba62 removed option to use different primary keys in kelondro tables
16 years ago
orbiter 7f67238f8b refactoring of plasmaWordIndex: less methods in the class, separated the index to CachedIndexCollection
16 years ago
orbiter 14a1c33823 refactoring of wordIndex class
16 years ago
orbiter e2e7949feb replaced old PPM computation with a better one that simply sums up events that had been stored in the profiling table.
16 years ago
borg-0300 d612430fce copy paste mistake
16 years ago
borg-0300 acbdac1b67 corrected examples
16 years ago
orbiter 396a4451be increased timeout in ViewFile
16 years ago
apfelmaennchen 9b6fac4a82 RichClient: better handling for small screens/windows
16 years ago
lotus 8ee946bf1d show upnp status
16 years ago
apfelmaennchen f0947a20a8 - RichClient: increased ajax timeout to 10 sek.
16 years ago
apfelmaennchen e73ac67f7e - for testing JsonP cross domain request I added apfelmaennchen-JsonP as search peer to RichClient
16 years ago
apfelmaennchen f7fd3d30c2 - various changes to RichClient
16 years ago
apfelmaennchen 4f3bdc64b5 - added ?callback= parameter for JsonP support
16 years ago
apfelmaennchen d84264946b - Randspalte für Navigatoren in Suchergebnissen (display=3)
16 years ago
orbiter d7a493b4f5 added experimental timeline api
16 years ago
orbiter efcd95dc37 simplification of (internal) query process / refactoring
16 years ago
orbiter f1b712c29a small corrections to image loading methods in result presentation
16 years ago
orbiter 98f36a801a - small update to search result layout
16 years ago
lotus 4f6658b115 * non-sliding api icon
16 years ago
orbiter aa44d9bad9 more refactoring of kelondro.text / deleted de.anomic.index
16 years ago
orbiter 6ffc6e3389 more refactoring of indexer and kelondro classes;
16 years ago
orbiter 404bc21da9 simplification of (internal) query process / refactoring
16 years ago
orbiter 76ef5f0f14 refactoring of index package: better names for the classes (to be continued)
16 years ago
lotus 39a177649b * added upnp listener for devices that do not respond to discovery but advertise themselves
16 years ago
orbiter 89d8e824ed memory protection for URLAnalysis
16 years ago
apfelmaennchen 72cc1d3a6c YaCy-UI: fix for query string handling in yacyuisearch.html: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1869#p12878
16 years ago
apfelmaennchen 784a7bb7fd YaCy-UI: small fix
16 years ago
apfelmaennchen aa13d03b99 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1874#p12914
16 years ago
orbiter de714783b1 - added host, path, filename to search result
16 years ago
orbiter 7cfab2ee9a added a size field to the search results. The file size is now shown in the html search page and the yacyinteractive. The field is presen in the rss and json
16 years ago
orbiter 4693495bbe added sru-compatibility to yacyuisearch ('query' instead of 'search')
16 years ago
apfelmaennchen 54c7698219 YaCy-UI: some clean up of base.css
16 years ago
apfelmaennchen 5d806623d5 YaCy-UI:
16 years ago
apfelmaennchen bd6a3083c5 YaCy-UI Widget: added a target='_blank' to search results
16 years ago
apfelmaennchen b6b39e9556 YaCy-UI Widget:
16 years ago
apfelmaennchen be29ece9d0 - added a new YaCy-UI Widget: /yacy/ui/yacyui-widget.html?style=xyz
16 years ago
orbiter 1ba4301920 automated interruption of dead incoming connections, if they are there for more than one minute
16 years ago
orbiter c12bb8a6d0 - refactoring of the http client
16 years ago
orbiter 62505bb3cb more bugfixes as recommendet by findbugs
16 years ago
orbiter 94c42691d8 - reject less transmissions as transmission receiver
16 years ago
lotus 4aad461100 added UPnP support
16 years ago
orbiter 62762ba81a fix for thread dump
16 years ago
apfelmaennchen 40ab13c886 YaCy-Ui: small bug fixes
16 years ago
daburna 5d3233ca6c some updates for german translation
16 years ago
apfelmaennchen e4597bd780 YaCy-UI: small bugfix
16 years ago
apfelmaennchen 8aafbe234b YaCy-UI:
16 years ago
apfelmaennchen 222c97b798 YaCy-UI:
16 years ago
low012 4c11843eba *) fixed small bug with large effect (OOM exception hazard when "show all" was selected for a blacklist)
16 years ago
orbiter 6a32193916 - refactoring of cache naming in web index cache (no more dht semantics there)
16 years ago
orbiter e52c3eb79d added option to create a custom number of thread dumps in multiple thread dumps
16 years ago
orbiter 6c627dbdff update to the server core
16 years ago
apfelmaennchen bc1e7da83f small bugfix for Safari to work with YaCy-UI
16 years ago
orbiter 6a876ecb88 first fixes to the DHT transmission process
16 years ago
orbiter de610b99ec replaced invisible pixel image with 'real' invisible pixel ;-)
16 years ago
orbiter c25c334b75 replaced old DHT transmission method with new method. Many things have changed! some of them:
16 years ago
orbiter c6c57b7b3d svn 5580 placed a bug into yacyinteractive and it was not possible
16 years ago
auron_x 49d95fb3d9 - cytag-xhtml-fix
16 years ago
orbiter 01b97ef3f8 added new cybertag-tracking feature that was inspired by itgrl
16 years ago
auron_x 03a16f6c20 - more XHTML-validation
16 years ago
auron_x 46af1e06dc - XHTML-Validation of some pages (Status.html still needs work)
16 years ago
orbiter b57c9da1f8 - fixes to doc, ppt, xls parser: better title
16 years ago
orbiter 65a1de6c05 longer timeout for remote crawl queries
16 years ago
orbiter 86763c42c4 enhanced interactive search
16 years ago
low012 5b79221037 *) bugfix for my last commit
16 years ago
orbiter 9d282d2c16 - renamed interactivesearch to yacyinteractive
16 years ago
low012 910c2aaed6 *) blacklists will only displayed partly now with 50 entries per page by default, this should make it easier to administrate large lists
16 years ago
orbiter 75bef03ac6 fix for bad encoding in yacydoc.html and yacydoc.xml
16 years ago
orbiter 12ec5132ce tried to fix the remote crawl problem.
16 years ago
apfelmaennchen ee3fe19c0b added /api/bookmarks/get_folders.xml
16 years ago
apfelmaennchen 7a159dc745 update for api/bookmarks/get_folders
16 years ago
apfelmaennchen f6ef9014c7 Bookmarks.html - removed API Logo for add, edit etc. views, as this is not supported for RSS Version
16 years ago
apfelmaennchen 35a5116606 - another update to Bookmarks.html
16 years ago
apfelmaennchen ab1a09ab95 small addition to last commit
16 years ago
apfelmaennchen 416d16e026 - partial work around for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1815#p12526
16 years ago
orbiter ef82cced01 removed default line 'P2P WEB SEARCH' if no line is given
16 years ago
f1ori bacccda6d7 * blacklist_p.xml: attrOnly = only give parameters of blacklists, no content
16 years ago
orbiter 94110df85a moved logging partially to kelondro
16 years ago
orbiter 024da2916b refactoring of logging
16 years ago
orbiter 83ce65707a (almost) completed partition of classes in kelondro
16 years ago
orbiter 7ee494fde5 more refactoring of kelondro:
16 years ago
orbiter bf93767ec6 refactoring of kelondro database classes
16 years ago
orbiter fc27bf8c4c refactoring of kelondro classes:
16 years ago
lotus 7e011de34e hint for recrawls
16 years ago
apfelmaennchen 3905caf8a1 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5536 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen 08ed14603e - fixed YaCy-UI sciencenet search
16 years ago
apfelmaennchen 55dd15e344 - clean up of YaCy-UI
16 years ago
apfelmaennchen 025ebd7574 small fix
16 years ago
apfelmaennchen 9bd9ccade2 refactoring
16 years ago
low012 b41a06228f *) cleaning up...
16 years ago
low012 ce81391095 *) using parameters like site: in the search field does not affect urlmask anymore
16 years ago
apfelmaennchen 96684df1a9 - security fix for addTag.java and editTag.java
16 years ago
apfelmaennchen 6dd52422ea - added two dialogs to manage bookmark tags in YaCy-UI
16 years ago
apfelmaennchen 12511bd236 - some additional icons for YaCy-UI
16 years ago
apfelmaennchen e76cbd9016 YaCy-UI: some small cosmetical changes....
16 years ago
apfelmaennchen af3147c3fc and one more....eclipse ist tricky...
16 years ago
apfelmaennchen 9317650272 forgot to post this one...
16 years ago
apfelmaennchen 92d77c3bef Major update to YaCy-UI...still not perfect...but I thought I share my progress :-)
16 years ago
borg-0300 a2b336dfe7 small table fix
16 years ago
low012 80e6356860 *) r 5512 has introduced a bug which resulted in useless filters if site:, filtetype:, or inurl: was used since the filters included the word "null".
16 years ago
lotus 4ef6b15eb8 limit -Xmx setting to 1999m on win32. bigger values would never work.
16 years ago
lotus 5078e837ac better readability / no functional changes
16 years ago
orbiter dedfc7df7f removed distinction between DHT-in and DHT-out. This is necessary to make room for the new cell data structure, which cannot use this this distinction in the first place, but will enable the same meaning with different mechanisms (segments, later)
16 years ago
f1ori 34da04c7dd * fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1754
16 years ago
low012 9a4780c165 *) Javascript should work with Konqueror too now (http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1757)
16 years ago
low012 1927fd5992 *) hopefully fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1757
16 years ago
apfelmaennchen 98ab7ae20a small fix
16 years ago
apfelmaennchen d7122722b2 hopefully a fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1736#p12061
16 years ago
lotus a2bc32e909 fix for IE6 api-icon display
16 years ago
orbiter 6663365720 adopted many calls to new api path
16 years ago
orbiter b423d0a036 moved all servlets from htroot/xml to htroot/api
16 years ago
orbiter 91af105373 last changes before release
16 years ago
orbiter 4bd927d513 the Semantic Web moves in!
16 years ago
apfelmaennchen 613c49bc38 YaCy-UI: update to welcome text (change-log and bug tracker) for stable release
16 years ago
orbiter bed38a5f8c fix for uncaught exception in RSSReader
16 years ago
lotus c7c291bc6b allow simultaneous inurl: site: and filetype: search
16 years ago
orbiter 9ef77d57f5 added an access control to the search interface using white/blacklists:
16 years ago
orbiter ac89e8e84d removed unused search interface
16 years ago
apfelmaennchen 9b26dfec80 small fix to correct encoding of xml output
16 years ago
orbiter efe801173c better dht-in cache flush. see also:
16 years ago
apfelmaennchen 3dc208fad0 bugfix: bookmarks can now handle folder names like /news and /newspaper without getting confused...
16 years ago
apfelmaennchen cc207a979e - added new unified bookmark api to /xml/bookmarks/
16 years ago
low012 f26b8fcb1b *) comment mode is 'moderated' instead of 'activated' by default now (to avoid spam being visible)
16 years ago
orbiter b2a8c653ee small fixes
16 years ago
orbiter 8632eebf60 - added api icon to the web structure visualization
16 years ago
orbiter 4f45605f04 small update for timing in search result processing
16 years ago
lotus 66818a2f2e smaller api banner
16 years ago
lotus 4641ecd6d9 inurl: search
16 years ago
orbiter 299189f1a9 added the API icon to the bookmarks, the network page and the search page
16 years ago
orbiter a1bf687b3b added first API tooltip!
16 years ago
lotus 0d1bd78674 * full site: syntax support e.g. site:de.wikipedia.org
16 years ago
orbiter 9bed4de280 fix for the search bug introduced in SVN 5449
16 years ago
lotus d6a5c98080 api banner concept draft
16 years ago
orbiter b2b7edae18 fixed interactive search
16 years ago
orbiter c6880ce28b removed the permanent cache flush and replaced it with a periodic cache flush
16 years ago
lotus ca80930892 accept leading dots on filetype: and site: search
16 years ago
orbiter 6c7e83909b - refactoring of data access methods to be prepared for new cell data structure
16 years ago
low012 1af728ae09 *) regex for site operator changed as proposed by Lotus
16 years ago
low012 9e58ae036d *) added site operator which can be used to only show results from a certain domain. example: "test site:edu" shows only documents which contain the word test and which come from an edu domain
16 years ago
low012 19e7c56f7f *) apply filter to dir list to only show .black files as blacklists
16 years ago
orbiter c4c4c223b9 fixed a problem with attribute flags on RWI entries that prevented proper selection of index-of constraint
16 years ago
low012 4bffe664ca *) moved entry field for new expressions to top of the list as requested in forum (http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1678)
16 years ago
low012 9d5d30f877 *) http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1672
16 years ago
orbiter 5448aad328 removed unused code
16 years ago
orbiter 28d2d28573 added support for filetype search
16 years ago
orbiter 78c568331e added test channel to /xml/feed.rss
16 years ago
orbiter e004da48d3 - added fast fingerprint computation for files (any). Will be used in new index dump method
16 years ago
low012 eab72424df *) Fixed small bug: When adding new elements to blacklist via import, the blacklist which the elements were added to was supposed to be displayed, which did not work correctly.
16 years ago
low012 0e56675596 *) cleaning up ;-)
16 years ago
low012 cf69557ea2 *) blacklists can be exported as XML or plain text now
16 years ago
low012 1594a15be9 *) explicit mentioning of blacklist in blacklist cleaner
16 years ago
low012 5a89266598 *) new parameters for future use (better blacklist handling for im- and export)
16 years ago
orbiter e34ac22fbd - added new monitoring servlet at
16 years ago
orbiter d376d81fc4 replaced busy thread control of crawl stacker by blocking threads
16 years ago
orbiter 7535fd7447 - refactoring of CrawlEntry and CrawlStacker
16 years ago
lotus 6569cbbec1 npe fix: http://forum.yacy-websuche.de/viewtopic.php?t=1646
16 years ago
orbiter 2802138787 - refactoring of CrawlStacker (to prepare it for new multi-Threading to remove DNS lookup bottleneck)
16 years ago
lotus b1e211b258 no error-alert: http://forum.yacy-websuche.de/viewtopic.php?t=1639
16 years ago
orbiter 13cb0916ee changes to statistics and content of thread dump servlet
16 years ago
orbiter e1acdb952c fix for problem with userDB and bookmarksDB which was caused by changes in kelondroRA in SVN 5376
16 years ago
lotus e918d64c23 show hand-cursor an labels
16 years ago
orbiter 4a2dac659e more speed hacks:
16 years ago
lotus 1fb518a5b4 display <String> etc.
16 years ago
orbiter 47292e696a more performance hacks
16 years ago
orbiter bd1dc9cd5d thread dump with statistics, a little bit of profiling
16 years ago
orbiter d39d420b39 performance hacks
16 years ago
lotus 5280ad638d added basic performance page
16 years ago
lotus 1a51d9fcfd display proper values
16 years ago
orbiter 0b4808ba3d added new interactive search feature:
16 years ago
lotus fea82b54ef more contrast on search snippets
16 years ago
lotus 1951d30a62 addendum to last commit
16 years ago
lotus 325ba7bfb8 only query words with length > 2
16 years ago
lotus 489edb4473 improved pattern selection
16 years ago
low012 e423fa9846 *) added method to only get file names in directory listing which match a filter
16 years ago
lotus 577b53aee6 added more search engines
16 years ago
lotus 7f4d411c0d npe-fix
16 years ago
lotus 1545e5440a * index deletion: checkbox-confirmation
16 years ago
orbiter 10f5ec1040 reverted last commit (more testing needed)
16 years ago
daburna ba5b274b8c #translation update:
16 years ago
orbiter 0ca4bc7b79 - added reader and visualization for mediawiki-export files:
16 years ago
lotus 4f996a7651 fix for logparser pattern
16 years ago
orbiter 867d0f2f56 removed some unnecessary pause delays
16 years ago
lotus fd83e59f8e new remote search average
16 years ago
orbiter dba7ef5144 extended crawling constraints:
16 years ago
orbiter 0ae84f4f8e set some default values for a crawl start that should cause less confusion and mistakes
16 years ago
lotus 4745e89451 auto-choose crawl type
16 years ago
low012 421d056550 *) changed layout of blacklist adminstration (less cluttered)
16 years ago
orbiter 674ad2d55b different handling of error cases that occur during loading files with http or ftp:
16 years ago
f1ori ae80f3e6a5 * extend opensearchdescription to support compare_yacy.html
16 years ago
orbiter 1b18d4bcf3 enhancement to crawling and remote crawling:
16 years ago
orbiter 3f746be5d4 - consolidation and refactoring of many DHT target - computing methods
16 years ago
orbiter d014b2728a Design-check, Extension and Refactoring of DHT target position computation:
16 years ago
low012 83967f8c77 *) servlet does not forget chosen blacklist anymore when editing, moving or delting an entry
16 years ago
low012 04e41a392f *) fixed bug where RegExes were not deleted and even added to the list a second time when the user tried to edit them
16 years ago
low012 7bac4796d2 *) added servlet which returns all shared blacklists of a peer without information about which part of YaCy (crawler, proxy, ...) blacklist is activated for (to be used for better online import)
16 years ago