hydrox
2522c26921
*) peer-search now checks matches to peername and peerhash
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3520 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
5c3afb3202
added option to configure a path to a secondary index location.
...
this shall be used to store a fragment of the index on another physical device,
to split IO load and enhance access speed. The index is splitted in such a way
that the LURLs are stored to the secondary location, and the RWIs to the primary
location. This is especially useful for environments where symbolic links are
not possible and may cause IO access even if there is no write access to the
device which hosts the symbolic link.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3519 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
07cd30cf9b
*) minor changes for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3518 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
51b2df566b
*) adding possibility to display a fileshare-dir as RSS feed
...
(e.g. to monitor the directory for changes)
usage example: http://localhost:8080/share/?format=rss
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3517 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
c2e6afbd69
*) bugfix: setting mimeType properly for dir listing with e.g. "?format=xml"
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3516 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
242c19b480
completed TLD categorization
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3515 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
146f4aee01
*) adding mimetype for opml
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3514 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
hydrox
b99f9d870d
*) fixed double selection of peers for the same DHT-chunk.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3513 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
e6681b2a79
*) changing RSS feed titles
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3512 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
f20b596dc0
*) adding servlet to display all deployed SOAP Services
...
- soap related servlets are located in htroot/soap
*) new serverContext class for soap
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3511 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
7edd5a0b77
*) correcting notifier.gif path
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3510 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
allo
8463e29b14
removes addons from minimal install
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3509 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
df15f71a5c
*) avoid NullpointerExceptions if Seed is null
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3508 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
75d90834a2
*) adding additional file extension for powerpoint
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3507 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
2cb16824e3
removed support for old database structures.
...
The new collection index will be more generalized to support other indexes
i.e. YBR block-rank computation. A clean-up of the many conditions to support
the old database was necessary.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3506 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
716b3d1533
*) updating feed item link
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3505 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
81b4598487
*) peer profile can now be displayed as vcard
...
e.g. http://localhost:8080/ViewProfile.vcf?hash=localhash
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3504 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
70bd67e73e
documentation update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3503 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
a53403e0b2
*) Updating News Feed for new release
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3502 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
3688ec33e5
release 0.51
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3501 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
1f61c13697
*) RSS-parser extracts the author tags now
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3500 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
602ac42010
fix for OOM case when a kelondroTree Node cache grows
...
See also: http://www.yacy-forum.de/viewtopic.php?p=33275#33275
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3499 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
b374812f01
*) adding rpm packager as author
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3498 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
beb772d6cd
fixed problem with broken notifier image, occurred only at initial start-up
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3497 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
40ce33e664
*) adding RSS feed for yacy news
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3496 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
589cbd8cbf
*) replacing all yacy-news-category strings with corresponding constants
...
Note: please use these constants from now on
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3495 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
allo
f4af360f7c
bugfix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3494 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
allo
bb51efbb49
"Bugfix" for Tagdisplay
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3493 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
rramthun
43114af6d7
*) Translated robots.txt-config-page
...
*) Simplified some sentences
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3492 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
7af188ff9a
fix for http://www.yacy-forum.de/viewtopic.php?p=33089#33089
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3491 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
5bbf010107
removed synchronization of size() method from numerous classes to avoid thread locking
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3490 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
6b9eea3932
- removed differentiation between longTitle and shortTitle; this cannot be used for search results,
...
and it is difficult to get both types from all document types
- added some author parsing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3489 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
a738b57b31
added author tag to indexing content
...
enhanced composition of title tag
TODO: insert author information for external parsers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3488 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
6be57983a8
another update to the crawl balancer
...
can now alternate between top and bottom of the crawl stack
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3487 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
91cdc1493f
removed query to NAT or responder in case that no other peer is there.
...
this is not needed any more, there are enough peers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3486 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
4783a30910
- fixed a flush problem in balancer
...
- return to idle divisor in RWI RAM cache flush
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3485 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
91c2a042a7
*) bugfix for wrong proxy traffic accounting
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3484 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
861f41e67e
redesigned NURL-handling:
...
- the general NURL-index for all crawl stack types was splitted into separate indexes for these stacks
- the new NURL-index is managed by the crawl balancer
- the crawl balancer does not need an internal index any more, it is replaced by the NURL-index
- the NURL.Entry was generalized and is now a new class plasmaCrawlEntry
- the new class plasmaCrawlEntry replaces also the preNURL.Entry class, and will also replace the switchboardEntry class in the future
- the new class plasmaCrawlEntry is more accurate for date entries (holds milliseconds) and can contain larger 'name' entries (anchor tag names)
- the EURL object was replaced by a new ZURL object, which is a container for the plasmaCrawlEntry and some tracking information
- the EURL index is now filled with ZURL objects
- a new index delegatedURL holds ZURL objects about plasmaCrawlEntry obects to track which url is handed over to other peers
- redesigned handling of plasmaCrawlEntry - handover, because there is no need any more to convert one entry object into another
- found and fixed numerous bugs in the context of crawl state handling
- fixed a serious bug in kelondroCache which caused that entries could not be removed
- fixed some bugs in online interface and adopted monitor output to new entry objects
- adopted yacy protocol to handle new delegatedURL entries
all old crawl queues will disappear after this update!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3483 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
094a1482f4
*) removing yacy.exe on ant clean
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3482 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
832662ccd2
*) removing yacy.jar on ant clean
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3481 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
hydrox
9b5fb3908d
*) a peer-message are now created when a blog-comment is written
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3480 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
581db87237
more debug code for
...
http://www.yacy-forum.de/viewtopic.php?p=33009#33009
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3479 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
81c4cc6bf7
better debugging of balancer failure
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3478 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
dd06d4cada
more logging to better trace bug
...
http://www.yacy-forum.de/viewtopic.php?p=33001#33001
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3477 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
96b79bf86d
redesigned remove method in kelondroRowSet
...
This should fix also numerous bugs like
http://www.yacy-forum.de/viewtopic.php?p=31077#31077
(java.lang.ArrayIndexOutOfBoundsException in kelondroRowCollection.removeShift)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3476 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
9f929b5438
better snippet handling in case of snippet load fail
...
see also http://www.yacy-forum.de/viewtopic.php?p=31096#31096
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3475 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
auron_x
d451ad48d3
*) improved peerloadgraphic:
...
- unnecessary (0 %) pieces are removed
- percent-values of each thread displayed in legend
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3474 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
a5d668c0c6
added speed-buttons for easy performance setting
...
appears in crawl start and on indexing monitor page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3473 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
5b0a84ce09
fix for synchronization deadlock with flushMissNameCache.
...
see also: http://www.yacy-forum.de/viewtopic.php?p=32939#32939
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3472 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
karlchenofhell
e2ac5f62bd
- Code hübscher machen [von NNs TODO]
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3471 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago