apfelmaennchen
42d936288e
small update for RichClient LogViewer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5883 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
6f5ea7b1a8
small fix for previous post
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5879 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
2eabd989ce
- added a log viewer to RichClient (alpha version, very slow)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5878 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
557c2a32a3
small fix for yacyui-portalsearch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5876 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b4539a61dd
some more documentation for yacyui-portaltest.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5875 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
64ce9da60f
- new yconf parameter global
...
- see http://forum.yacy-websuche.de/posting.php?mode=quote&f=9&p=14207#pr14207
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5873 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
9325198c42
hopefully a fix for http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762#p14305
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5871 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
675f350d18
YaCy Portal Search Widget
...
- see http://localhost:8080/yacy/ui/yacyui-portaltest.html
- two new parameters (logo and link) for yconf as requested at http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762#p14101
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5869 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
daea87d436
do not accept dht from bad versions
...
delete bad hashes on receive
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5852 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
dfb96ecb72
more fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5844 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
fa3adbbfc6
added domain checks to surrogate reader and RWI transfer receiver to prevent spaming using surrogates
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5837 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
b15b059c0d
fix for latest commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5813 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
c8624903c6
full redesign of index access data model:
...
terms (words) are not any more retrieved by their word hash string, but by a byte[] containing the word hash.
this has strong advantages when RWIs are sorted in the ReferenceContainer Cache and compared with the sun.java TreeMap method, which needed getBytes() and new String() transformations before.
Many thousands of such conversions are now omitted every second, which increases the indexing speed by a factor of two.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5812 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
89ec3acb3e
- full abstraction of index content type: the kelondro full text index may now also contain indexes about other content than text, i.e. navigation indexes or reverse linking indexes.
...
- during index joins all word positions are maintained: better ranking for word distance possible; exact phrase match can be implemented soundly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5804 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
44e01afa5b
- refactoring
...
- a little bit more abstraction
- new interfaces for index abstraction
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5783 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
c2359f20dd
refactoring: better abstraction of reference and metadata prototypes.
...
This is a preparation to introduce other index tables as used now only for reverse text indexes. Next application of the reverse index is a citation index.
Moved to version 0.74
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5777 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7ba078daa1
- added fast site-operator
...
- refactoring merge into BLOBArray
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5770 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
eb65990f85
small fix for opera in yacyui-portalsearch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5751 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
695c420bcd
small fix for yacyui-portalsearch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5750 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
95885a263a
- added default properies to yacyui-portalsearch
...
- see http://localhost.8080/yacy/ui/yacyui-portaltest.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5749 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
c001a020a9
- small modifications to yacyui-portalsearch
...
- see http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762&p=13459#p13459
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5748 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
34a825f90d
small fix for yacyui-portaltest.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5746 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
9f9d7f875d
small fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5745 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
453f3aaa94
RichClient: further clean-up
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5744 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e888c9a934
RichClient:
...
- renamed base theme to start theme
- reoved all but start theme
- additional themes can be downloaded from http://jquery-ui.googlecode.com/files/jquery-ui-themes-1.7.zip
- or a custom theme can be generated at http://jqueryui.com/themeroller/
- themes are installed into DATA/LOCALE/htroot/yacy/ui/css/themes
- update for RichClient theme selection will follow soon
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5743 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
42c5f930c8
reverted an accidental commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5742 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b5e6232f8d
small correction of font-size for portal search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5741 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
7425c6c3ca
added an ajax loading graph to portal search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5740 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
a975ae4a7e
Added YaCy portal search: http://localhost:8080/yacy/ui/yacyui-portaltest.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5739 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b57a1820bd
small fix for jquery-faviconize-1.0.js to handle https properly
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5738 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
075b58a0a9
minor fixes for RichClient search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5737 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
83792d9233
more refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5722 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
474aac65af
more refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5719 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
209f25f5f5
refactoring to integrate indexCell data structures
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5718 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7f67238f8b
refactoring of plasmaWordIndex: less methods in the class, separated the index to CachedIndexCollection
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5710 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
14a1c33823
refactoring of wordIndex class
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5709 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
e2e7949feb
replaced old PPM computation with a better one that simply sums up events that had been stored in the profiling table.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5706 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
9b6fac4a82
RichClient: better handling for small screens/windows
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5681 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f0947a20a8
- RichClient: increased ajax timeout to 10 sek.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5678 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e73ac67f7e
- for testing JsonP cross domain request I added apfelmaennchen-JsonP as search peer to RichClient
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5677 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f7fd3d30c2
- various changes to RichClient
...
- improved search stability
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5675 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
efcd95dc37
simplification of (internal) query process / refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5671 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
aa44d9bad9
more refactoring of kelondro.text / deleted de.anomic.index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5664 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6ffc6e3389
more refactoring of indexer and kelondro classes;
...
- integrating the indexer into kelondro as package 'text'
- renaming of classes in kelondro.index
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5663 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
404bc21da9
simplification of (internal) query process / refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5662 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
76ef5f0f14
refactoring of index package: better names for the classes (to be continued)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5661 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
72cc1d3a6c
YaCy-UI: fix for query string handling in yacyuisearch.html: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1869#p12878
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5645 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
784a7bb7fd
YaCy-UI: small fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5644 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
aa13d03b99
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1874#p12914
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5643 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
4693495bbe
added sru-compatibility to yacyuisearch ('query' instead of 'search')
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5637 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
54c7698219
YaCy-UI: some clean up of base.css
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5635 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
5d806623d5
YaCy-UI:
...
- fix for folders
- first experiments with topwords
- first experiments with bookmark tag folder
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5634 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
bd6a3083c5
YaCy-UI Widget: added a target='_blank' to search results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5632 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b6b39e9556
YaCy-UI Widget:
...
- added parameters fontsize=[small,normal,big], height and width
- e.g. http://localhost:8080/yacy/ui/yacyui-widget.html?style=darkness&fontsize=small&height=400&width=300
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5631 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
be29ece9d0
- added a new YaCy-UI Widget: /yacy/ui/yacyui-widget.html?style=xyz
...
- http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1127#p12781
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5630 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
94c42691d8
- reject less transmissions as transmission receiver
...
- do not flag too much receiver when something goes wrong during transmission as sender
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5616 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
40ab13c886
YaCy-Ui: small bug fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5604 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
daburna
5d3233ca6c
some updates for german translation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5602 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e4597bd780
YaCy-UI: small bugfix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5601 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
8aafbe234b
YaCy-UI:
...
- some themes to get started
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5598 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
222c97b798
YaCy-UI:
...
- updated to jquery 1.3.1
- updated to jquery-ui 1.6rc6
- added support for themes (not yet persistent but otherwise working well)
- deleted some obsolete files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5597 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6a32193916
- refactoring of cache naming in web index cache (no more dht semantics there)
...
- activating a feature in the thread dump that cuts off dumping of a trance of inside-java-core events
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5593 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
bc1e7da83f
small bugfix for Safari to work with YaCy-UI
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5590 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6a876ecb88
first fixes to the DHT transmission process
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5588 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
c25c334b75
replaced old DHT transmission method with new method. Many things have changed! some of them:
...
- after a index selection is made, the index is splitted into its vertical components
- from differrent index selctions the splitted components can be accumulated before they are placed into the transmission queue
- each splitted chunk gets its own transmission thread
- multiple transmission threads are started concurrently
- the process can be monitored with the blocking queue servlet
To implement that, a new package de.anomic.yacy.dht was created. Some old files have been removed.
The new index distribution model using a vertical DHT was implemented. An abstraction of this model
is implemented in the new dht package as interface. The freeworld network has now a configuration
of two vertial partitions; sixteen partitions are planned and will be configured if the process is bug-free.
This modification has three main targets:
- enhance the DHT transmission speed
- with a vertical DHT, a search will speed up. With two partitions, two times. With sixteen, sixteen times.
- the vertical DHT will apply a semi-dht for URLs, and peers will receive a fraction of the overall URLs they received before.
with two partitions, the fractions will be halve. With sixteen partitions, a 1/16 of the previous number of URLs.
BE CAREFULL, THIS IS A MAJOR CODE CHANGE, POSSIBLY FULL OF BUGS AND HARMFUL THINGS.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5586 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
auron_x
03a16f6c20
- more XHTML-validation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5580 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
auron_x
46af1e06dc
- XHTML-Validation of some pages (Status.html still needs work)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5579 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
12ec5132ce
tried to fix the remote crawl problem.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5563 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
94110df85a
moved logging partially to kelondro
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5545 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
024da2916b
refactoring of logging
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5544 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
83ce65707a
(almost) completed partition of classes in kelondro
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5543 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7ee494fde5
more refactoring of kelondro:
...
- seperated BLOB from table classes
- renamed 'coding' package to 'order'
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5542 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
bf93767ec6
refactoring of kelondro database classes
...
(to be continued)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5540 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
fc27bf8c4c
refactoring of kelondro classes:
...
kelondro shall become independent from other packages.
moved bytebuffer, date and memory to kelondro
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5539 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
08ed14603e
- fixed YaCy-UI sciencenet search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5535 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
55dd15e344
- clean up of YaCy-UI
...
- added /yacy/ui/yacyuisearch.html (stand alone version)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5534 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
025ebd7574
small fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5531 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
9bd9ccade2
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5530 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
6dd52422ea
- added two dialogs to manage bookmark tags in YaCy-UI
...
- fixed renameTag() in bookmarksDB
- added /api/bookmarks/tags/addTag.xml
- added /api/bookmarks/tags/editTag.xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5525 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
12511bd236
- some additional icons for YaCy-UI
...
- added license (readme.txt) to exiting icon sets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5524 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e76cbd9016
YaCy-UI: some small cosmetical changes....
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5522 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
af3147c3fc
and one more....eclipse ist tricky...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5521 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
92d77c3bef
Major update to YaCy-UI...still not perfect...but I thought I share my progress :-)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5519 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
dedfc7df7f
removed distinction between DHT-in and DHT-out. This is necessary to make room for the new cell data structure, which cannot use this this distinction in the first place, but will enable the same meaning with different mechanisms (segments, later)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5511 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6663365720
adopted many calls to new api path
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5498 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
613c49bc38
YaCy-UI: update to welcome text (change-log and bug tracker) for stable release
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5485 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ac89e8e84d
removed unused search interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5474 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
efe801173c
better dht-in cache flush. see also:
...
http://forum.yacy-websuche.de/viewtopic.php?p=11936#p11936
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5472 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
cc207a979e
- added new unified bookmark api to /xml/bookmarks/
...
the get_bookmarks api currently supports:
.xml: posts, xbel, rss, flexigrid
.json: posts, flexigrid
.html: work in progress
- YaCy-UI: support for new bookmark api
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5467 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6c7e83909b
- refactoring of data access methods to be prepared for new cell data structure
...
- removed a memory overhead in collections which prevent OOM Exception in low memory configurations
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5443 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
e004da48d3
- added fast fingerprint computation for files (any). Will be used in new index dump method
...
- refactoring
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5415 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
low012
5a89266598
*) new parameters for future use (better blacklist handling for im- and export)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5403 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
2802138787
- refactoring of CrawlStacker (to prepare it for new multi-Threading to remove DNS lookup bottleneck)
...
- fix of shallBeOwnWord target computation heuristic
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5392 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
47292e696a
more performance hacks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5379 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
1951d30a62
addendum to last commit
...
handle words with length < 3 correctly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5369 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3f746be5d4
- consolidation and refactoring of many DHT target - computing methods
...
- implemented vertical DHT acceptance ("my own DHT") to accept new targets
- added new target computation for global search: addresses vertical targets also
- enhanced remote crawling: collection of remote crawl urls if queue has less than 100 entries (was: 0 entries)
- better performance value computations for PPM selection in network configuration
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5319 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d014b2728a
Design-check, Extension and Refactoring of DHT target position computation:
...
- two different computations (but mathematical equivalent) of the DHT distance had been consolidated
- moved from 0.0 .. 1.0 double-range position computation to 0 .. Long.Max range for DHT targets
- added fast Long - to - hash computation
- high-precision target computation of gaps for new peers
- added new target computation for horizontal and vertical DHT targets (not yet in use)
- old horizontal-only DHT targets will be upwards compatible to new horizontal and vertical DHT positions
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5318 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
0edec2b760
FULL redesign of algorithms in htmlTools to encode/decode strings from/to unicode and html.
...
The old process used a not really efficient way to detect html encoding strings in texts.
All calling methods had been adoped to call the new class in an enhanced way with less parameters.
Many classes in interfaces used a XML encoding only (instead of full html conversion from unicode to html); this behavior was not changed with this commit but should be controlled again since it points out possible XSS leaks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5295 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ff68f394dd
fix for problem with balancer and lost crawl profiles:
...
if crawl profile ist lost, no robots.txt is loaded any more
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5258 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
3717d2057a
YaCy-UI: fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1483
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5251 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d0bdcdd57c
small changes to attributes of DoS attack protection parameters
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5246 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
2c23e6ad34
YaCy-UI: added some features for Admin Console
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5241 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
efcae14714
YaCy-UI:
...
- added 'Open' button to search result toolbar
- lets you open all selected search results in new window/tab
- added 'any language' filter as default
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5240 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
820a03f9d6
- removed some warnings
...
- used fix in SVN 5233 for ysearch.java and search.java
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5237 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
7f88dadf87
YaCy-UI: added a notice to a bug in bookmarks folder recursion!
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5221 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
cc9f1e9dd9
YaCy-UI: enabled edit bookmarks in toolbar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5215 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
00c843f7d9
YaCy-UI:
...
- added scrollbar to folder widget
- slightly improved Ajax handling for folder and tag widget
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5214 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
848dbbd280
YaCy-UI:
...
- added bookmark folder widget to sidebar (it uses the xbel.xml with XSLT!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5206 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
8b6a0376db
YaCy-UI:
...
- another XSS fix (TagCloud)
- upload of missing icons for toolbar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5198 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
2ff6f0360e
YaCy-UI: small fixes to accomodate Safari & Opera
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5196 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
a28af9d4c4
YaCy-UI: enabled language selection - special thanks to orbiter
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5195 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
1d9f0234c8
YaCy-UI:
...
- added basic functionallity to add bookmark(s) from search results
- re-design of sidebar search form
- replaced classic search with compare search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5194 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
00c1535f84
added ranking and evaluation of language type in a search
...
the wanted language is taken from the browser user-agent string
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5192 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e201ad0e9f
YaCy-UI:
...
- moved search result to flexigrid
- added a toolbar similar to YaCyBar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5191 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
06c07f2e0f
YaCy-UI: fixed broken style for add bookmark dialog
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5190 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
a5f61e8b1b
YaCy-UI:
...
- fixed xss vulnurability
- improved add bookmark dialog
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5189 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e071f759d2
YaCy-UI: small optical changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5172 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
bbacf86fe8
- added /xml/bookmarks/posts/add_p.xml
...
- security fix to /xml/bookmarks/posts/delete_p.xml
- YaCy-UI: added 'add' and 'delete' bookmarks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5171 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
cd1ac5bb90
- fixed security issue with /xml/util/ynetSearch.xml
...
- hopefully fixed YaCy-UI local search with async=false for Ajax-request
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5170 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
c73cf05ddd
tried to fix local search in yacy-ui
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5169 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
99ff478d63
YaCy-UI: small optical fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5167 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7e24c51fd5
- removed alternative search page in main menue in favor of rich client search page
...
- added necessary option to search request of yacy-ui to get snippets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5165 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
7c5867a832
Major update to YaCy-UI
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5162 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
4fbee21cea
- added fetch-ahead again (had been removed in last commit)
...
- reverted default query mode to verify=false
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5111 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
05dbba4bab
added logging conditions to all fine and finest log line calls
...
this will prevent an overhead for the generation of the log lines in case that they then are not printed
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5102 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
3fbfd5a78b
* fix for non-changing offset on new search term
...
* dht-heap doesn't has to be deleted (5097), we simply write a new one on exit
* do not install YaCy in startup because a Windows-shutdown might corrupt something. Installing YaCy as a service would solve this.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5099 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
cd19d0aee6
- added warnings for failed transferRWI (dht-in)
...
- fixed parseMultipart (uncompress gzipped body) (dht-in)
- fixed parseMultipart (using content-length only if uncompressed)
- better gzipped POST (chunked instead of content-length) (dht-out)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5096 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
536e77e8b7
modifications towards a single database operation to read/write http header and cached file at once:
...
- removed distinction between header file types for http and ftp; ftp is simulated by using http properties
- removed all old resourceInfo classes that handled this distinction
- introduced a new distinction between http request and http response objects
- unified new response objects with two other object types that had been introduced elsewhere
- changed all servlet call methods to use the new http request header object type
- divided static object keys for http header properties into request and response types
- refactoring here and there (a large number of type changes and many methods merged/moved)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5079 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
296fa2265b
YaCy-UI: removed unused Servlet ymarks.java
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5076 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
a9cf3b42c4
YaCy-UI: removed unused JavaScript
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5075 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
08bf3fd235
YaCy-UI: updated to jQuery-ui 1.6b
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5074 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
753a1ae430
- changed default browser from netscape to firefox
...
- fixed "Inefficient use of keySet iterator instead of entrySet iterator" [WMI_WRONG_MAP_ITERATOR, FindBugs]
- fixed some possible null pointer accesses
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5063 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
621b473b18
* removed some warnings of findbugs ( http://findbugs.sf.net )
...
- removed unnecessary code (unused variables, String.toString)
- corrected some calculations (cast int to double or long ;)
- improved little performance (using Integer.valueOf() instead of new Integer)
- log if some File-actions fail (mkdir(), delete(), ...) and some ignored exceptions
- finalized some (more) fields
- finally close some streams
- made inner classes static if not using environment
- generalized some equals (from specificClass to Object)
- fixed some potential nullpointer accesses
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5039 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
17b7845eb5
* refactoring
...
- moved constants from plasmaSwitchboard to own class (all 232 ;)
- moved remoteProxy-Methods to httpRemoteProxyConfig, better names
- removed some unnecessary code (else-statements)
* formatting (correct indentation)
* minor bugfixes (due to findbugs.sf.net)
* hopefully fixed "missing quote" (announcing StringParts as UTF-8)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5031 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
3bb870bfcd
added final where possible
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5030 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c3d461d191
- removed superfluous copyright statement
...
- updated my email address
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5011 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3ca98fee42
removed superfluous copyright statement
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5010 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
10d01fdd0d
addendum to 5002
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5005 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
e12438142e
- warning instead of NPE if urlHash is not in index of CrawResults
...
- times of LOCAL_SEARCH are shown in milliseconds
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5000 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a6719dfd2b
- refactoring of robots parser
...
- no more keep-order parameter in remove (it was not possible to make this strict, and not useful)
- some small enhancements in balancer
- robots parser without references in switchboard
- changes synchronization in robots
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4969 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
7feae906aa
- organize imports
...
- removed potential null pointer accesses
- removed unnecessary casts
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4893 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
0e1c7dfaaf
small fix for testing environment that should not affect a production environment
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4886 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
e0e7f86f82
some bugfixes for the peer-ping process
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4885 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
b21598bdd0
- enhanced handling of own IP address inside seed
...
- prevention of false information of own IP address
- enabled searching before an own IP address is assigned (before first ping happened)
- removed warning about limited search function
- added better time-out settings for peer-ping process (10 seconds complete, 5 seconds for back-ping)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4883 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
40d7f485f3
- fixed several NPE bugs
...
- fixed loosing of own seed hash (hopefully)
- fixed a bug with crawl start s beginning with (bookmark) files
- added better IP recognition during hello process
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4882 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2f381b8d7a
- fixed at least two causes for a NPE after a use case switch.
...
A large refactoring was neccessary
- added another crawl start option: automatic restriction to sub-path
- removed crawlStartSimple and renamed crawl start expert
to crawl start (without expert)
- some changes to texts in crawl start
- added some more deletions when an web index is deleted:
delete also queues and robots cache
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4881 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
c5f4f518e2
YaCy-Ui: fixed reverse order display of search results...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4868 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
e9a3b0f3da
YaCy-Ui: fixed some bugs and updated to jQuery-ui 1.5b4
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4866 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
c80dc7e6b6
YaCy-UI: updated to jquery-1.2.6
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4865 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
64aaa81eda
YaCy-UI: updated to jquery-1.2.6
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4864 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
16f98e7a5f
YaCy-UI: introduction of modal window for edit bookmarks dialouge...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4863 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
17375a3d11
YaCy-UI: small fix for FF3 bug with pagination of search result
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4862 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
11e00a0849
- refactoring of seedURL handling
...
- additional check for seedURL pointing to localhost: deny such peers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4851 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
01b3e9431a
- fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1140&p=7626#p7626
...
- less dots for ppm bar in watchcrawler (one dot for each 10 ppm)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4846 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d8277e6af1
- added parsing of numeric html entities for crawler
...
- fixed a bug in search response
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4843 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
0c173821fd
more access security regarding database access and snippet retrieval: restrict number of results for not-authorized searchers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4838 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
e4d93599e6
- added another network definition for personal web portals (replacing robinson peers in freeworld) for default use case selection. This solves the problem that the public network freeworld can spoil the personal web index during configuration phase with index entries that the user does not want for his personal web portal
...
- changed network selection to new network 'webportal' in ConfigBasic servlet
- removed unused servlets from yacy/ui
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4837 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
53dfe9fe9a
added RECENT command for search query:
...
add RECENT (in uppercase letters) to the search words and results will be ordered by date (recent first)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4825 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
aa29a8c165
YaCy-UI: small optical changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4822 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
f494d944fd
YaCy-UI: basic support for searching bookmark tags...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4821 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
c8c93c198b
ywidget: added img file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4820 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
9b686fed35
ywidget: added config form (currently not functinoal)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4819 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
b5faea410b
ywidget: added footer and small optical changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4818 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
ecc11da8ac
moved styles to ywidget.css
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4817 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
4e0f031722
small feature fix that limited ywidget to 5 rss items
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4816 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
125b28622f
needed for ywidget
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4815 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
1019fd91c0
- added /yacy/ui/ywidget.html
...
- it can be used with all yacy search parameters?search=yacy;contentdom=text;count=40;offset=0
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4814 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3aa69dab94
prevent too high search request frequency submitted from the same peer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4813 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
cfe6790498
- added option to switch between yacy networks, especially between the two default networks (freeworld and intranet),
...
from the ConfigNetwork online interface
- to make this possible, a large refactoring and reorganisation of data structures was necessary
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4803 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
7429687601
small bug fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4802 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
c689d6f061
YaCy-UI now supports searching Sciencenet...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4801 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
37505c0665
implemented ynetSearch.java to allow ajax cross domain search (e.g. sciencenet) for YaCy-UI...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4800 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
db032fb6de
- added RWI transmissions to the event terminal
...
- fixed bug in Collage
- added 'embedded mode' to collage
- integrated Collage to terminal_p as iframe in embedded mode (Pictures now visible in terminal_p)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4797 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
0f7449840e
- minor changes on YaCy-UI
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4792 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
bbda1a45a9
- added box800.png (quick resize of box600, needs to be fine tuned)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4785 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
fa3ed2888d
- bookmarks are now retrieved from /xml/bookmarks/xbel/xbel.xml and do no longer require a seperate servlet
...
- minor bug fixes
- refactoring (obsolete items)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4783 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
9bc56a9edc
xss protection
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4772 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
b32736762c
enhanced rssTerminal
...
- 3 lines possible
- distinguishing of private and public data, if not authorized only public data is shown
- shows now more events, including local searches in clear text if user is logged in
- simplyfied peer events
- better recognition of 'real' new peers
- presentation of peer pings from other peers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4771 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
1689030ee8
refactoring: moved all crawler classes into their own package
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4768 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d2ba1fd2ab
major step forward to network switching (target is easy switch to intranet or other networks .. and back)
...
This change is inspired by the need to see a network connected to the index it creates in a indexing team.
It is not possible to divide the network and the index. Therefore all control files for the network was moved to the network within the INDEX/<network-name> subfolder.
The remaining YACYDB is superfluous and can be deleted.
The yacyDB and yacyNews data structures are now part of plasmaWordIndex. Therefore all methods, using static access to yacySeedDB had to be rewritten. A special problem had been all the port forwarding methods which had been tightly mixed with seed construction. It was not possible to move the port forwarding functions to the place, meaning and usage of plasmaWordIndex. Therefore the port forwarding had been deleted (I guess nobody used it and it can be simulated by methods outside of YaCy).
The mySeed.txt is automatically moved to the current network position. A new effect causes that every network will create a different local seed file, which is ok, since the seed identifies the peer only against the network (it is the purpose of the seed hash to give a peer a location within the DHT).
No other functional change has been made. The next steps to enable network switcing are:
- shift of crawler tables from PLASMADB into the network (crawls are also network-specific)
- possibly shift of plasmaWordIndex code into yacy package (index management is network-specific)
- servlet to switch networks
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4765 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
d4bce6affd
refactoring (initialized static fields, removed empty if/else, serialized some fields in serializable classes)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4755 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
483e9a2066
- shifted tld recognition methods from yacyURL to serverDomains
...
- changed isLocal Property in such a way that it is possible to see if a domain is in the internet (and not intranet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4751 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d0b893523e
- protection against RAM overflow caused by new peer rss news
...
- more XSS protection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4742 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9935e83c86
added new news window into the status page. At this moment it is just a test.
...
The news inside the window are about peer arrivals and departures, remote search accesses and crawls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4739 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
e024e3b9cf
added new default profiles to distinguish snippet fetch for local and global search
...
the difference is, that a local search will no not cause a re-indexing of loaded pages
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4731 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5e3ce46339
- better logging when rejecting a url because it is not in declared domain
...
- more XSS attack protection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4720 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
2149728227
- major rework on YaCy-UI
...
- search results are retrieved from rss/xml, no other servlet needed
- added double accordion sidebar menus
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4718 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
512f48e7d6
- removed unused methods
...
- fixed xss attack on peer list in CrawlStartSimple
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4714 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
14384e7a45
deactivated unnecessary and very CPU-intensive deletion check for blacklisted URLs in index receive
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4713 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9a32a4c328
fixed concurrentModificationException during hello-process
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4693 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
117ae78001
speed enhancement for reading of eco-table indexes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4647 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
5c3c1fdf41
replaced httpc with Apache Jakarta Commons HttpClient (includes some refactoring ;)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4640 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
7f9f639d20
- refactoring and abstraction of index reference (urls) handling: blacklisting is part of reference filtering
...
- refactoring of word/phrase handling: word abstraction from condenser becomes part of index element handling
- removed unused code parts from condenser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4603 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d6050b9ffb
- separated the LURL data storage and Crawl result stack for process supervision.
...
this is another step to enable multiple, concurrent fulltext-indexes
- another try to make the yacy-httpc more stable
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4602 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
541b817502
refactoring of switchboard queueing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4591 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
5fde618337
changed display of y-marks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4583 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
54cb097ea4
added .trigger("update") after paging
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4574 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
82f17ccee2
just an example sidebar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4573 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
3c710f22cd
added server side driven pagination for search tabs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4572 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
368b8735b5
added 'close tab' function
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4560 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago