orbiter
c4bdb1e7f2
added one more option in ViewFile to show an iframe like for the orginal web page content but using the cache than the direct link to the content in the web. Upgraded the very old and previously not any more used CacheResource_p servlet to a new and working version.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6719 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
c09a995930
better logging of double occurrences of urls in the crawler
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6718 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1bbe14d23f
SVN 6716 unfortunately contained parts of the unfinished SMB integration. To fix compile errors the remaining parts of the SMB implementation stub is added with this commit.
...
This adds the jcifs smb library.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6717 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
884b262130
- added a new Wiki Namespace Navigator
...
- some redesign of Navigator data structures
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6716 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b0c6d0108b
fix for select-all toggle in tables servlet
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6715 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
617dfbbd06
allo 'authorization by encoded password' also if requesting client is not from localhost but from the same host as yacy is running on.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6714 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
270fb38674
- fixed some bugs in Table viewer
...
- added 'select all' feature in Tables_p
- enhanced ViewFile.html: has now an input field to load arbitrary resources from the web and analyze them (!!!)
- included the ViewFile servlet into the Index Administration menu
- show in ViewFile if ressource is in url-db and/or in Web cache
- bugfixes to BEncodedHeap and Tables management
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6713 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
38d7a28cd2
fix in viewfile needed when ViewFile is called only with 'url' parameter
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6712 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
599c3766c4
added authentication to automated API call
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6711 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
727dd9b193
- fixed a bug in robots.txt parser
...
- moved storage of robots.txt entries to WorkTables, so it is now possible to browse the robots entries with the table browser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6710 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
54af9e6b49
- added parsing of robots meta-tag in html headers to detect a noindexing request
...
- added evaluation and indexing prevention in case that a noindexing is given in a html file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6709 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
f336ed568d
fir for parameters on reload
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6708 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
ddc21e7b73
adapted banner colors to current standard template
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6707 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
e76f1e6cc0
Update property name bookmarks to display_bookmarks (changed in SVN 5554) to fix the broken Bookmark RSS feed
...
- Fixes RSS part of http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1824
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6706 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
c52dec0c06
Updated German translation de.lng: Translated new entries in Network.html and Status_p.inc
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6705 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
cc074c1a36
Renamed, removed and added license information for each jar archive in external lib folder
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6704 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
8a19be24de
tell non-windows users about the tray-icon
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6703 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
f5ec7ad077
replaced four old libraries with latest version
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6702 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
6b89f681c5
added bing, dbpedia and wolfram alpha to the compare-search options
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6701 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
475ffabfa1
Added License (Apache 1.1) information for Jakarta ORO library 2.0.7 (2.0.8 available)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6700 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
46c4f8b68a
better look-ahead into the crawl queue: show more on crawl monitor
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6699 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4b6efe3b48
more ergonomic default values for crawl start
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6698 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
7b546415dc
added svn6695 for windows
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6697 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
f175f9a2d3
changed way how number of search requests are counted:
...
so far only search requests at the remote search interface had been counted.
This was done to protect the privacy of searchers, because counting was not done and published at the own search interface.
This caused that no search requests of robinson peers had been counted, becuase they cannot be counted at remote peer.
This change introduces a distinction of locally done search requests at the local search interface from search requests that are on the local interface but had been submitted from a remote IP without authentication.
Now 3 counters are maintained:
- partial count of remote searches
- total count of local searches on robinson peers from non-authenticated clients
- total count of local searches on robinson peers from localhost or authenticated clients
In the global statistic of search requests now the first two counters of the three cases are added
Because we habe a large number of robinson peers with a large number of remote non-authenticated requests the statistic should show at least three times of the number of search requests.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6696 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
84222e3b4f
fix for auto-updater: delete old libraries before copy of new one
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6695 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
sixcooler
cd6de83905
next try for for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2703
...
(reverted 6692)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6694 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
sixcooler
bfe4693e9a
fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2703
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6693 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
6fde481ef4
missing for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6692 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b68deb407a
- moved test data from /bin to /test/words
...
- refactoring of stopYACY.sh by introduction of /bin/apicall which is able to call any api file with attached authorization
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6691 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
cd7f0bf75f
wait a little bit longer for a init.d restart between stop and start
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6690 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
50169759ca
Replaced old pdfbox and fontbox LICENSE files with new ones (still Apache 2.0)
...
Testing delete and adding files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6689 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1e2c011c98
updated the jsch lib from 0.1.21 to 0.1.42
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6688 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
c2b505ae87
updated bouncy castle libraries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6687 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
681f4d185f
replaced microsoft office document parser POI 3.5 with latest version 3.6
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6686 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
e9cdddcd0f
updated parser libraries fontbox and pdfbox with latest version of jar files
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6685 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
93b7ddc27d
fix for http://forum.yacy-websuche.de/viewtopic.php?p=19376#p19376
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6684 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
3df1060015
jre update für installer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6683 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
7d569ce735
Updated German translation de.lng: Translated new buttons in Table_API_p.html
...
Updated French translation fr.lng: cleaned up syntax and added a few lines
Updated Italian translation it.lng: cleaned up syntax
Updated Slovakian translation sk.lng: cleaned up syntax
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6682 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
23bf81d225
new buttons to select/deselect all entries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6681 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
8030ed3319
self-healing for lost crawl profile handles
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6680 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
881a1065ce
version number step to 0.94
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6679 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
e3e5e05ec2
fix for problem in ranking setting which was caused by the introduction of a toString() method in serverObjects
...
see also: http://forum.yacy-websuche.de/viewtopic.php?p=19310#p19310
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6678 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
e3ccfb54aa
fix for display problem in Firefox on MacOS X
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6677 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
07fc76a45e
Updated German translation: - Forgot kiosk mode in index.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6676 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
564927ce72
redesign of CrawlResult data structures because of OOM occurrences during URL deletion processes.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6675 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
bab0438fee
Updated German translation: - kiosk mode and some corrections
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6674 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
30c8185139
fix for sid check
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6673 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
ef62d017e5
integrated session id filtering for crawler
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6672 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
d8d9984913
added framework for session id filtering (not ready yet)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6671 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
2bc36de336
- fix for bug in svn 6669
...
- cleanup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6670 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago