orbiter
cd41e9a0eb
moved DHT index selection to new object that holds indexes to be send away to other peer.
...
This was made to make it possible that RWI selections can be serialized with indexing.
Serialization will be implemented in another step.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1698 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
e3dd67bba0
bookmarks import.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1697 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
dda143df79
We NEED this here for the XML-Files
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1696 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
42a5f56723
*) Bugfix for broken dht thread configuration
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1695 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
91b78d9f04
missing File for IndexCreate
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1694 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
bfd37e34aa
using other XML Parser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1693 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
aa87df35e1
*) To avoid confusion location will now also be displayed for own peer
...
See: http://www.yacy-forum.de/viewtopic.php?p=17283#17283
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1692 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
851493624f
MIME-Type setzen
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1691 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
15ed57f9b7
Updated German language, by VT100, NN, rramthun
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1690 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
62664d7252
AJAX Check for robots.txt before crawling.
...
Icons from herrlich
TODO: Style it nicely ;-)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1689 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
0b5a736280
bugfix for nullpointer on unparsable date.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1688 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
cf0993f516
added newline after excluded stopwords
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1687 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
f503df04f8
sort the Bookmarks with newest First.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1686 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
3b4a99ff6a
fix for java 1.4.x
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1685 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
1d14958417
*) added link to profile of peer that sent a message (requested in http://www.yacy-forum.de/viewtopic.php?t=1957 )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1684 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
8cf55537d7
*) changed name of COPYING and removed email address as suggested in the forum
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1683 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
d884796c7f
*) new bookmark icons and file COPYING added
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1682 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
3dbaca03c7
*) correcting classpath for target compileHtdocsWWW
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1681 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
651bce8e2f
*) adding missing function to transmit url chunks for crawl-order jobs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1680 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f95d98142f
*) displaying amount of items in the existsIndex caches
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1679 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
9b941fb773
*) bugfix for usage of yacy with extended port binding (e.g. #eth0:8080, 192.168.0.1:8080, etc.)
...
- port was reported incorrectly to other peers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1678 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
26d7e8dd0d
more escapes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1677 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
2d4e1325cf
UTF-8 fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1676 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a4b3981f33
all queues on WatchCrawler.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1675 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
127396436f
more queues in the xml backend
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1674 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
e2af2a3f45
*) it's now possible to run more then one indexDistribution-Thread
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1673 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
4fe572164c
My punishment for criticizing theli ;-)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1672 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
40dd6ec4fd
*) experimental restructuring of db import function
...
- trying to reduce IO load by avoiding unnecessary db access
- trying to presort url list
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1671 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
0b9f2d785d
*) showing RemoteCrawlJobQueue and RemoteCrawlTriggerQueue in status table
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1670 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
c8f5adea4d
- don't send Message Body on HEAD requests, even in the case of an error
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1669 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a7248fbb0a
*) bugfix for http/0.9 responses
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1668 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
2da18ab359
*) correcting logging output
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1667 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a354bc2ec1
*) Bugfix for content length check
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1666 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8ffc6e35ad
*) correcting logging output
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1665 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
e974d0cb99
Improve compliance to rfc
...
*) There is no status line in HTTP/0.9
*) Answers to HEAD requests should return the same headers as a GET request
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1664 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
556d242be0
*) Limited support of content-range requests
...
- a simple continue download request should work now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1663 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8fcb25f9f9
*) Setting via header according to rfc
...
- can be disabled via settings dialog
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1662 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
7a5af1e4df
*) adding target that can be used to compile userspecific servlets located in htroot/www
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1661 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
980e986b64
*) Re enabling short cycle for already removed nurl entries
...
See: http://www.yacy-forum.de/viewtopic.php?p=17147#17147
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1660 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
daburna
7e02f470ad
migrate translation for bookmarks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1659 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
218cd6561c
fixed problem with wrong hash length in file share
...
see: http://www.yacy-forum.de/viewtopic.php?p=16565#16565
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1658 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
56516fd8e6
added refresh parser to htmlFilterContentScraper
...
* getRefreshSeconds() - number of seconds until refresh
* getRefreshPath() - url path
See also: http://www.yacy-forum.de/viewtopic.php?p=16851#16851
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1657 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ba5fe0b287
fixed (again) nullPointerException in kelondroTree
...
see: http://www.yacy-forum.de/viewtopic.php?p=17091#17091
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1656 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
4ceea34187
Fix for http://www.yacy-forum.de/viewtopic.php?p=16964#16964
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1655 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
99a970eda1
xml backend with verifyAuthentication
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1652 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
e6c2f700b1
public Tagview
...
IMPORTANT: Fix for new(empty) Tags when adding/editing bookmarks.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1651 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
910a709d3f
show number of bookmarks in a tag.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1650 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
672b384fc7
refactoring setTagsTable and setBookmarksTable.
...
preparation for remote Bookmarks. (and Bookmark/Tag Object, which do not interfere with local bookmarks/tags)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1649 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
040624e361
*) better support for http head requests of servlets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1648 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
daburna
deece1e6d5
updated language file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1647 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago