orbiter
eda055e729
- enhanced kelondroCollection speed
...
- tested + debugged kelondroCollection
- inserted the new kelondroCollection Object as indexing class for kelondroFlexTable
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2183 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5d2cd26529
enhanced kelondroCollection performance
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2182 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
5625937d1c
Language improvements
...
One very minor HTML fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2181 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
577a6e6487
some work on kelondroCollection, no effect on current YaCy functions
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2180 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2185a5cfb7
prevention of possible ConcurrentModificationException
...
This happend at my peer and created a deadlock.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2179 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
71228cfc56
*)added ip to Blog.xml
...
*)added possibility to import Blog.xml-files
*)included german translation for new Blog-features
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2178 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b30645305b
some additions to kelondroCollection
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2172 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
370c481fa7
bugfixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2171 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
26b6cddf51
synchronized the DNS cache, because the non-synchronized version resulted in deadlocks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2168 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c36e9fc8d3
full integration of kelondroRow
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2167 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
6e49721762
completed and tested kelondroFlexTable
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2166 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b68f7dec9d
added stub of new table class
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2165 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b21824ef16
added new array interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2164 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c75cacda95
added a flex-width-array: this is a table where it is
...
possible to add columns to an existing table
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2163 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4a907a570f
1st step to migrate kelondroTree to usage of kelondroRow instead of byte[][]
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2162 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
572d53506c
new kelondroRow objects now replace byte[][] objects in object cache
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2161 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
09f780df27
more bugfixes for the new row/stack handling changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2160 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
89424ff122
multiple bugfixes for new stack/row features
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2159 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3c3c047d0a
integrated kelondroRow into kelondroStack
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2156 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5bb565944f
integration of new kelondroRow into some parts of kelondro,
...
especially into the array storage
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2155 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d580f582dc
update to row/column handling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2154 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
eaa6f012f0
refactoring: better naming for classic DB (files in WORDS)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2151 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5041d330ce
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2150 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7b3b12888c
refactoring: integrated indexContainer abstraction layer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2149 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
cb295fbbdc
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2147 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
bc94a714b2
Better explanation for the auto-dom-filter.
...
Some javadoc.
Small change to DetailedSearch.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2146 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
28ff7ec214
added missing file from last refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2145 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
196b8abb30
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2144 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
24686e50a2
- fixed a caching bug
...
- added counter for cache delete to distinguish between flush and delete
- changed some default paramenters for cache size settings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2143 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
b48327904a
Don't disconnect peers that report 'busy' during index transfer.
...
These peers are already being marked as not accepting remote index transmissions by yacyClient.transferIndex. That should by enough to prevent further transfer attempts until newer seed information is received.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2142 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
899c1a5df5
integrated cell-, and row-management classes
...
this will be used for automatic export features
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2141 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4d8f8ba384
added cache-performance analysis for node caches
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2140 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a520ab2e8c
*) adding possibility to use an existing PKCS12 certificate for https
...
instead of creating a new one.
Notes:
This import is done automatically on startup if the following properties
are set in the config file:
pkcs12ImportFile =
pkcs12ImportPwd =
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2139 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
c5c5c166f0
*) fix for javadoc generation
...
See: http://www.yacy-forum.de/viewtopic.php?p=21884
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2138 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1b4a27cd99
added monitoring for new miss-cache
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2137 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bd057b44dd
- automatic setting of peer-does-not-accept-remote-crawl
...
- increased percentage of object cache to node cache to 30%
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2136 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
912116c5a7
renew cache update time if a cache-read hit happens
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2135 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
81e79f2caf
fixed new cache behaviour changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2134 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
545f81b317
bugfix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2133 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
cda087f43b
- integrated cache miss storage into object cache
...
- removed cache-miss handling from indexURL
todo: new Monitoring in PerformanceMemory_p
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2132 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
757ec28430
refactoring: better data capsulation for indexURL
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2131 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
61078b3885
*) adding support for delayed shutdown
...
- needed by Ismael to receive the Steering page properly on shutdown
- now the steering page should always be displayed properly in the web browser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2129 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8b7626f8d1
*) Automatic redirection of browser if user changes port settings in ConfigBasic
...
See: http://www.yacy-forum.de/viewtopic.php?t=2415
*) If ssl is available, the browser conntects to yacy via https on yacy startup
See: http://www.yacy-forum.de/viewtopic.php?p=21649#21649
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2127 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
e7199c6c7e
*)fixed "Umlaute"-Bug in Blog
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2125 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
af098b815c
- fix for blog/wiki error
...
- re-enabled new map writing methods
see http://www.yacy-forum.de/viewtopic.php?p=21729#21729
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2124 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
90d569d70f
refactoring of index management:
...
url storage is part of index management; moved plasmaURL to indexURL
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2122 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a930be4ba3
refactoring of index management:
...
generalized the index entry
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2121 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
634543121b
added debug message
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2120 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
74a78ebd78
turned back handling of map-writing into kelondro because of possible bug for testing
...
see http://www.yacy-forum.de/viewtopic.php?p=21560#21560
please re-test
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2119 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e656a00b74
removed some unused methods
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2118 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
232ab7902b
*)catched Null-Pointer-Exception
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2117 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
82b2bc6932
patch for index-transfer DoS problem
...
see http://www.yacy-forum.de/viewtopic.php?p=21627#21627
note that this function will make the index-transfer functionality void
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2114 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
df7e1d9df3
Changes to plasmaURL and subclasses:
...
- Improve performance of plasmaURL.exists() by remembering URL-hashes that are not present
- Use a more realistic estimation of memory usage by the existsIndex cache
- Routine cleanup of the existsIndex to limit its memory usage
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2113 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a474669338
start with refactoring of index management
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2110 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
338047e056
replaced kelondroDyn write methods for properties and maps by faster version
...
this affects news, robots?, bookmarks?, blogs, the wiki, seed-db, news etc.
this all should create less IO
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2107 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b40f0edbe5
replaced property- and map-reader in AbstractRA by much faster version
...
this has very strong effects of to all methods that read maps
from kelondroDyn databases, i.e. news, seeds (bookmarks?)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2106 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7f28a1a4cb
another fix in kelondroDyn: construction of getDyn chunks was not clean
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2105 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bb931c7b83
fix for some improper details in kelondroDyn
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2104 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
19c6e67003
- added generation of news for blog entries
...
- added display of blog banner in Network view
- extended lifetime of blog, wiki and crawl news
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2102 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
f08e33680c
Added Blog-news-symbol as requested.
...
I think I will change the character distance a little bit later.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2101 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b4ab183518
*) Bugfix for NullpointerException if the seeds IP could not be resolved
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2099 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f331def5d8
*) Bugfix for distribution. Incorrect behavior if peerCount == selectedCount
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2098 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
cea6e416d9
*) wrong name in header
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2097 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
df068cf23c
*) adding first version of native SSL support for yacy
...
VERY EXPERIMENTAL!
See: http://www.yacy-forum.de/viewtopic.php?p=18516
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2096 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
55ea4cbfe6
*)reverted patch for memory-display issue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2095 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
5048b05bc6
*) Index Transfer should only restart at the beginning if the delete
...
option is configured. Otherwise we have an endless loop
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2092 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
53d9ab6db7
*)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers
...
see http://www.yacy-forum.de/viewtopic.php?t=2370
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2091 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
ddfe0f0e27
*) don't try to parse referer string if it's null
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2090 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
bcc950c533
*) Bugfix for Index Transfer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2088 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
99110e6fd2
Fixed some of the copyright headers.
...
Please add yourself, if you contributed to these files, and i forgot you. ;-)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2086 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a1ba7fab69
bugfix for proxy users
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2085 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d4b4812732
extended kelondroDyn with new objectBuffer
...
(there was a buffer inside some commits before, which has
been removed and is now replaced by this new one)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2084 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
586b256627
*)fixed Blog-bug with german Umlaute
...
*)corrected wrong html in blog
see http://www.yacy-forum.de/viewtopic.php?t=2330
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2083 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
9938c252dd
better Errorhandling for proxyAccounts
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2082 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
35995cf8c7
some enhancements to caching and kelondroRA-methods
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2081 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2e89477f22
undoing last change
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2080 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a3a4525931
usage of a buffer to prevent too many cache lookups in kelondroMap
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2079 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
015d044c25
tried to fix some problems with latest changes to httpc
...
very experimental!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2078 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
55c5b41bd0
modified kelondroDyn to work better with new object caches
...
(removed own single object cache)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2077 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
26e3216bcc
update to profile fetch behavior
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2076 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3e31820c3d
- corrections to PerformanceMemory display of object cache
...
- configuration of object cache size in kelondroTree initializer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2075 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fd7c17e624
added virtual host support:
...
all yacy-to-yacy communication now send the <peer-hexhash>.yacyh
virtual domain inside the http 'Host' property field.
This shall enable running a yacy peer on a virtual host.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2074 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
461548698c
configuration of index transfer chunk size
...
see http://www.yacy-forum.de/viewtopic.php?p=20951#20951
new properties in yacy.init:
indexDistribution.minChunkSize = 5
indexDistribution.maxChunkSize = 1000
indexDistribution.startChunkSize = 50
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2073 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
29b1b0823c
added monitoring of new object cache to performanceMemory page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2072 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
23ced30e83
fixed a bug in new caching
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2071 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
35f9418117
Fixed links and images. ( http://www.yacy-forum.de/viewtopic.php?p=20908#20908 )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2070 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bab9ee38e7
added very experimental object cache for all kelondroTree
...
databases. This cache now takes up 10% of all cache sizes,
90% goes to the node routing cache we had so far.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2069 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
9104001e7c
*) Better error handling for assortment import
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2067 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
d40ccc5208
*) Partly undoing last commit\n*) Fixed bug that caused attributes of cells in tables not to be recognized as such.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2066 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
adcad5eae6
*) Fixed a bug that prevented the usage of tables in the wiki.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2065 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
51e3bb576f
Don't increase dhtTransferIndexCount when the last transferred index was smaller
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2064 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
152745b145
*) Added some characters and their HTML-codes.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2060 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
a0ca4c5fb8
Remove a possible race condition between DHT transfer and deQueue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2059 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
0cfba8950f
Removing unnecessary and possibly dangerous synchronization of the wordIndex
...
when deleting transferred indexes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2058 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fe4ad214f1
configuration of time-out for fetching seed-lists during bootstraping
...
(weil das beim linuxtag nur auf meinem Notebook nicht funtioniert)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2054 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
1179c9ffff
fix for the bookmark error.
...
fixes: http://www.yacy-forum.de/viewtopic.php?t=2274
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2043 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d6213f8a85
quickfix for http://www.yacy-forum.de/viewtopic.php?p=19482#19482
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2042 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e9aadb2e11
quickfix for http://www.yacy-forum.de/viewtopic.php?p=19765#19765
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2041 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
727aac4768
*) Bugfix for Transparent-Proxy-Support <-> Port Forwarding problem
...
See: http://www.yacy-forum.de/viewtopic.php?p=20358
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2039 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
cd4aeffea2
*) Bugfix: httpdFileHandler.java did not handle filenames with encoded chars correctly
...
See: http://www.yacy-forum.de/viewtopic.php?t=2265
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2036 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a10072b5c0
*) Adding timeout to ftpc.java
...
See: http://www.yacy-forum.de/viewtopic.php?t=2268
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2035 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
76ea16a6cb
*) Removing Keep-Alive header (is also a hopByHop header)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2034 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b0036249c1
added some attributes to network picture
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2032 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
cbcf7418ef
Cleanup synchronization in plasmaWordIndex
...
- only synchronize when changing data in more than one database
see: http://www.yacy-forum.de/viewtopic.php?t=2167
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2031 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
60e5aff9fc
some enhancements to the remote crawl trigger
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2030 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
dbe96e6541
added hand-over of search filter and prefer ranking to yacy protocol
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2029 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
0604203bce
Updated and corrected German language file
...
Changed Italian language file for an Italian/English interface and not Italian/German
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2024 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
4639c0ac6d
*) cleaned up code
...
*) fixed a bug where a line like <pre><pre>text</pre></pre><pre>text</pre> caused an exception
*) fixed a bug where a line like [=[=text=]=][=text=] caused an exception
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2023 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
00a5d435e2
- fixed some bugs with domain filter
...
- added new ranking filter "prefermask": urls that match the filter are ranked better
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2022 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
14d6e476c9
tried to solve some problems with new picture viewer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2019 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
23cdf319be
*) cleaning up code
...
*) fixed a bug concerning [= =] and <pre></pre> in tables
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2018 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
9324425165
fix for remote crawl reject
...
see http://www.yacy-forum.de/viewtopic.php?p=20075#20075
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2017 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
30e4fc39a5
HTCache extended
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2015 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d0dd8b14d2
fixed picture tag and presentation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2014 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
da6a8bafa2
rename currCacheSize -> curCacheSize;
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2010 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
92110aea32
nullpointer fix for profile(); other minor change;
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2009 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f0833b0328
introduced simple search interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2007 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bd283b8443
fixed bugs:
...
- null pointer exception during startup of a robinson-configured peer
- wrong time calculation of default value of re-crawl option
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2005 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
47b541b2d1
added better option handling in yacysearch
...
added depth option for image presentation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2001 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c9e16bfd48
first try to insert image search (does not work yet)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2000 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f77775220b
fixed parser error
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1999 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
0bf2eb4813
*) fixed Blog updating timestamp on edit (now always keeps creation-date)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1997 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
22de954a57
added some log output to parser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1996 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
83e0e765ec
redesigned some parts of the html scanner & parser
...
to better support image tags
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1995 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ac114d69c0
tried to fix some problems with time-outs during search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1994 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e2e8d0c188
some kind of refactoring of yacysearch:
...
made 'room' for new picture search result presentation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1993 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
6b63e26cbb
- removed search function from index.html/java, only imput left
...
- added media fetcher/crawler class (not ready yet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1992 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bc3e80fe42
quickfix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1990 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d8d0ac29c3
added image-viewer servlet that can do:
...
- each image that is requested is stored in the cache
- the image is taken from the cache if exists there
- the image can be scaled
The purpose of creation a scaled image is because of copyright problems
In a further stept the retrieval of not-shrinked images is restricted
to either access from localhost or with given authentication
This servlet can be used for image-preview purpose after an image search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1989 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ddc6394d9b
fixed bug about auto-depth 0
...
see http://www.yacy-forum.de/viewtopic.php?p=19751#19751
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1988 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
60351fa3f7
small fix to previous commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1987 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a469874e3f
added and fixed time-out behaviour during search
...
see also: http://www.yacy-forum.de/viewtopic.php?p=19823#19823
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1986 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1d0b0d6e2a
synchronized local searched to prevent that several searches are performed at the same time
...
see also: http://www.yacy-forum.de/viewtopic.php?p=19761#19761
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1985 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
22b9d03bbf
Correcting remaining time issue in getContainers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1984 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5defe97ccb
fixed a problem / possible bug with ordering implementation (did not rotate always)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1983 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d58788b753
added some synchronisation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1982 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e566d1d8d6
some bugfixes regarding new crawling options
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1980 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c7f1300300
-fixes for last commit
...
-some more ranking attributes (comments only)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1979 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f2421f6a47
some small attribut changes regarding cache flush
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1974 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7a650d0023
several bugfixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1971 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
245cc34d51
small fix for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1969 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
e2853f357d
added more lowercase to url normal form generation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1968 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
59d52fb4a9
fixed some problems with crawl profiles
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1967 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4a5b5515b5
added a lowercase to url normal form generation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1966 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
44d72f06c4
more Caching
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1965 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
918445a2f4
Bugfix for last commit.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1964 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
708cc6c8d9
fixed some bugs for auto-filter and added monitor in profile list
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1959 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
c58789177f
bookmarkCache
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1956 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
250864406f
...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1955 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
42b0b10a95
-Adding Windows Media to types which are not sended compressed
...
-Renaming writeandzip to writeandgzip to avoid confusion about type of compression
-Adding new startup message to windows script
-The usual language "enhancements" ;-)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1953 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
2ed4fa96b7
tagCache
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1952 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
330eb9c74f
bookmarkDB cleanup
...
(preparation for tagCache)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1951 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e82899ba57
fixed missing urls map initializer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1950 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
63f39ac7b5
added 3 new crawling steering options:
...
- re-crawl by age of page (enter in minutes)
- auto-domain-filter
- maximum number of pages per domain
NOT YET TESTED!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1949 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1fc3b34be6
some pre-work (without function yet) to implement:
...
- re-crawl (by age of last crawl)
- auto-crawl-filter by crawl depth (to be explained..)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1948 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
c9e6b5e391
*) check size of indexing-queue and crawler pool before processing remote triggered crawl jobs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1946 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1509314ea6
set tighter control during DHT index and peer selection
...
see http://www.yacy-forum.de/viewtopic.php?p=19329#19329
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1945 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
fcc0683200
*) undoing last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1944 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
9411961eec
*) another little fix for DHT-Transfer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1943 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
77f3237de3
adapted for isListed()
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1942 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
8b14a0c833
*) little fix for DHT-Transfer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1941 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1f4412a146
adopted isListed to discussed new behavior as discussed (url, getFile)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1940 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
59fc55ea1e
added checks to protect peers from wrong seeds
...
see also: http://www.yacy-forum.de/viewtopic.php?p=19249#19249
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1939 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
063ef4660a
bug?
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1936 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
82358677a9
added another shiftK2W to flushCacheSome
...
this should fix the bug that the DHT cache is not flushed if there is no indexing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1935 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
128e4ab199
- in serverSystem: maxPathLength is now a variable, not a method
...
- upon startup the calculated maximum path length is shown
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1932 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a37b09e303
implemented automatic adoption of chunk-read-ahead in kelondroTree to needed chunk size
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1931 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
30e3e3a0fd
adopted MAXPATHLENGTH to host system capabilities
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1930 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
d808765087
something Javadoc
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1929 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
85bb8e32a1
Bugfix for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1928 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
3fe402069f
try to fix
...
see: http://www.yacy-forum.de/viewtopic.php?p=19175#19175
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1927 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f16f1f15cd
bugfix for 100% CPU bug; thanks to Matthias for analysis
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1926 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
254a13efd9
MAXPATHLENGTH used
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1925 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
8865948e4e
Cleanup;
...
Methode replaceRegex added;
Constant MAXPATHLENGTH added;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1923 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
6c70f4a0cf
renamed wordHashes for a word hash set generation to wordHashSet
...
This was done because the wordHashes iterator will get another integer
parameter and then conflicts with the wordHashes set generation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1921 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d5f8f40c31
removed correcting iterator
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1920 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
526407f32e
adoptions, fixes for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1919 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
488a0ed580
replaced old keyIterator and rowIterator by buffered iterators
...
that are synchronized with database access
Main change is done in kelondroTree, other classes are only adoptions
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1918 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
4e9a8f41fd
rwiDBCleaner + dbImporter: Iterate over small excerpts of
...
word hashes instead of the whole DB especially while changing
the DB in the process.
see http://www.yacy-forum.de/viewtopic.php?p=19136#19136
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1917 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
474379ae63
remove TABs from plasmaDbImporter.java
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1916 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
dba02f399f
starting of re-design of kelondroTree iterator
...
- new access to iterator
- added many IOException handling in other Classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1914 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f02b426073
made kelondroTree.nodeIterator private
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1910 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
5f6fdf1786
Bugfix for getCachePath(URL url)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1909 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
303b6463a8
added debug line to URL storage for testing
...
see http://www.yacy-forum.de/viewtopic.php?p=19129#19129
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1908 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
431a4f3609
eliminated correcting iterator in kelondroTree
...
VERY EXPERIMENTAL! NOT TESTED!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1907 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
91dca2cd8d
fixed a bug in last commit: LURL entries cannot be written,
...
because a stored property was not set to false (but true)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1906 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3286b1f498
re-organisation of lurl-creation and -stacking
...
this was necessary to prevent useless write to the database
in case of blacklist appearance of the url
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1905 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
9cca36a107
no more strict comparator checking in map exclude method if not needed
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1901 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0b903c5317
removed usage of kelondroNaturalOrder from plasmaCondenser to experimental
...
exclude cause of a 100% bug.
see http://www.yacy-forum.de/viewtopic.php?p=19076#19076
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1900 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4239db0d1c
fixed new ordering for backup iterator TreeSet
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1899 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
399538b7de
Bugfix: wrongly compared
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1898 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
33eba5ecb8
temporary disabling last change, does not work (cannot debug right now)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1896 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f0464042fc
fix for latest iterator-replacement-fix:
...
iterator generated TreeSet which did not resprect rotations
this has now be implemented using kelondroOrder Objects
and by adding this rotation-rules to the ording
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1895 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
ec21c585cb
try to fix path too long
...
see http://www.yacy-forum.de/viewtopic.php?p=19079
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1893 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a6a3f4b694
fix for svn 1888
...
this is a redesign of the no-iterator solution
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1892 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
8da13088e9
*)removed multiple DHT_Distribution_Threads
...
*)boosted DHT_Distribution sending chunk parallel to multiple peers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1890 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
283a7181c6
try to fix new 100% cpu bug, possibly caused by iterator method
...
see http://www.yacy-forum.de/viewtopic.php?p=18900#18900
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1888 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
34c075c1c7
testcommit with subversive
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1886 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f588c0724f
removed cache flush in case of DHT receive
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1885 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e94b374d56
update to cache flush method
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1884 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bcd99fe83e
introduced a second RAM cache for DHT transfer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1880 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
360a460da8
*)URL-Cleaner: moved logging-statement to correct position
...
*)plasmaURLPattern: host is now added to the hashset in lowercase
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1879 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
02f9765013
quickfix for time problem during cache restore
...
see http://www.yacy-forum.de/viewtopic.php?p=18810#18810
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1878 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
69d26045eb
quick-fix for http://www.yacy-forum.de/viewtopic.php?p=18805#18805
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1876 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
b3df5ce2b8
another local iprange
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1875 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
ad119f06af
*) Don't overwrite new entries with older ones
...
see: http://www.yacy-forum.de/viewtopic.php?t=2015
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1874 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
be88687d8c
fixed some problems with new cache flush karenz
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1873 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
d3da7c9a08
*) Adding support for robots Allow directive
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1872 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
734d18f283
*) more correct robots.txt validation
...
- isDisallowed now uses getFile instead of getPath
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1870 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
f046e1814a
*fix or last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1869 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
c55c51e2a8
*)added keywords to IndexCleaner_p.java
...
*)updated Logging
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1868 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f0ad0d2b2b
*) better robots.txt support
...
- previously rules for all crawlers and special rules for yacy where
combined using AND. Now the general rule will be ignored if there is
a special rule for yacy (according to rfc)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1867 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ddbeda738e
added minimum age of word in cache to performance menu
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1866 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f188611fc6
apply blacklist on rwis during dht receive
...
very experimental!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1865 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
915812f597
*) Undoing robots parser policy changes from svn rev. 1421
...
- crawling is not allowed if server returned a 403 statuscode (according to rfc)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1864 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0ec28b8f8e
added DBCleaner from Hydrox
...
see http://www.yacy-forum.de/viewtopic.php?p=18093#18093
The servlet is now named IndexCleaner_p.
See http://localhost:8080/IndexCleaner_p.html
The Servlet was adopted to fit in the overall architecture
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1863 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
5ee0125046
*) adding possibility to configure the server port for seed uploading via scp.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1861 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
2065138a41
reverted last Commit.
...
@Orbiter: kannst du dich dann mal drum kümmern, wenn ich versuche die ganze Sache ans Laufen zu bringen, hast du jedesmal was dagegen. Dann mach du es bitte, du wirst ja wissen was du willst...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1860 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
7afa5c1b8e
staticIP fix
...
tried to solve http://www.yacy-forum.de/viewtopic.php?p=18663#18663
D 2006/03/08 07:08:20 YACY yacyClient.publishMySeed mySeed error - not proper: IP is not proper: -UNRESOLVED_PATTERN-
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1859 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
fb4100d47b
*) undoing last commit.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1856 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a84cc71218
*) removing getTotalRuntime
...
- not needed anymore
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1855 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
1965a8cf70
*) bugfix for previous commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1853 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
1c3b415c35
*) nicer anchors (TOC)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1852 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
6000a38a05
*) changed anchors (TOC) according to thelis request in http://www.yacy-forum.de/viewtopic.php?t=1987
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1851 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
dce08771d1
*) Fix for wrong estimated and elapsed times when import was paused
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1850 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
b34713324a
DBImport: remove words from source index even if nothing has been added to home index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1849 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3237fe1cc7
added IOException for httpc client error
...
see also http://www.yacy-forum.de/viewtopic.php?p=18615#18615
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1842 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
520b60f15b
fix for http://www.yacy-forum.de/viewtopic.php?p=18610#18610
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1841 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
c7ececbfb2
*) httpd.mime: adding jar mimetype
...
*) httpd.java: charset is only appended to mimetype for text mimetypes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1839 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ae536c4608
fixed soap service: index.soap -> yacysearch.soap
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1827 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bae3783d38
added a snippet marking
...
(search words are now bold in snippets)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1823 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f0a38873eb
* added yacysearch page with better view on search results
...
the old search page is obsolete and will be removed
* ConfigBasic.html is now the default page instead of index.html
as long as no password is set
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1815 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f0041d504d
remove of several results from a single domain is stopped if the result set is smaller than the wanted number of results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1811 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
b92a00172e
*) modified Blog
...
- added delete-option
- fixed displaying of admin options
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1805 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
68ec572df0
bugfix for staticIP
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1803 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
89286478e7
*) removing thread pool eviction for now. Not needed at the moment
...
See: http://www.yacy-forum.de/viewtopic.php?p=18290#18290
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1801 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
759800f543
*) Bugfix for storeHTCache problem
...
- content was not indexed if storeHTCache was off
See: http://www.yacy-forum.de/viewtopic.php?p=18269
See: http://www.yacy-forum.de/viewtopic.php?t=1882
See: http://www.yacy-forum.de/viewtopic.php?t=241
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1800 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a4682e2810
fixed problems in basic config and added language setting
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1799 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a8548c0484
* several bugfixes regarding basic configuration
...
* extended number of search target peers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1794 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1b9b8922d9
* fixed problems with new basic 1-2-3 configuration (now authentication required)
...
* fixed graphics problem
* fixed some other problems with default values
* 1-2-3 config now appears automatically on start-up if no password is set
* added new config menu
* moved profile to new config menu
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1792 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
8c6f38fe70
*) added Blog to YaCy (atm not reachable through interface) -> Blog.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1790 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c51603a405
added two new kelondro classes that will handle the new index data structures (not used yet)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1789 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ce5274c194
yacybot user agent
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1786 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
3b7e66ab48
staticIP should now work
...
(with resolved Conflict)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1785 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8558000bd9
*) better handling of port forwarding
...
- button is disabled if libx is not installed
- bugfix for disconnect
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1782 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
32d4c3e4c6
static IP is proper
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1779 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f96238e9be
cosmetic
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1778 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
d6cc0ec3d8
*) Fixed a bug: Images in tables were not displayed if alt or align attributes were added.
...
*) Align for images only accepts valid parameters (bottom, top, center, middle, left , right) now.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1775 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
351bd0a678
*) dbImport: convert cacheSize to kb when creating plasma* objects
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1773 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
eaffcfefe2
* added more ranking attributes (without function; this will be added later)
...
* added ranking coefficient transmission to remote peer (without evaluation on server side, will be added later)
* changed ranking coefficients slightly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1770 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
87e90b9d8c
refinements in ram cache flush procedure and default timing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1768 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d31a4e0b4f
some small enhancements with cache flushing parameters and data structures
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1767 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3703f76866
- fixed re-search bug: after a search with several words, a second search could not
...
find the same words as before. This was caused because indexContaines stored the url references
with a hashtable. A tree was needed to work with the index conjunction-by-numeration
- added permanent ram cache flush (again)
- removed direct flush of ram cache after a large container is added.
this happens especially during DHT transmission and therefore this fix should
speed up DHT transmission on server side.
- removed unused and out-dated methods
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1765 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
fbbbf5f411
*) remote trigger for proxy-crawl
...
- remote crawling can now be enabled for the proxy crawling profile
See: http://www.yacy-forum.de/viewtopic.php?p=17753#17753
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1758 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
f31b633b2e
*) Fixed yet another small bug in the wiki. (no blank between image URLs, align and alt)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1755 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
8bdbf0dfff
*) Fixed a bug in code for tables and hopefully eliminated XSS vulnarability which Allo pointed out to me.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1754 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
dc9174c809
*) Implementing snippet fetching via ajax
...
Snippets that are not available on page load time will be fetched using ajax requests.
see: http://www.yacy-forum.de/viewtopic.php?p=16479
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1748 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
468ca5b0e6
*) Bugfix for url.toString problem in yacyClient crawlOrder
...
Thanks to Stephan for the advice
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1737 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
62d0f7a334
*) added TOC for pages in wiki as requested in http://www.yacy-forum.de/viewtopic.php?t=1987
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1734 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1d8ca6e082
serialized dhtChunk deletion with indexing
...
The dht selection, transmission and deletion is now completely serialized with indexing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1731 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
ff476c19a5
tuning User.html
...
FIXED: Now admin can logout
ADDED: Nice Progressbar, representing your remaining onlinetime.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1727 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
2e8221050a
*) removed redundancy, no changes in functionality
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1725 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
2336f0f013
*) allow pausing/resuming of crawlJob Threads separately
...
- pausing/resuming localCrawls
- pausing/resuming remoteTriggeredCrawls
- pausing/resuming globalCrawlTrigger
See: http://www.yacy-forum.de/viewtopic.php?t=1591
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1723 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
af1da090bb
blogRight in UserDB.
...
Look at the Fileshare, for how to use it.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1722 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
2ee5796e76
added keywords, properties;
...
change '\n' -> '\r\n'
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1720 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
60dac4325e
serialized indexing with dht selection
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1719 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a840755964
moved parts of index transfer logic back to switchboard
...
this is needed to merge the dht selection with the indexing thread
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1718 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
134253a603
fixed bug with cache flush
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1717 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
149409ba5c
move description -> javadoc
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1716 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
00975359c5
added keywords, properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1715 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c2d863855d
different flush limit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1713 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
64441b1f78
ADDED: yacy.badwords list to filter the topwords
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1711 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
d7da273d7e
using ArrayList instead of Vector
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1710 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
d6f7bd44ae
fix for public tags
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1709 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f9063e2040
added some synchronization to avoid that several tasks can trigger a cache flush simultanously
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1708 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2c4e4ae6a2
further refactoring of dht selection, transfer and flushing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1707 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
73dad68cf1
outsourced thelis DHT flush class into own file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1706 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
aa4b04e3dd
reverted last change
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1705 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
467216d4c7
bugfix for umlaute and html-specialchars in wikiCode
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1704 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
4b0dae8fcf
added a possiblity to get the ranking values for an url.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1703 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
85ac7d8386
* moved DHT transfer thread to own class file, needed for further modularization
...
* changed status handling
* added forced cache flush when cache has containers with too high number of index entries
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1702 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
34341a868e
code cleanup
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1701 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7df2e6e571
bugfix for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1700 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
cd41e9a0eb
moved DHT index selection to new object that holds indexes to be send away to other peer.
...
This was made to make it possible that RWI selections can be serialized with indexing.
Serialization will be implemented in another step.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1698 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
e3dd67bba0
bookmarks import.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1697 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
dda143df79
We NEED this here for the XML-Files
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1696 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
42a5f56723
*) Bugfix for broken dht thread configuration
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1695 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
bfd37e34aa
using other XML Parser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1693 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
aa87df35e1
*) To avoid confusion location will now also be displayed for own peer
...
See: http://www.yacy-forum.de/viewtopic.php?p=17283#17283
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1692 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
15ed57f9b7
Updated German language, by VT100, NN, rramthun
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1690 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
0b5a736280
bugfix for nullpointer on unparsable date.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1688 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
f503df04f8
sort the Bookmarks with newest First.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1686 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
3b4a99ff6a
fix for java 1.4.x
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1685 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
651bce8e2f
*) adding missing function to transmit url chunks for crawl-order jobs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1680 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f95d98142f
*) displaying amount of items in the existsIndex caches
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1679 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
9b941fb773
*) bugfix for usage of yacy with extended port binding (e.g. #eth0:8080, 192.168.0.1:8080, etc.)
...
- port was reported incorrectly to other peers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1678 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
2d4e1325cf
UTF-8 fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1676 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
e2af2a3f45
*) it's now possible to run more then one indexDistribution-Thread
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1673 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
40dd6ec4fd
*) experimental restructuring of db import function
...
- trying to reduce IO load by avoiding unnecessary db access
- trying to presort url list
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1671 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
c8f5adea4d
- don't send Message Body on HEAD requests, even in the case of an error
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1669 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a7248fbb0a
*) bugfix for http/0.9 responses
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1668 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
2da18ab359
*) correcting logging output
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1667 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a354bc2ec1
*) Bugfix for content length check
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1666 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8ffc6e35ad
*) correcting logging output
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1665 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
e974d0cb99
Improve compliance to rfc
...
*) There is no status line in HTTP/0.9
*) Answers to HEAD requests should return the same headers as a GET request
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1664 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
556d242be0
*) Limited support of content-range requests
...
- a simple continue download request should work now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1663 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8fcb25f9f9
*) Setting via header according to rfc
...
- can be disabled via settings dialog
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1662 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
980e986b64
*) Re enabling short cycle for already removed nurl entries
...
See: http://www.yacy-forum.de/viewtopic.php?p=17147#17147
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1660 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
218cd6561c
fixed problem with wrong hash length in file share
...
see: http://www.yacy-forum.de/viewtopic.php?p=16565#16565
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1658 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
56516fd8e6
added refresh parser to htmlFilterContentScraper
...
* getRefreshSeconds() - number of seconds until refresh
* getRefreshPath() - url path
See also: http://www.yacy-forum.de/viewtopic.php?p=16851#16851
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1657 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ba5fe0b287
fixed (again) nullPointerException in kelondroTree
...
see: http://www.yacy-forum.de/viewtopic.php?p=17091#17091
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1656 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
e6c2f700b1
public Tagview
...
IMPORTANT: Fix for new(empty) Tags when adding/editing bookmarks.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1651 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
672b384fc7
refactoring setTagsTable and setBookmarksTable.
...
preparation for remote Bookmarks. (and Bookmark/Tag Object, which do not interfere with local bookmarks/tags)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1649 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
040624e361
*) better support for http head requests of servlets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1648 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
62ffb5ece0
*) httpdFileHandler.java: adding real streaming support for lage files
...
- avoid to read the whole file into memory
- support of chunked transfer-encoding for http/1.1 clients
- support of gzip content-encoding suitable clients
See: http://www.yacy-forum.de/viewtopic.php?p=17058#17058
*) MessageSend_p.html: better highlighting of peer response/status messages
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1646 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
3b6328ad02
*) Consistent use of minCount for index transfer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1645 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0017812b2e
bugfix for null compare
...
see http://www.yacy-forum.de/viewtopic.php?p=16980#16980
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1644 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
b137c90015
BugFix for too long Usernames.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1642 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
9d6bae77ee
the best PPM ever! ;-p
...
Now stopped indexingstop is recognized as 0 PPM.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1641 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
0b60b9bf51
*) Remove entries from AssortmentCluster before reinserting the rest into the ramCache
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1640 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
8ab1d6ff4b
*) fixed NullPointerException in plasmaWordIndexEntity
...
See: http://www.yacy-forum.de/viewtopic.php?t=1921
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1638 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a26574c894
Migration from tagName as key to wordhash(tagName) as key for bookmarkTags.db
...
(just deleting the old db, rebuildTags does the rest)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1637 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
eeba8b055e
*) guessing, testing and suggesting alternative hostnames on "unknown host" error
...
See: http://www.yacy-forum.de/viewtopic.php?t=1879
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1636 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7eb10675b3
re-organization of index management
...
this was done to be prepared for new storage algorithms
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1635 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a8a5ad959a
using TAG_NAME for getFriendlyName() and the lowercaseversion for getTagName()
...
Removed TAG_FRIENDLY_NAME
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1634 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
73f18ed5b2
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1627 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
bc6d400b03
bookmarktags with wordhashs.
...
to Come: Migration
please test this...1) backup bookmarks.db 2) delete bookmarksTags 3) test it...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1626 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
addc802cf3
workaround for kelondro Umlaut-Problem.
...
his will only fix öäüÖÄÜß ...just do not use other special chars ;-)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1621 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
fb5c387368
XML import works.
...
Please backup your bookmarks.db before trying it, i had many kelondro errors while importing del.icio.us xml-Files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1620 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a4513523d6
hide add/edit/import bookmarks per default.
...
xml-bookmark import (this does not work, yet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1619 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1e4578aab6
VERY EXPERIMENTAL removal of index ram cache flushing thread.
...
The cache will fill up and flushed explicitely when it is full.
This shall remove double-access of assortments (indexing and flush)
during indexing process. Hopefully this should reduce IO.
The main idea is: the cache shall mainly be flushed by DHT transfer, and
only indexes that shall be hosted by the own peer are flushed to the
assortments. This needs further work.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1617 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
44996afd79
*) Bugfix for handling of http/0.9 clients.
...
- nothing was send as response
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1610 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
01c668fe1b
experimental disabling of db write buffer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1605 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
954f02d22e
*) Bugfix: Prevent wordIndex.getContainer() from returning and even manipulating
...
the containers from the ram cache. Return a new container instead.
*) Speedup flushFromMem by reducing the number of searches in the TreeMap
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1604 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4438a96b87
tried to fix "Object type or Object type combination not supported" bug
...
see http://www.yacy-forum.de/viewtopic.php?p=16588#16588
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1592 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c70befbe9c
added xml read/write example file: kelondroXMLTables
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1591 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
27b6b3d714
public Tags.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1589 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
a627162f13
*)fixed logginglevel for Debugmsg
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1585 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fe39493145
changed default ranking parameters
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1582 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
5ef57211a6
trim was just too easy...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1579 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
38e79aec94
Fix for wrong(?) httpheader:
...
" pragma: no-cache" (IIS specific?)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1578 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a8eff9a0ae
xml/bookmarks/posts/all.xml to list all public Bookmarks
...
bookmarksIterator now accepts an option, if you want all(with private) or only public bookmarks.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1577 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
d04e7d724e
fix for deleting tags.
...
string2vector should return an empty vector on ""
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1576 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
365a3fff8e
fixings for ranking attributes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1569 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
785763d070
added debug output for "Object type or Object type combination not supported" bug.
...
See also: http://www.yacy-forum.de/viewtopic.php?p=16306#16306
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1568 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
2a88232cee
*) Bugfix for httpd security but
...
- authentication was only required for html files.
See: http://www.yacy-forum.de/viewtopic.php?p=16510
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1563 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
8e55098b74
fixed detailed search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1562 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
ebc5b1eafb
*) adding a servlet that can be used to generate a Firefox search-plugin for yacy.logging
...
- You can access this servlet via YaCySearchPluginFF.html
- The generated search plugin has the name YaCySearchPluginFF.src
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1555 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0cb940a8e5
added detailed search.
...
ranking profiles do not work properly yet
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1551 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c695928f7c
adopted search page to new detailed search (to be commited later)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1550 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
45323e7b76
fixed null pointer exception during search
...
see http://www.yacy-forum.de/viewtopic.php?p=16429#16429
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1547 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
1fce0ea263
xml api for deleting bookmarks.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1546 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
6b16c13b20
showing the public/privat flag.
...
TODO: Some nice icons.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1545 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
49647583b2
language update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1544 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
670356fa4e
code cleanup
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1543 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fb7411d7bb
re-structuring of ranking application:
...
concentration of all ranking attributes in the
plasmaSearchRankingProfile
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1541 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
5f5eee1ae9
*) replace System.out.println with log
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1540 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d98418390b
- introduced rankingProfile Class
...
- selection of ranking and timing profiles for each search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1539 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
eab1805bca
refactoring: plasmaSearchProfile -> plasmaSearchTimingProfile
...
This was made to distiguish this profile from the
(to-be-implemented) plasmaSeachOrderProfile
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1538 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
6eef848954
re-design of post-ranking process
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1537 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
af2127f3ad
allow multiple #File: Sektions for one File in translations.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1534 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
1bb768178f
simple check for unused Translations.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1533 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
be77fe1a88
code clean-up
...
@Martin: bitte schaue mal warum die Variablenzuweisung
in plasmaCrawlNURLImporter war. So wie sie waren, waren sie überflüssig.
Das hattest du dir bestimmt nicht so gedacht.
Sollten es ggf. globale Variablen sein?
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1529 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0bc2aaeb42
added normalization to search attributes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1528 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
7bd61ab0e5
Locales will now be in DATA/HTDOCS. So it works with readonly htroot.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1527 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
008bcb7fb8
*) simplifying code by moving closeTransferIndexes into final block
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1522 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
50d85657b8
*) new import function for IndexImport_p.html
...
- can be used to import the crawling queue (noticeUrlDB + stacks)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1518 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
214302284e
*) undoing last commit because of problems with getUpdateTime
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1514 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
408de3beee
*) avoiding to search in the treemap two times for the same key
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1513 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
139ba4e0c8
Bugfix for getCachePath(URL url)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1510 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
442807cb29
*) Bugfix for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1506 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
22fd1ca9aa
*) minor changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1505 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
6a99304b2b
*) Redesign of db import functionality
...
- restructuring to allow different import tasks to be controlled via one gui
- adding possibility to import a single assortment file
- adding possibility to set the cache size that should be used
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1504 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
56936139ae
Fix logging in kelondroTree:
...
*) Use java.util.logging.* (via kelondroRecords) without de.anomic.server.logging.serverLog
*) Log "CORRECTING ITERATOR" only in debug mode
(happens way too often to be a useful warning and is corrected anyway)
*) Log when correctedNodeIterator stumbles on incorrectly ordered data
(now this one deserves throwing a warning at the user)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1503 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3834675084
fixed bug that caused wrong behavior of search result preparation
...
(second search on same topic resulted in less links)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1502 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
31c8476b5d
plasmaWordIndexCache.getContainer:
...
*) Also get entries from cache
*) calculate available remaining time for backend.getContainer correctly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1501 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
bb1664b63e
*) Remove workaround from SVN 1472: It is not needed anymore
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1500 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ec5d88664a
tried too fix serverSwitch synchronization problems
...
see also: http://www.yacy-forum.de/viewtopic.php?p=16110#16110
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1499 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3419b3bcdd
fix for bug that caused the peer-counter problem.
...
See http://www.yacy-forum.de/viewtopic.php?p=16016#16016
The kelondroDyn now uses a generic fill character.
kelondroDyn-Tables containing peer/word/url-hashes must not use '_'
as fill character.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1498 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
9bc62bfdac
typo
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1497 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
cdc595ab67
another ppm fix. no more unknown ppm
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1496 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
4f43816ec0
*) Fix wrong class cast in indexSize()
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1495 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a7f0adf6fa
bugfix in entity iterator
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1490 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fa90c3ca7a
- removed some usage of indexEntity
...
- changed index collection process: indexes are not first flushed to indexEntity,
but now collected directly from ram cache and assortments
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1489 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
aea3e00864
cleanup: removed unused temporary index management in indexEntity.
...
This is replaced by indexContainers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1486 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
03c65742ba
changes towards the new index storage scheme:
...
- replaced usage of temporary IndexEntity by EntryContainer
- added more attributes to word index
- added exact-string search (using quotes in query)
- disabled writing into WORDS during search; EntryContainers are used instead
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1485 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
84a00e5673
Use YaCy logging instead of something I don't understand.
...
Problem was: YaCy under Linux wrote every CORRECTING ITERATOR message to syslog an your logfiles get VERY big if you run YaCy 24/7.
Approx. 20MB/day.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1483 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
ab7a911bb3
*) Trying to solve pool not open problem
...
See: http://www.yacy-forum.de/viewtopic.php?t=1798
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1482 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a6245a302f
even better ppm ;-)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1481 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
d665f3c39c
*) fixed Threadnames for stackCrawl-Threads
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1480 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
3d5347bc8e
*) changing loglevel for some messages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1479 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
0fcd113c42
*) last bugfix part. Seems to work now for the stackCrawler
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1478 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b9c9eaeb44
*) next try todo a bugfix :-((
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1477 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
4b4b93c413
*) next try todo a bugfix :-(
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1476 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
d9fbad71b9
*) next try todo a bugfix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1475 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
6da97bd2e4
*) next bugfix for threadpool problem
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1474 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
bea2b9edee
*) further redesign of threadpools to solve too many thread problem
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1473 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
2d1283da34
This is an extremely ugly workaround for an incompatibility between yacySeed hashes and kelondroDyn keys
...
See: http://www.yacy-forum.de/viewtopic.php?p=15955#15955
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1472 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
784fd50437
*) more verbose thread names
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1471 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
56e4dbeb71
*) displaying current active + current idle threads in PerformanceQueues_p.html now
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1470 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
859c6a88f5
*) testing various thread pool eviction settings to avoid outOfMemory - Thread creation problem
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1467 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
7197f171d3
better ppm calculation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1464 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f2b18cede9
AND-bugfix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1461 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b946e28e61
some ranking enhancements
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1460 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
6c02f889f7
Cosmetic changes.
...
Corrected version numbering as described in http://www.yacy-websuche.de/wiki/index.php/De:Versionsnummern
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1453 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b191f06d16
*) Adding additional logging message to locate problems with stackcrawl threads
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1452 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
5c56b9ed59
*) catch exceptions that could occur during url decoding
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1451 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
d9bcd73d93
*) Bugfix for exception
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1448 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f5abfe8d57
*) more failsafe threadpools
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1446 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
47344e8df0
removed referrer fake (too many complaints, too less use)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1444 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
ad0de69607
Yet another bug fix for svn 1441. It should work now.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1443 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
58fd40e1c1
Aaargh
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1442 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
b08af0c2cb
*) Force download of seed file when checking upload success
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1441 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
66c889138e
*) Bugfix: Principals are reported back as 'principal', so IWasAccessed should also be true
...
*) make it easier to include legacy peers switching between timezones +0100 and +0200
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1438 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a56fefe0d3
added missing forced-flush for index cache
...
see http://www.yacy-forum.de/viewtopic.php?p=15732#15732
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1434 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
78bcb8014a
*) Limit range for selection of indexes for distribution to a DHTDistance of 0.2
...
(For wider ranges enough suitable targets are not probable)
*) Migrate Indexes from ClassicDB back to AssortmentCluster if transfer fails
*) Remove class iterateFiles from plasmaWordIndex
(The class iterateFiles from plasmaWordIndexClassicDB is used instead)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1430 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
861aae678d
*) cleanup cacheAge database when cleaning up the HTCache
...
*) Log directory deletes with level Fine
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1427 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b9d73f63e7
replaced String object in loop detection by byte[] to omit String-generation
...
which could cause locks.
See http://www.yacy-forum.de/viewtopic.php?p=15738#15738
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1425 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
927c2c3709
*) Fixed a minor bug in code for tables. {|border"1" did not work, {| border"1" did. Now the space is not needed anymore.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1423 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
75aad0fe66
*) Bugfix for URLs containing spaces
...
See: http://www.yacy-forum.de/viewtopic.php?t=1640
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1422 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
754a35877f
*) Changing robots parser cxclusion policy
...
- crawling is now allowed if server returned a 403 statuscode
when trying to download the robots.txt
See: http://www.yacy-forum.de/viewtopic.php?t=1612
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1421 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
a2e2d583f9
*) small bugfix regarding peerPingMaxRunning
...
*) beautify log
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1419 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b4e2efef10
*) first test of new iteration function
...
ATTENTION: please don't use it at the moment
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1418 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
a4e90c4b11
Fixed spelling bug.
...
I think this is important for other programmers, who don't make the same mistake as the original author.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1417 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
c45517db46
*) replaced code for table with better version (by kane)
...
*) split replaceHTML into replaceCharacters and replaceHTMLonly, replaceHTML can still be used to ensure compatibility
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1416 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
eabf4a0386
fix for null pointer exception during shut-down
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1415 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
47843e69e2
auto-reset for switchboard queue stack
...
bugfix for http://www.yacy-forum.de/viewtopic.php?p=15684#15684
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1414 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a70970f993
fixed increment in content iterator
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1413 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
62ab8d18c1
*) Bugfix for peer sorting method. This seems to cause funny side effects in the SeedDB
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1412 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
75b268f16d
*) use majority voting for peer type decision
...
*) reduce the number of peer pings sent out
see: http://www.yacy-forum.de/viewtopic.php?t=1748
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1411 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d6581c445b
added content iterator for corrupted database files
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1406 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
ecdc1f7547
*) Bugfix for crawling URLs with query parameters
...
See: http://www.yacy-forum.de/viewtopic.php?p=14065
*) Preparation for http://www.yacy-forum.de/viewtopic.php?t=1719
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1405 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
eb80156233
*) added Kane's code for tables
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1403 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
ef22fa8bf2
*) beautifying code and a little comment
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1401 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fc4ae899f7
added word-position to ranking (this is only a first step)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1395 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bb2095fe39
assortment files are now not deleted, but shifted to a backup directory.
...
See also: http://www.yacy-forum.de/viewtopic.php?p=15458#15458
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1394 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7366e39dd3
tried to fix 100% CPU bug.
...
See http://www.yacy-forum.de/viewtopic.php?p=15569#15569
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1393 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f14d49fae9
enhancements, bugfixes and additions to word index attribute storage
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1392 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
4d33020f56
Migration to WORK
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1389 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
1e5feedf0e
Fix for http://www.yacy-forum.de/viewtopic.php?p=15547#15547
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1388 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f4ffa9aee5
- implemented more attributes to index entries
...
- implemented hand-over of new word index attributes during remote search
- implemented word-distance computation during search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1382 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
026dcdfcc0
*) Bugfix from mbirth for ftpc bug
...
See: http://www.yacy-forum.de/viewtopic.php?p=15496#15496
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1381 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
34a7802a36
.bat files create DOS-window with title "YaCy" as suggested in http://www.yacy-forum.de/viewtopic.php?p=15470#15470
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1380 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
90b940e90e
fixed position storage problem.
...
Now the word position is properly stored.
No use of that now, but can be used for better ranking.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1378 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0371494010
tried to add word position to index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1377 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f1cfee7703
removed tabs from condenser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1376 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
37791fd529
*) Close indexEntities when "found not enough peers for distribution"
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1375 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3ec7177f0f
added seed flag 'AcceptCitationReference'
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1374 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
c5b6154136
added CRDistOn = true/false
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1372 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
ee010c36ae
*) fixed bug where ampersands were replaced by replaceHTML even if they were part of &.+;
...
*) fixed bug in htmlentities (cAseSenSitivity!)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1371 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago