orbiter
417ed5102e
redesign of database iterators:
...
an iteration of key elements in kelondroTree databases is no longer supported.
this is now replaced by an iteration of kelondroRow.Entry objects from the database
Iteration of keys from the database was mostly followed by retrieval of the row
from the database, whcih caused unnecessary database load.
The index selection was also redesigned to use the new row iteration methods.
This affects many funktions, most important is the DHT selection routine which is now much faster.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2327 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
dd2865178a
major bugfix (searched a whole week for the bug) for
...
the kelondroRowBuffer, which has effect mostly to the
kelondroFlexTable but also to all other database functions
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2260 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
66964dc015
removed high/med/low from kelondroRecords cache control.
...
this was done because testing showed that cache-delete operations
slowed down record access most, even more that actual IO operations.
Cache-delete operations appeared when entries were shifted from low-priority
positions to high-priority positions. During a fill of x entries to a database,
x/2 delete situation happen which caused two or more delete operations.
removing the cache control means that these delete operations are not
necessary any more, but it is more difficult to decide which cache elements
shall be removed in case that the cache is full. There is not yet a stable
solution for this case, but the advantage of a faster cache is more important
that the flush problem.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2244 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3a8aecb2ed
reflect new database and authentication methods with version number
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2216 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
45b39ee1be
*) solving unpacking problems with to long filename by
...
a) renaming the parent folder in the tgz file to yacy
(can be configured via build properties file)
b) reconfiguring build file to throw an error if a file
name is too long
Please note that currently there is _no_ proplem with too long
class names because of step a.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2207 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
572d53506c
new kelondroRow objects now replace byte[][] objects in object cache
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2161 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
338047e056
replaced kelondroDyn write methods for properties and maps by faster version
...
this affects news, robots?, bookmarks?, blogs, the wiki, seed-db, news etc.
this all should create less IO
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2107 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
0bf51edb40
Changing version number according to http://www.yacy-websuche.de/wiki/index.php/De:Versionsnummern
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2051 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
93eb4f14e6
release 0.45
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2047 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0f005cbc28
code freeze please for next release
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2033 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
00a5d435e2
- fixed some bugs with domain filter
...
- added new ranking filter "prefermask": urls that match the filter are ranked better
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2022 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f0833b0328
introduced simple search interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2007 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a37b09e303
implemented automatic adoption of chunk-read-ahead in kelondroTree to needed chunk size
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1931 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3385b5720d
documentation update + start of next development cycle
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1847 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1fa3d8cfbe
* release 0.44
...
* documentation update
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1844 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5484788cf3
* cleanup of unnecessary code (see: new yacysearch.* pages)
...
* documentation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1817 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d878eee0d5
0.434
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1795 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
87e90b9d8c
refinements in ram cache flush procedure and default timing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1768 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1d8ca6e082
serialized dhtChunk deletion with indexing
...
The dht selection, transmission and deletion is now completely serialized with indexing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1731 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
f008dfe16e
Converting as described in http://www.yacy-websuche.de/wiki/index.php/De:Versionsnummern to avoid confusion among self-compilers.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1602 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b4fcc20c47
0.43
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1594 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
8e55098b74
fixed detailed search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1562 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f0af91219c
*) restructuring of build.xml to allow all-in-one-builds
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1493 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fa90c3ca7a
- removed some usage of indexEntity
...
- changed index collection process: indexes are not first flushed to indexEntity,
but now collected directly from ram cache and assortments
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1489 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
35a53c9ad6
0.423
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1462 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
6c02f889f7
Cosmetic changes.
...
Corrected version numbering as described in http://www.yacy-websuche.de/wiki/index.php/De:Versionsnummern
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1453 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e2ff1767b5
fix for last DHT distribution bug-fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1330 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a81cc9d969
no DATA/DATA to avoid confusion.
...
increasing version number
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1273 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
70c84c613f
0.42
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1219 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5e2673e86c
new version number to check performance enhancements
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1207 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
85282b1d98
enhanced YBR recognition and search result heuristics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1121 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b3e57ae663
*) Restructuring of build file to fulfill requirements of Gentoo svn-ebuild
...
See: http://www.yacy-forum.de/viewtopic.php?p=12711
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1090 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
79818a320f
introduced citation-rank transmission protocol and activate transport for anonymisation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1055 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d2731418bf
added creation of global ranking files and changed url normal form usage
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1046 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5f68b6886b
introduced new url-hashes for better ranking computation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1013 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c1c94111b0
added new network picture at Network menu using the new image-servlet method
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@880 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
37ee53856c
cut for release 0.41
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@848 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7fc822a59b
changed handling of time-zones
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@801 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
9e2fc7e5fe
load balancing of crawl target domains
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@791 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2148c0cf49
replaced kelondro storage core; much less objects in kelondro cache now; less IO from DB
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@724 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
46d3fe1fd2
cut for changes-while-in-ecuador
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@696 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
06261e8ef7
download doc update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@551 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
e616395c3b
latest changes and cut for 0.40
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@548 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
25f632dbd9
more DHT bugfixes and better logging of DHT effects
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@542 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
5cb00889d9
enhancements to dht selection, search and search presentation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@540 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
cd10370992
several bugfixes and dht selection / logging improvement
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@531 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
248c24b60a
intermission-feature usage in case of local and remote search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@510 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
2dd2533e6d
cut for 0.394
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@489 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
849b194149
fixed news receipt and added processing buttons on News page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@458 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
ad90f0ad13
activated RWI distribution to DHT for senior peers (default redundancy 3), necessary now for network growth
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@438 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
b9d18d40cb
configuration of proxy idle time in performance menue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@436 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
be1f324fca
performance setting for remote indexing configuration and latest changes for 0.39
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@424 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
1d2155675b
changed assortment memory cache flush
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@403 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
419f8fb398
fixed bugs/missing code regarding new crawl stack
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@384 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
858cd94299
replaced indexing ram-queue by file-based stack-queue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@381 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
d6c85228a6
enhanced snippet computation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@319 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
3e8ee5a46d
enhanced caching in kelondroRecords and added better synchronization/finalizer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@301 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
f45dc29f35
maintenance
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@279 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
e88951166b
0.381 nachgezogen (nach Rolands Veroeffentlichung). bitte nicht selbststaendig Nummern vergeben!
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@263 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
594c591223
changes towards 0.38
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@208 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
d8fdc2526e
added experimental snipplet-generation (to be disabled for 0.38)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@206 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
e89ded9e41
bugfixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@204 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
9c224ffe99
Execution Filerights for Unix Wrappers
...
added locales to the tar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@181 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
84f9d8f7f0
*) migrating ant build files to generate a single extension tar per default
...
This is buildconfigureable by changing the extensionTarget Property in the build.properties file
*) Trying to solve "yacy.java template replacement / ant build failed" bug
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@169 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
8bd49ba535
*) setting root dir for all tar files properly
...
*) automatically adding SVN Revision number to tar file name
*) introducing build.properties file that can be used to set the build version number and date
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@164 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago