orbiter
9b0c4b1063
redesign of parts of the new BLOB buffer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5287 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
1778fb420d
- added some performance tweaks to the new BLOB buffer
...
- removed the now superfluous HT storage thread
- reduced number of file decompression by shifting the compression moment to the future
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5286 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
low012
77e41da7d2
*) further propagation of display value (see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1536 )
...
*) removed another depreciated parameter "time" which led to ugly -UNRESOLVED_PATTERN- in URL
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5285 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
9663e61449
added another class to handle BLOB writings to the new HTCACHE data storage:
...
- entries are buffered and written as stream with many entries at once (saves many IO accesses)
- entries are compressed with gzip: increases capacity of cache
- concurrency for stream-writing and compression: all writings to the cache are non-blocking
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5284 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
low012
ff46ce8520
*) fixed display=2 (see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1536 )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5283 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
382226da94
fix for bug introduced in SVN 5281: parameters were switched
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5282 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
f2fd043797
refactoring (moved duplicate code into methods)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5281 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
c612046e5e
r5278 java 1.5 compatible
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5280 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
af71ec93bf
ops, forgot to import something
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5279 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
9e65e9141c
* always use UTF-8 for encoding hashes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5278 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
03d2b323c2
* remove bad mimetype tag so I see my changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5277 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
826ca79735
refactoring and new architecture to store the files of the web cache:
...
- files are not stored any more as individual files
- a new database structure using BLOBHeap files stores many cache entries in common files
- all file-writing procedures had been migrated to generate byte[] objects which are written with the new database methods
this is only an intermediate step to the final architecture, where cached files are written together with their metadata in one single database structure.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5276 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
low012
2b18a9b2c4
*) removed depreciated parameter "time" which led to ugly -UNRESOLVED_PATTERN- in URL
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5275 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
f095137238
- respecting httpdMaxBusySessions (refusing new connections if limit is hit)
...
- comments in serverBusyThread converted to JavaDoc
- better debug output for npe-case in diskUsage
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5274 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
94e43ece41
unter debian yacy als (fast) letztes starten und erstes beenden
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5271 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
9d69964d3d
start daemon in different runlevels on debian and fedora/openSUSE-Systems
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5270 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
8ba33f104e
fix for npe
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5269 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
998861acfd
- some refactoring in BLOBHeap to enable more gap processing functions
...
- better gap merging in BLOBHeap
- shrinking of heap file if gap is at end of file when file is closed
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5268 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
9d50bfd0b3
fix for npe: http://forum.yacy-websuche.de/viewtopic.php?p=10562
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5267 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
766cad6e93
enhancement in memory management of BLOB Heap files / merging of deleted entries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5266 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7860d5d632
fix for bug in seed list management (cause was bad class overloading, only visual effects!)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5265 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
603282bcf4
fix for out of bounds exception
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5264 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ffed5fc415
fixed problem with lost peers in database
...
migrated seedDB from BLOBTree to BLOBHeap
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5263 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6fb865fbdc
- fix of bug in iterator in kelondroBLOBHeap which caused bug in crawl profile listing
...
- some refactoring of classes that use kelondroMap (Map instead of HashMap)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5262 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
2d65887723
- fix for bug in new profile handling
...
- added a new feature in ymageChart (cannot be seen yet, just wait... will be used in profiling chart)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5261 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
4df63626f5
sorry
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5260 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
736dd86193
- option enableSimpleConfig can disable hidden tables
...
- corrected some Xmx values
- friendlier welcome message format
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5259 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ff68f394dd
fix for problem with balancer and lost crawl profiles:
...
if crawl profile ist lost, no robots.txt is loaded any more
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5258 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
d197a62faf
* wrong default parameter in initscript
...
* should fix http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1500
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5257 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
f0c7166a48
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1505
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5256 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
88fdd4c4f2
* remove unix wrappers from installonlinux-target, because they are useless on systemwide installations
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5255 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
daburna
9286afad4e
new development cycle - nun aber wirklich :-P
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5254 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
ed51ccf725
* correct error message
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5253 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
low012
fe6142a6ab
*) ...and even more languages.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5252 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
3717d2057a
YaCy-UI: fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1483
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5251 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
low012
9f0cc3afdd
*) more languages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5250 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
low012
e96a3d0472
*) added statistics for a few languages: Czech, Esperanto, Irish, Turkish
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5249 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
fb8d9850ea
fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1462
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5248 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
0d1a2f6183
fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1461
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5247 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d0bdcdd57c
small changes to attributes of DoS attack protection parameters
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5246 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
9ac16f565b
- fixed several bugs in database management functions
...
- fixed a display bug for the performance graph
- fixed deadlock when initialization of awt happens simultanously
- removed some debugging output
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5245 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
daburna
1976b89bef
new development cycle
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5244 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
7fdf65339d
system status dropped into next line if seed server was enabled. display needs about 230px, set fixed width again.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5243 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
7782a43060
fix if LANGUAGE: was not defined and the end of the query
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5242 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
2c23e6ad34
YaCy-UI: added some features for Admin Console
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5241 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
efcae14714
YaCy-UI:
...
- added 'Open' button to search result toolbar
- lets you open all selected search results in new window/tab
- added 'any language' filter as default
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5240 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
68115c30ba
quick release 0.61
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5239 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
902a0d0f38
fieldset of system status was bigger than defined space. IE overlapped some text.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5238 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
820a03f9d6
- removed some warnings
...
- used fix in SVN 5233 for ysearch.java and search.java
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5237 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
69925a7e91
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1441
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5236 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago