lotus
f9fb2d0fee
hide memory tables by default
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5020 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
5f77f55ed7
possible fix for negative speed values
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5019 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
79dba5445d
init-script: fixed some variables to general defaults
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5018 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
785688ef82
- creating pid-file under linux
...
- added modified init-script (using startYACY.sh instead of doing the same thing)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5017 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
50ef5c406f
- refactoring of robots parser (removed opaque Objects[] result vector)
...
- added Allow-component to robots result object
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5016 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
7913bdb75b
Flextable: filename in errormessage if inconsistent
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5015 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
d42eae25f8
yacyTray:
...
fix for unproper shutdown
some messages
installer:
start shortcuts minimized
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5014 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
7cec908813
dont't show HTTPC debug messages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5013 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5f41913043
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1347&hilit=&p=9216#p9216
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5012 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c3d461d191
- removed superfluous copyright statement
...
- updated my email address
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5011 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3ca98fee42
removed superfluous copyright statement
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5010 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
c049d80fbd
fixed login problem with yacy as proxy (POST and Cookies)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5009 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
62afea0c9f
some improvements for yacyTray
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5008 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
af616a92ff
fixed welcome message above image on custom search page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5007 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
7c110e07f0
removed debug
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5006 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
10d01fdd0d
addendum to 5002
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5005 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
eadc204130
gzip POST wiederholbar gemacht (macht transferURL stabiler)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5004 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
d14e8d348f
- times of LOCAL_SEARCH are shown in milliseconds (also in yacysearch.java ;)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5003 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
28c39e2aa4
fix for new starter files
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5002 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
b63a519456
fixed build problem
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5001 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
e12438142e
- warning instead of NPE if urlHash is not in index of CrawResults
...
- times of LOCAL_SEARCH are shown in milliseconds
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5000 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
5784070f6e
added user agent
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4999 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
3e26aca356
added startYACY_debug.bat to dist Target
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4998 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
fa695c2d9f
tray is now only shown on Windows and doesn't block on linux
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4997 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
d77ed28e2f
temporary disabled tray because of flaws on only-shell-linux
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4996 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
adeb881288
fix for building Windows installer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4995 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
b704cf1fbc
* no need to update the searchpage links anymore
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4994 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
0bb7c42bc8
rename of Windows start scripts
...
* startYACY.bat -> startYACY_debug.bat
* startYACY_noconsole.bat -> startYACY.bat
changes for Windows Installer
* do not set shortcuts to the YaCy search page because we have a tray icon now. the user will not get an error if yacy doesn't run.
* do not set a shortcut do debug start. usual users don't care about logs.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4993 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
f8a1e3175e
new yacyTray
...
this will make a YaCy icon in the tray area on supported platforms
enabled by default
the search page will open on double click
used JDIC 0.9.4 from https://jdic.dev.java.net/
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4992 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
4a7e5f377e
added translation for new customization pages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4991 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
05c26d58d9
fixed missing remove operation in balancer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4990 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
606b323a2d
fixed bug that appeared when a new crawl ist started
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4989 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
38eb5bd1ee
fixed a bug in kelondroBLOBHeap. The following files are probably inconsistent and should be deleted:
...
DATA/HTCACHE/responseHeader.heap
DATA/PLASMADB/crawlRobotsTxt.heap
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4988 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
28d5703f8a
- fixed a bug in Robots.txt loader which could have caused that robots.txt files had been loaded from the same domain more than once
...
- patch in BLOBHeap to prevent OOM during startup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4987 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
7b1c9e6aee
discovered and removed a (possibly large) memory leak:
...
many classes used the kelondroMapDataMining (was: kelondroMapObjects) which adds statistical
functions to the kelondroMap (was: kelondroObjects), but these functions were not used by these
classes. Especially the HTCACHE and robots.txt database allocate a very large number of objects
for statistical use, but never used them. By replacing the kelondroMapDataMining with the
kelondroMap object for these classes now less memory is allocated.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4986 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
0f5fe8cc53
refactoring of method calling for objects from kelondroMapDataMining
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4985 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
01d1ae6676
patch for negative time in case that the time of the computer is changed
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4984 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
bac758bc5a
* update to JRE 6u7
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4983 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
4acf0a61cd
refactoring of kelondroObjects (mainly renaming to kelondroMap)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4982 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
441e9c861e
fix for npe in HTCache cleaning process
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4981 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f7aaeb3fad
created new main menu entry 'Customization and Integration'
...
- moved some already existing servlets to this menu
- renamed the skin servlet to appearance
- added a set-to-default-button to the search page appearance setting
- removed the peer profile servlet which is now replaced by a field in the new appearance servlet
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4980 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
5488543b8f
disabled disk usage logpoints
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4979 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
1e6d12f146
Major update to BLOB data structures:
...
- introduced a new BLOB file format: kelondroBLOBHeap. This is a flat file with an index in RAM.
very similar to the eco-tables, but with flexible value sizes. It will replace the kelondroBLOBTree,
which is based on a kelondroTree, a file-AVL-based index data structure.
- the HTCACHE header file was replaced by the new blob heap file structure
- the robots.txt file was replaced by the new blob heap file structure
- the robots parser was enhanced (bugfixing for double-loading of the same robots.txt)
- other BLOB-dependent data structures were prepared to use also the new BLOB heap
- fixed a bug in the snippet fetch process: the file header was not written to the header index
There should now be less IO during snippet fetch and during crawling
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4978 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
81f75f5056
- removed unnecessary classes (these objects are much easier to handle using generics)
...
- generalized BLOB referencing. This is the preparation to use another BLOB class, the kelondroHeap
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4977 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
b38f467e3c
better SRU compliance
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4976 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
3980dd7554
* maske ampersan & Co. in xbel export
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4975 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
7052f2f61f
- added copyright header of ResourceObserver
...
- commented/removed some code to eliminate code warnings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4974 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
1400cdc91e
- refactoring of resourceObserver (moved it to crawler)
...
- partly redesign of diskUsage: little bit more functional behavior, less side effects, better error case handling
- the resourceObserver can now show a error message if the diskUsage is 'out of order'
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4973 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
f0012554de
* improved localsearch.sh:
...
* read port from DATA/SETTINGS/yacy.conf
* use curl or wget, depending on what is available
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4972 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
b6301a54fa
* added class ListDirs to provoid generic listing of directories in systemdirectories and jar-files
...
* yacy runs, when classes are in a jar-file (->build-jar ant-target)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4971 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago