theli
b990dc1ad1
*) Replacing jsch 0.1.19 lib with newer version 0.1.21
...
*) Replacing PDFBox 0.7.1 lib with newer version 0.7.2
*) Refactoring of classes httpd/httpc/httpHeaders to
make many methods for httpHeader/Requestline parsing
reusable for new icap implementation
*) adding chunked input stream support
- needed by new icap implementation
- needed by future httpc HTTP/1.1 support
*) httpd.java
- moving all connection property contants to class httpHeader
- moving readHeader function to class httpHeader
- moving parseQuery function to class httpHeader
- moving handleTransparentProxy function to class httpHeader
*) httpHeader.java
- adding new fuction to parse the http response line
- adding new function to converte http headers to a string that
can be send to the client
- adding a function that generates a proper url using all parsed
connection properties
*) ICAP Support
- yacy now supports handling of icap response modification requests
- this feature can be used by other icap enabled proxies to contact
yacy as icap server, and to handover the downloaded content to yacy.logging
for indexing
- functionality was successfully tested with squid 2.5Stable 10 + icap patch
- further icap services e.g. URL filtering based on yacy's blacklists are possible
*) plasmaSwitchboard.java
- htcache entries that are still needed for indexing are now properly registered
as in use after system restart
- extended logging: log message now shows parsing and indexing time for each sb. entry
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@757 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
6d1de8abfd
finals; cleaned;
...
Properties;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@756 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
e748ba3f6e
super(), finals;
...
other; cleaned;
Properties;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@755 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
af9021e956
fixed bug with news caching
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@754 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
14bc880fa4
fixed bug with crashed profile database
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@753 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
71a31f0902
integrated and extended new memory performance menu; found and fixed bug in DHT caching
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@752 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fb52a82008
added new performance page for memory settings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@751 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
0f1bbff459
*) Tiny little job of cleaning up. (Was man nicht im Kopf hat, hat man in den Fingern...)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@750 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
4dbc871524
*) Trying to get rid of possibility of exploits in IndexCreate* through HTML and JavaSkript in peernames, URLs, <title>-tags etc. (see http://www.yacy-forum.de/viewtopic.php?t=1181 ) I hope I got them all and did not overdo it.
...
*) Just a tiny bit of cleanig up in News.java. (I messed it up myself some time ago.)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@749 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
9dfbd93c7b
Updated german language file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@748 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e6b30911c3
small changes to caching
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@747 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
effbf35f57
finals;
...
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@746 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
11e175630b
StringBuffers, finals;
...
cleaned;
Properties;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@745 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
22ffde70dd
more Properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@744 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
905e9d274e
more Properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@743 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
d082837c87
added Properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@742 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
42cd2cea65
added final constants, so that other class can reach it;
...
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@741 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
900ab97422
change of memory-allocation blocking value for GC prevention
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@740 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
5543ea08ad
sorted directory/file list;
...
dont list responseHeader.db;
StringBuffers, finals;
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@739 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0ffca99886
added priority-organization to kelondroRecord cache. This should virtually double the cache capacity.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@738 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2d22626386
automatic switch-off of cache control in kelondroRecords in case that cache is big enough (so that no cache-aging needs to be controled)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@737 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
d06aa558f5
back to 731
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@736 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
50a9500035
fixed 100% CPU bug with news queue deletion
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@735 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
f50d45678e
better values for BIG directory's
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@734 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
650764ce62
sorted directory/file list;
...
dont list responseHeader.db;
StringBuffers, finals;
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@733 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
cddd9aaa33
fixed SERIOUS bug with kelondroStack; affected all stack processing since 729
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@732 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
51aa6d0b33
fix for performance-problem on CacheAdmiin_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@731 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
416c126815
fix for a profile = null problem and new monitor in crawl queue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@730 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
19547f1821
changed node manipulation methods in kelondro core to reduce object allocation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@729 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
0d319fff41
german stopwords.
...
We should try to use language dependent wordfiles as fast as possible, because they will prevent the indices from getting big with useless (very common) words, which have no function, while the stopwords used at the moment filter too much.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@728 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
c256ab0532
updated german language file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@726 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
debb207a74
removed file sync
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@725 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2148c0cf49
replaced kelondro storage core; much less objects in kelondro cache now; less IO from DB
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@724 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
dff96601fe
*) Bugfix for transferURL:
...
URL list index was not incremented properly.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@723 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
beefddf0e8
*) Adding option which allows to do a Index-Transfer without deletion of index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@722 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
4036ee812a
Updated german language file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@721 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
16c371a385
finals;
...
StringBuffer;
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@720 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
40925f4fb7
*) Improving complete index transfer performance by automatically increasing size of transfered word chunk
...
for fast connections (much similar to normal dht behavior)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@719 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
91ab4d044b
*) Adding automatic retry functionality to complete index transfer function
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@718 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a62677f761
*) Adding additional logging output for complete index transfer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@717 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
7638b4181b
*)Undoing peername sorting
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@716 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
61d3b23ada
replace created with contributed
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@715 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
e0aadfe76e
sorted config list (Config_p.html);
...
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@714 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
10e7d6f02b
Bugfix for http://www.yacy-forum.de/viewtopic.php?t=1053
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@713 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b991d2e7dd
*) Additional logging message for complete index transfer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@712 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
3c00c5f6c7
*) Complete Index Transfer
...
See: http://www.yacy-forum.de/viewtopic.php?p=9622
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@711 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f783061414
*) Changing redirection code from 307 to 302
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@710 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
85958e5064
*) IndexControl_p.java: sorting peernames properly
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@709 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a6a8af0f04
*) httpdFileHandler templateCache can now be disabled
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@708 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
2cb084d426
*) Complete Index Transfer
...
See: http://www.yacy-forum.de/viewtopic.php?p=9622
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@707 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago