orbiter
c83594528c
integrated crawl stacker into thread control
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@887 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d666b61b83
fix for news-deletion, see also http://www.yacy-forum.de/viewtopic.php?p=11000#11000
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@885 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
45f55a6fad
*) Bugfix for wrong index-queue size displayed on status page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@883 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c1c94111b0
added new network picture at Network menu using the new image-servlet method
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@880 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
a1777788a5
small change
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@879 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d98ed41f31
update to image painter and test on http://localhost:8080/imagetest.png
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@878 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
f65c939a60
userDB Auth
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@874 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5153ec0f3e
update to image painter
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@873 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c6f0e35a32
removed notifier.gif; this file is created automatically after startup
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@871 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1b2db0b52a
fix for file-share access; damaged some commits before by me :-(
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@870 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
f875eda9b7
changed 2, added 5 new picture for more information
...
added runtime to the list
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@869 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1a5d98cd6d
better imagePainter example and fix for typo http://www.yacy-forum.de/viewtopic.php?p=10920#10920
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@868 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
06f4ac494a
image-painter test; try with http://localhost:8080/imagetest.png
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@864 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
fb27428674
added restart to Status.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@863 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
13dd16d1dd
small change
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@861 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
5c4db6968e
sorted URL list, StringBuffers, finals, cleaned, Properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@860 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
2a18e6486b
cleaned, finals, Properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@859 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
64acb46a91
cleaned, finals, Properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@857 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
52168fab9b
cleaned, finals, Properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@856 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
be60b512b7
fix for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@855 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f6cf3967de
fix for compile-bug in svn 583 (Martin guck mal ob das richtig ist: fifo oder filo-stack?)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@854 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a2fa75e688
*) Asynchronous queuing of crawl job URLs (stackCrawl)
...
various checks like the blacklist check or the robots.txt disallow check are now
done by a separate thread to unburden the indexer thread(s)
TODO: maybe we have to introduce a threadpool here if it turn out that this single
thread is a bottleneck because of the time consuming robots.txt downloads
*) improved index transfer
The index selection and transmission is done in parallel now to improve index
transfer performance.
TODO: maybe we could speed up performance by unsing multiple transmission threads in
parallel instead of only a single one.
*) gzip encoded post requests
it is now configureable if a gzip encoded post request should be send on
intex transfer/distribution
*) storage Peer (very experimentell and not optimized yet)
Now it's possible to send the result of the yacy indexer thread to a remote peer
istead of storing the indexed words locally.
This could be done by setting the property "storagePeerHash" in the yacy config file
- Please note that if the index transfer fails, the index ist stored locally.
- TODO: currently this index transfer is done by the indexer thread.
To seedup the indexer
a) this transmission should be done in parallel and
b) multiple chunks should be bundled and transfered together
*) general performance improvements
- better memory cleanup after http request processing has finished
- replacing some string concatenations with stringBuffers
- replacing BufferedInputStreams with serverByteBuffer
- replacing vectors with arraylists wherever possible
- replacing hashtables with hashmaps wherever possible
This was done because function calls to verctor or hashtable functions
take 3 time longer than calls to functions of arraylists or hashmaps.
TODO: we should take a look on the class serverObject which is inherited from hashmap
Do we realy need a synchronization for this class?
TODO: replace arraylists with linkedLists if random access to the list elements is not needed
*) Robots Parser supports if-modified-since downloads now
If the downloaded robots.txt file is older than 7 days the robots parser tries to
download the robots.txt with the if-modified-since header to avoid unnecessary downloads
if the file was not changed. Additionally the ETag header is used to detect changes.
*) Crawler: better handling of unsupported mimeTypes + FileExtension
*) Bugfix: plasmaWordIndexEntity was not closed correctly in
- query.java
- plasmaswitchboard.java
*) function minimizeUrlDB added to yacy.java
this function tests the current urlHashDB for unused urls
ATTENTION: please don't use this function at the moment because
it causes the wordIndexDB to flush all words into the
word directory!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@853 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
01db66dc69
implemented image-servlets. the imagetest will stay there only for a limited time. Now images can be generated on-the-fly from servlets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@852 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
a9c466ef21
cleaned, finals, StringBuffer, Properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@849 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0c3a20d44f
more + changed log for better understanding of outOfMemory bug and others
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@846 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
d8544e8416
cosmetic
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@844 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
0cb9566546
HTML for last Commit.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@840 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
8d871a6a79
delete Function
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@839 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
7df4c85506
bugfix & cleanup
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@838 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
f58cfbf9a8
passive red to yellow changed
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@833 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
252492d031
update User
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@832 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
1b61b674db
changed method
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@831 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
2d481e89df
Michael would like it
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@829 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
60fc32ffeb
load values
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@828 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
8de3b2dd3c
User create function
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@825 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
ff1d3d0680
Init of userDB
...
Pagelayout of User_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@822 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
8d728d742b
remove my SVN 818 change
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@821 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
a3bb20ca88
New column Info replaced Type, Contact and accept Crawl/Index;
...
11 new pictures show the information in 11x32 pixel;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@818 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
1d1b8f699e
*) Extending proxy autoconfig to avoid problems with multiple local network cards
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@816 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
394fb5d484
*) Small changes that make entering values much easier for people who use the TAB-key to navigate through the page or who use textbowsers like lynx.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@814 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
138d218d5b
all big number have now separators (not Last Seen);
...
used dot instead of comma;
used yacySeed.constants;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@812 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
9c4306e41e
fixed problem with htcache path
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@811 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
25a59a51ad
fixed problem created with last svn commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@810 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0054d3b1a6
added age in network menu
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@809 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3dd7e90cdd
kbytes instead of bytes in performance settings; new default values
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@808 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2c7b490e30
memory-logging
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@804 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
ee347364d9
basic xhtml/css layout
...
-to test, replace #[he4ader]# with #[xhtml-header]#, #[footer]# with #[xhtml-footer]# and use the xhtml-style css
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@803 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7fc822a59b
changed handling of time-zones
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@801 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3c1d968d29
fix-fix for 792 and small changes in ftpc/download/dir experiments
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@797 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
dc474aa22f
various bug-fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@792 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
(no author)
1aa79f5bb5
cleaned;
...
Properties;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@790 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
694226d4b1
typo
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@789 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3fcc95a82c
integrated crawl-profiles db in memory-performance monitor
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@788 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
fe6a6abc0b
*) Adding robots.txt db to Performance Settings for Memory menue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@785 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
68d5ff2ef1
added stringbuffer in condenser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@782 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
c42a543bc3
*) Adding peername to logmessage when receiving URLs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@781 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
495bc8bec6
removed cache-control from low and medium priority caches which reduces memory use and computation overhead
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@774 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
1dc94e7753
*) Adding support for gzip content-encoding of http post requests
...
used to transferRWIs and transferURLs.
See: http://www.yacy-forum.de/viewtopic.php?t=1167#10020
*) adding yacyVersion.java containing constants defining yacy versions
that support a given feature.
Needed to determine if a remote peer is able to decode gzip
content-encoded http post bodies properly.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@772 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e6b9b23290
configuration of startup-memory in webinterface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@771 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
07f30931ec
various configuration options in memory performance
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@763 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2f732e32a2
enhancements to memory menue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@762 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
150bd33591
finals;
...
cleaned;
Properties;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@761 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e17df64b54
removed IS_ADMIN - feature. This was covered by plasmaSwitchborad.adminAuthenticated
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@760 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b5337a122c
some more information about available memory in PerformaceMemory menu
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@759 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
96a5b6e8fb
removed yacy peer types from serverSwitch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@758 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
71a31f0902
integrated and extended new memory performance menu; found and fixed bug in DHT caching
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@752 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fb52a82008
added new performance page for memory settings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@751 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
0f1bbff459
*) Tiny little job of cleaning up. (Was man nicht im Kopf hat, hat man in den Fingern...)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@750 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
4dbc871524
*) Trying to get rid of possibility of exploits in IndexCreate* through HTML and JavaSkript in peernames, URLs, <title>-tags etc. (see http://www.yacy-forum.de/viewtopic.php?t=1181 ) I hope I got them all and did not overdo it.
...
*) Just a tiny bit of cleanig up in News.java. (I messed it up myself some time ago.)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@749 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
effbf35f57
finals;
...
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@746 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
11e175630b
StringBuffers, finals;
...
cleaned;
Properties;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@745 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
22ffde70dd
more Properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@744 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
5543ea08ad
sorted directory/file list;
...
dont list responseHeader.db;
StringBuffers, finals;
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@739 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
d06aa558f5
back to 731
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@736 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
50a9500035
fixed 100% CPU bug with news queue deletion
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@735 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
f50d45678e
better values for BIG directory's
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@734 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
650764ce62
sorted directory/file list;
...
dont list responseHeader.db;
StringBuffers, finals;
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@733 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
51aa6d0b33
fix for performance-problem on CacheAdmiin_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@731 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
416c126815
fix for a profile = null problem and new monitor in crawl queue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@730 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
beefddf0e8
*) Adding option which allows to do a Index-Transfer without deletion of index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@722 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
16c371a385
finals;
...
StringBuffer;
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@720 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
40925f4fb7
*) Improving complete index transfer performance by automatically increasing size of transfered word chunk
...
for fast connections (much similar to normal dht behavior)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@719 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a62677f761
*) Adding additional logging output for complete index transfer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@717 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
7638b4181b
*)Undoing peername sorting
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@716 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
61d3b23ada
replace created with contributed
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@715 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
e0aadfe76e
sorted config list (Config_p.html);
...
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@714 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
3c00c5f6c7
*) Complete Index Transfer
...
See: http://www.yacy-forum.de/viewtopic.php?p=9622
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@711 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
85958e5064
*) IndexControl_p.java: sorting peernames properly
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@709 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
2cb084d426
*) Complete Index Transfer
...
See: http://www.yacy-forum.de/viewtopic.php?p=9622
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@707 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
595ec6faf1
svn keyword test
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@706 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
fdf38d6559
smaller StringBuffer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@705 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
0de9245975
big lists, accelerated 20x+;
...
cleaned;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@703 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8ba6be1d72
*) Bugfix for "YaCy verzählt sich ..." Bug.
...
See: http://www.yacy-forum.de/viewtopic.php?p=9559
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@700 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
5fb898870b
Partial bugfix for http://www.yacy-forum.de/viewtopic.php?p=9507
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@692 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a2fec3bb1c
*) Bugfix for " java.lang.NullPointerException at hello.respond(hello.java:167)"
...
See: http://www.yacy-forum.de/viewtopic.php?p=9471
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@685 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
d666630bad
*) Bugfix for Status class not found
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@683 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
e6338b4390
*) Bugfix for "Error with request: GET http://localpeer:80/IndexDelete_p.ht "
...
See: http://www.yacy-forum.de/viewtopic.php?p=8906
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@678 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
dc85b1021e
*) Bugfix of Delete-Indexqueue-Entry, Clear Indexing Queue functionality
...
- htcache files will now also be deleted if entry should not be stored into cache
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@667 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
4557966cdb
*) avoiding the possibility of news pages getting messed by HTML in news messages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@658 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
e19ededd66
*) prevents problems due to HTML code in profiles (my posting from 05.Sep.2005 http://www.yacy-forum.de/viewtopic.php?t=964 )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@657 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
22adb555de
replaced o.compareTo() with o.equals()
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@648 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
966c527966
Improved german translation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@647 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
dc0a2d4c11
*) Bugfix for Loader Queue:
...
Job count was not displayed correctly
*) IndexingQueue:
- now it's possible to delete single entries from the queue
- now it's possible to clear the whole queue
See: http://www.yacy-forum.de/viewtopic.php?t=995
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@641 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
732a107160
*) Bugfix for "-UNRESOLVED_PATTERN-" Bug on IndexCreateWWWLocalQueue_p.html and "urlEntry.url() == null" Bug
...
- Logging message for "urlEntry.url() == null" is now displayed as info
- IndexCreateWWWLocalQueue_p.html now detects null entries while looping throug the list and removes them automatically
See:
- http://www.yacy-forum.de/viewtopic.php?t=532#8781
- http://www.yacy-forum.de/viewtopic.php?t=639
- http://www.yacy-forum.de/viewtopic.php?t=1071
- http://www.yacy-forum.de/viewtopic.php?t=338
- http://www.yacy-forum.de/viewtopic.php?t=980
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@640 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
33aaffbfc6
*) Displaying content size of each entry in indexing queue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@639 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
0471019606
*) IndexCreateIndexingQueue_p.html now also shows indexing jobs that are currently in process
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@633 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
bead8a32aa
*) IndexCreate_p.java:
...
Crawler StartURLs will now also added to the errorURL-DB if an error occures on this url
*) kelondroStack.java, plasmaSwitchboardQueue.java
Adding method which returns a list of all entries in the queue. This list is used by IndexCreate_p.java
instead of an iterator to display the indexing-list.
Advantages: avoid concurrent modifications of the list while displaying it.
Speedup because now we have to access only one sync function instead of multiple ones
(one for each entry)
*) IndexCreateIndexingQueue_p.java
Using new list() function of plasmaSwitchboardQueue
*) httpdFileHandler.java
If a servelet returns the special value "LOCATION" the httpFileHandler does a Redirection of
the Browser to the URL specified by the servelet. This can e.g. be used when a http get request is
used insead of a post request, but a refresh should not be allowed.
*) IndexCreateWWWLocalQueue_p.html
Now it's possible to delete single entries of the local crawler queue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@626 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
66bab602e1
*) Bugfix for "wrong link to IndexDelete_p.html in status text after new crawl job was started"
...
http://www.yacy-forum.de/viewtopic.php?p=8827
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@624 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
3563552bd3
*) Renaming Logger function names to reflect the proper Java Logging API Loglevels
...
- please use logFine instead of logDebug
- please use logSevere instead of logFailure and logError
See: http://www.yacy-forum.de/viewtopic.php?p=8726#8726
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@616 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
4fd5b95b1f
*) Renaming Logger function names to reflect the proper Java Logging API Loglevels
...
- please use logFine instead of logDebug
- please use logSevere instead of logFailure and logError
See: http://www.yacy-forum.de/viewtopic.php?p=8726#8726
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@615 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
6adf8a4bde
*) Renaming Logger function names to reflect the proper Java Logging API Loglevels
...
- please use logFine instead of logDebug
- please use logFailure instead of logError
See: http://www.yacy-forum.de/viewtopic.php?p=8726#8726
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@614 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
a88e6d3ba2
increase max length
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@612 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
eac34cf772
no negative values
...
See http://www.yacy-forum.de/viewtopic.php?t=1021
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@611 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
904ab7aa39
Bugfix 5.0 to old version
...
See http://www.yacy-forum.de/viewtopic.php?t=1064
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@609 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
bf14e6def5
*) proxyCache, proxyCacheSize can be changed under 'Proxy Indexing'
...
- path now are absolute
*) move path check from plasmaHTCache to plasmaSwitchboard
- only one path check when starting
*) small other
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@606 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
3c1e105009
*) smaller file, save 9 kb
...
*) rename the old file to *.bak
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@599 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
578b0c525c
*) test: first 'Commit'
...
*) added notifier.gif
See: http://www.yacy-forum.de/viewtopic.php?t=1029
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@598 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
cc26779aeb
*) fixed broken link problem in profile. see http://www.yacy-forum.de/viewtopic.php?t=964 for details
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@597 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a812fb86cc
*) Port Forwarding Feature does not detect broken connection properly.
...
Therefor a test-request was added to the isConnected function to detect broken connections
and to keep open connections alive
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@596 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
b778493aae
publicIP() fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@593 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
0d912a3de9
removed not needed copyFile Method.
...
(same exists in Skins_p.java (there its used))
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@585 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
e569a84dc0
*) Using the same configuration settings for all indexing threads on server Startup
...
See: http://www.yacy-forum.de/viewtopic.php?p=8349
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@584 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
17be77a468
*) Bugfix for "Crawler data will not be removed from htcache if content parsing failed"
...
See: http://www.yacy-forum.de/viewtopic.php?t=965&highlight=ramdisk
*) Making ACCEPT_LANGUAGE configureable for crawler
See: http://www.yacy-forum.de/viewtopic.php?p=8327
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@583 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
cf03c139e7
*) Adding missing include file for splitted status page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@582 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
858cb983d7
*) Printout date and system name on proxy error page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@581 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
b2d48ebcef
*) Splitting Status Page into Private and Public Informations
...
*) Adding Queue overview to status page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@576 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
cb97d2972e
*) Bugfix for "peer not accessible via .yacy name if Transparent Proxy Support is enabled" bug
...
See: per Browser nicht erreichbare Peers
*) Proxy Error Page now displays the Peer Name on top
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@575 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
330eae7cf3
*) Normalizing CrawlerStartURL now before crawling is started
...
*) CrawlWorker also does a URL normalization now before following the redirection URL
*) CrawlWorker removes redirection URL correctly from noticeURL stack now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@571 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
c47bb1182d
bugfix for assortment initialization error
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@547 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
c3e1abffaf
Small changes for 0.40
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@544 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
low012
d242cf7a6d
added a Preview button to yacyWiki
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@543 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
25f632dbd9
more DHT bugfixes and better logging of DHT effects
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@542 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
dbba052331
removed internal addres presentation in interface according to http://www.yacy-forum.de/viewtopic.php?p=6779#6779
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@541 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
5cb00889d9
enhancements to dht selection, search and search presentation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@540 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
ba0a486328
moved printStackTrace() to logging
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@539 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
ea780a7afc
Additions to the language file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@537 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
8d6c288f04
display of peer name in headline; see http://www.yacy-forum.de/viewtopic.php?p=7466#7466
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@535 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
28bf20608b
Converted standard content-charset for HTMl pages to UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@533 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
cd10370992
several bugfixes and dht selection / logging improvement
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@531 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
da81dcd66a
Corrected regex-tutorial...
...
Wenn noch was falsch ist, einfach korrigieren.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@528 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
ed978c8564
added words; see http://www.yacy-forum.de/viewtopic.php?p=7349#7349
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@525 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
7db543a9fa
fixes for several dht misbehaviours
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@524 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
20002b6386
Added Regex tutorial to Help.html, because many people don't understand Regex.
...
Added german translation for Regex tutorial.
Added bold and underline to bbCode.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@522 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
5716f8521d
bug fixes for word ordering and dht index selection
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@521 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
41cd5e930a
*) Adding missing Template for SOAP API
...
http://www.yacy-forum.de/viewtopic.php?t=169
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@520 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
a223faace1
not recursive, but it should work on Windows.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@516 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
ee0a9a2d9b
recursive Translations.
...
You can now translate the Menu and other things in subfolders, too
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@508 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
ec07928807
faster listing and news aging enhancement
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@505 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
53dcbadfbf
using Wikicode instream of bbCode
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@504 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
8659a689f4
seperate Class for the wikiParser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@500 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
865b9490a2
*) Making DHT Transfer while Crawling configurable
...
See: http://www.yacy-forum.de/viewtopic.php?p=6904
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@496 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
0610e83468
*) Bugfix. recipient peer was accidentally displayed as source peer of a url transmission.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@495 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
0211c4f297
Added scripts for Windows ME and 98 as requested in http://www.yacy-forum.de/viewtopic.php?t=839 .
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@494 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
bb3e897baf
mor minor changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@488 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
2d8557cb10
minor changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@487 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
eacff63eda
Typos...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@482 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
228b04b499
*) Bugfix for "wrong seed-upload timestamp" problem
...
http://www.yacy-forum.de/viewtopic.php?t=817
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@480 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
34f449e6f1
Added description of the "one character links"
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@479 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
low012
77f4a3d99d
yacyWiki now supports the [[Image:]] tag
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@478 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
470839a16a
*) Crawler/Session pool settings will now be stored properly into configfile
...
Bugfix for:
- http://www.yacy-forum.de/viewtopic.php?t=502
- http://www.yacy-forum.de/viewtopic.php?t=778
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@477 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
e84a177c49
many bigfixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@475 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
9ee8a5ba6c
fixed big in yacynews
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@474 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
083c8ddc69
new alert symbols
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@473 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
93811dc6e0
wiki-update-marked entries in network now link to the updated wiki page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@471 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
e9bfa80050
integrated Wiki to Main Menu
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@470 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
bcc292ad12
added self-news; added news in case of wiki update; added crawl announcement on Network page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@469 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
5157159281
update of links
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@467 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
d34eb23e4e
fixed news; added news appearance on Network and IndexCreate page; added intention string to global crawl
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@466 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
5672709ef3
several bugfixes for YaCyNews
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@465 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
e24dbde217
better logging for WRONG seed
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@463 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
41be998391
*) Removing confusing colon
...
See: http://www.yacy-forum.de/viewtopic.php?p=6305
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@462 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
1022fbeb65
many YaCyNews fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@461 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
13abd8b6e7
added news-creation at crawl start
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@460 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
f555b9d5f2
Translation, spelling...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@459 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
849b194149
fixed news receipt and added processing buttons on News page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@458 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
f65dd694a1
integrated news service: update of profile
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@456 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
60117a2073
integrated YaCyNews basis
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@455 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
b99205e445
Translation, spelling...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@448 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
low012
515d6c00eb
Fixed a typo and changed the order of some words. (Sounds better to me now.)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@446 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
0174df12af
deny of global search in case DHT is switched off
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@445 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
81e564edb8
faster crawl profile list cleanup
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@442 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
e5a63c3c70
cleaned up search interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@441 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
85877413a0
tried to fix principal bug .. not succeeded
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@440 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
2181982ce5
disabled buttons on Status page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@439 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
ad90f0ad13
activated RWI distribution to DHT for senior peers (default redundancy 3), necessary now for network growth
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@438 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
b9d18d40cb
configuration of proxy idle time in performance menue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@436 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
3470a72d48
fixed div by zero, set default delays, fixed release number format and display
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@435 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
12da0c2758
http://www.yacy-forum.de/viewtopic.php?p=5645#5645
...
the line with ??? does not work...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@434 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
89e9e467d2
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@433 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
45378323c3
stupid mistake
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@430 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
fc83032579
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@428 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
be1f324fca
performance setting for remote indexing configuration and latest changes for 0.39
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@424 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
69afae514d
Updated translations...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@422 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
c64970fa47
re-implemented proxy-busy-check and fixed some other things
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@421 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
86d778f7bc
default-button in profile menue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@419 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
b6d32f7f89
bugfix performace-menu
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@418 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
b73557ed2d
better assortment monitoring and enhanced profile menue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@416 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
e16e4ba32b
staticIP/DynDns Settings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@414 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
a2cf76ea7c
bugfixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@413 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
25a7d4c982
Finished translation of status.html into german. I hope I forgot nothing...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@410 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
0f11399d16
Some corrections...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@409 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
9f505af7aa
preparations for bulk remote crawls
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@408 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
0f663bcebf
added global ppm computation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@407 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
51962d55bf
added 'PPM', page-per-minute statistics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@405 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
c47736a158
configuration of number of output lines in IndexMonitor
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@402 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
19dbed7cc8
code clean-up
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@401 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
40036ba69c
fixed dht transmission; added url-blacklist blocking also for remote search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@398 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
311e627363
blocking of blacklisted urls in indexReceive and small changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@397 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
13eeaa08f3
*) httpc.java:
...
- Now it's possible to interrupt pending httpc-actions on server shutdown
- this is possible because of a newly introduced registration mechanism for
open sockets
*) yacyCore.java
- blocking peerPing threads can now be interrupted on server shutdown
*) serverCore.java
- restructuring shutdown code
*) error.html
- port number is now set correctly if port forwarding was enabled
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@389 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
5c3822d5f4
*) adding experimental support for parsing of bookmarksfiles
...
See: http://www.yacy-forum.de/viewtopic.php?t=177
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@388 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
419f8fb398
fixed bugs/missing code regarding new crawl stack
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@384 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
858cd94299
replaced indexing ram-queue by file-based stack-queue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@381 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
4851b432e1
nice Version display(without svn rev added)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@380 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
252c6e4869
added crawl queue monitor for global crawls
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@372 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
e2d8766fa7
Nearly finished translation of Status.html...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@371 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
9a3f80403e
redesigned IndexCreate menu -- introduced submenues to enable more crawl queue control pages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@370 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
0e2c33ee55
*) Network.html/Network.java:
...
- Adding function to manually force peer ping to remote yacy peer
See:Network.html?page=4
- for debugging purpose only!
*) serverAbstractThread.java:
- Adding posibility to notify a server thread via a synchronization object
- this is needed e.g. by the port forwarding feature to send a notification
to the peerPing thread to redo peer-ping with the new ip/port Settings_p.html
*) Port Forwarding Feature (it should work now)
- adding a serverThread which is responsible to detect broken port forwarding
connections and to do reconnect if needed
- serverCore.java: moving port forwarding initialization into a separate function
- adding positility to configure the ssh port
- moving configuration section on the gui into a separate fieldset
- hello.java: only trying to do a second connect to the clientIp address during
peer handshake if either remote port forwarding is not enabled locally or
the clientIP is not equal to any local ip
*) httpdFileHandler.java:
- printout a more verbose errormessage
*) httpc.java
- allowing to deactivate content encoding from outside
*) plasmaCrawlWorker.java
- the crawler worker now tries to refetch the content of a website without
gzip content encoding if a gzip error occured
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@368 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
5159a090b0
fixed parser bug with lowercase force (appeared in: http://spellbound.sourceforge.net/ )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@367 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
377e94f30e
The usual stuff...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@366 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
fbef7fed81
adopted latestVersion to float handling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@363 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
f32ce64789
Began translation of status-page...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@361 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
eb74fa0c82
fixed a bug with snippet-length
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@359 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
1a75762897
Translation...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@357 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
8290969150
Automatic regeneration of Locales on Restart with a new (SVN) Version
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@353 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
129929b396
Preparations for automatic Languagefile upgrade on new YaCy Version.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@352 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
35c7a5883b
First update of german language file + corresponding changes in HTML-file. Many will follow...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@349 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
bef3aaec38
better Translationsystem.
...
You only need to escape Chars, which have special meanings in regexps.
some you have to escape: ()[]{}
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@348 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
712fe9ef18
bugfixed utf-8 decoding and parser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@346 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
allo
63f9570d3a
bbCode
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@344 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
ec397c343c
*) Allowing longer forwarding commands
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@336 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
d50ad1521a
*) correcting logging statement
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@335 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
8718795c6d
Using theli's anchors on Status.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@334 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
9d8c66fb5e
*) adding possibility to forward received yacy-messages (htroot/yacy/message.java)
...
via a command-line email program (e.g. sendmail) to a configured email address
- the configuration dialog is reachable via Settings_p.html#messageForwarding
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@332 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
low012
24d77b892f
This changes eliminate a way to cripple Profile pages on other peers by sending special messages with HTML tags.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@331 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
dbd06eace9
Used "id" tags instead of <a name="XXX">XXX</a>.
...
This avoids links without target, which change colour on mouseover, but are not clickable. (<-- Das Wort gibt es bestimmt nicht...)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@330 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
08e4334c1d
*) Status.java: showing amount of time since last upload of seed-file
...
*) hello.java: adding additional output for principal-downgrade bug
*) httpd.java, httpdFileHandler.java, httpdProxyHandler.java: improved errorhandling
*) yacyCore.java: trying to fix principal-downgrade bug
*) yacySeed.java: adding some constants
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@329 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
low012
a333715ffd
This changes eliminate a way to cripple Message pages on other peers by sending special messages with HTML tags. (See forum for details.)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@325 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
aad2268751
*) adding menue to top of configuration pages
...
- IndexCreate_p.html
- Settings_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@324 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
3addf58046
enhanced snippet-loading with threads
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@322 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
56d28a16f0
bugfixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@320 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
d53b2393e5
*) autoconfig.java: ip address was not reported correctly when port-forwardin is on
...
*) hello.java: reportedip my be empty at peer startup
*) httpc.java: adding method to determine if the connection was already closed or is broken
*) httpdProxyHandler.java: trying to do a better errorhandling
*) server/serverCore.java
- setting myseed ip-address and port correctly if port-forwarding is on
- doing a more failsafe close and adding some debugging output
*) yacyClient.java: adding some logging statements to allow a better detection of
"degraded to senior"-bug
*) yacyCore.java: restructuring publishMySeed
(@Orbiter: pleas take a look)
- to avoid buzy waiting
- to allow a gracefull shutdown on server shutdown
- new seed count was not calculated correctly in the previous version
*) yacySeedDB.java: host ip and port was not initialized correctly if port-forwarding
was activated
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@318 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
933256bbfc
*) adding href's to allow direct access to the currently crawled website
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@317 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
83ceec3a63
*) Bugfix for wrong "Statusanzeige"
...
See: http://www.yacy-forum.de/viewtopic.php?p=4560
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@314 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
1e7f062350
many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@313 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
theli
dc1d707eb2
*) Deactivating "Port Forwarding Feature" for a while because of too many problems at the moment
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@312 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
low012
afe7cbe4de
just a typo...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@310 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
low012
10f6f19c08
Fixed one typo and added a few options to handle messages when messages get displayed.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@309 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
rramthun
cf171ca35d
Some corrections to the webinterface...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@306 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
85075269a6
extended fail-safe memory-managament. prevents too much allocation, too often GC and should help for the 100%CPU-bug
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@303 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter
10781f36b7
changed performance menu to accept milliseconds; 200 milliseconds may be appropriate for all crawling jobs; indexing should be set to 0
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@299 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago