f1ori
9589dfe080
* removed trayicon popupmenu title
...
* added some menu items to trayicon
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5213 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
5a637f004d
localized tray
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5212 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
9d4f0325e1
- removed shutdown from search page (we have it in tray now!)
...
- fixed doubleclick action for tray
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5211 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
214277dad6
- revert r5202
...
- cleanup
- installer checks for JRE 1.6 only
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5210 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
7afa084207
* add nativ java trayicon, using reflections
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5209 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b97ff24b43
bookmarksDB / xbel.xml:
...
- added support for folder=/foldername
- it crashes if foldername ends with /
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5207 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6e7d113eac
fix for wrong index initialization after network switch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5203 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
0a0cc3bf67
added missing classes to build target "run"
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5201 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7b35d54c6c
fixed some problems with network switching (was not completely 'clean')
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5200 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
f0b42e5a98
fixed NPE
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5199 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
8e0de7f180
update to language statistic evaluation:
...
- the condenser does not abandon too small words any more before feeding the statistics
- for text indexing no more urls are used to feed the index (this was wrong, but in contrast the indexing of urls for media search is necessary)
- urls are not used any more to feed the statistics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5197 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
1198eeecc7
added language selection to search query:
...
- the language can be selected using a LANGUAGE:<language> element in the query line, i.e.:
java LANGUAGE:en
- the language can be selected with a post element in google-style syntax with the 'rl' element:
?lr=lang_en&query=java
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5193 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
00c1535f84
added ranking and evaluation of language type in a search
...
the wanted language is taken from the browser user-agent string
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5192 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
a81cb78211
finally some putHTML on htroot/xml/
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5188 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
bfcf9b7aa3
- added language detection using metadata from documents: html and odt documents provide this information
...
- metadata and results from statistical analysis are compared and result is printed out as debug lines
- added ranking profile for wanted language
- added class with ISO 639 table, a list of all valid country codes that will be used for the language identification
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5187 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
5e8bd0f29c
small fixes to getpageinfo_p.xml and htmlFilterContentScraper.java with respect to keyword extraction
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5185 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
5b2a57bfd0
- /xml/util/getpageinfo_p.xml added <desc> and <lang> tags
...
- changed htmlFilterContentScraper.getKeywords() to split either space or comma charater not both
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5183 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
e1f67262f7
- added and removed some debugging output
...
- fixed a bug with merge method
- patched wrong output of language identification (not fixed, only patched!)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5181 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ce2a7ed116
integrated language detection classes into condenser environment
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5180 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
2b13705839
fixed a mistake in indexing queue processing: documents had been parsed before it was checked if they should be indexed or not. parsing was not necessary for this check, so the check was moved in the queue in front of the document parsing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5179 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
21dbb39afa
switched two balancer cases
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5177 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
1bbf362cef
update to the crawl balancer: better organization and better crawl delay prediction
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5176 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ddcf285499
- fixed a bug in performance setting (did not work with german translation)
...
- reduced maximum number of error url references to save some memory (this was actually a small memory leak)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5174 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
0cd0fee546
fixed bug with wrong proxy result enqueueing. See:
...
http://forum.yacy-websuche.de/viewtopic.php?p=8130#p8130
- removed the online status property. This influenced the proxy behavior and created some complexity that was not needed because the online status was never used as it was ceated for (offline browsing)
- checked all proxy identification procedures during crawling and enhanced transparency and error checking
- fixed a proxy identification routine that caused the wrong selection of the proxy result queue
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5173 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
670244849d
fix for http://forum.yacy-websuche.de/viewtopic.php?p=9835#p9835
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5164 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
fd9233244e
configurable free disk space via disk.free
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5163 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
25a62cdc3f
small fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5161 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
73f233bb11
* set resource observer to 1000MB
...
* transparent favicon
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5160 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
5fbccfd75e
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1366&p=9348#p9348
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5155 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
a28faabfd2
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1351&p=9242#p9242
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5154 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
7b63c66a08
- bugfix in bookmarksDB.Tag.hasPublicItems()
...
- this anoying little bug prevented display of public items without admin login for /xml/bookmarks/...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5151 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
1fb1665e71
increased dht interval to avoid peer selection failure
...
(maybe too less peers available to fill the big gaps)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5143 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
1eb813bd43
shifted index deletion-on-exit rule to the class where the errors are produced
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5141 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
ba76995d2c
* fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1415
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5140 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
bea6c13139
* with r5137 robotParser didn't work at all -> fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5139 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
3ded1efe84
kelondroExceptionCounter didn't work
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5138 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
ae677e1738
* fix problem in robotparser, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1421&p=9742
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5137 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
383d89481e
count errors before deleting collection.index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5136 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
0bb4fbc403
delete corrupted collecion.index on exit for rebuild on next start
...
see http://forum.yacy-websuche.de/viewtopic.php?p=9725#p9725
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5135 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
b68d06a6e8
performance settings based on network's remote crawl speed
...
removed some _pro values from config
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5134 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
d60b2b198d
proxy fixed 'not modified' http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1419
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5133 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
bd0318ba81
* YaCy only supports gzip-encoding, so remove any other encoding from request
...
* fixes http://www.yacy-forum.org/viewtopic.php?f=2&t=163
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5132 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
bb5c898441
enhancements to localsearch behavior
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5131 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
42e2d195ac
added hint from http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1294
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5130 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
39964e88fa
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1329#p9121
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5129 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3f3673b6e5
extended balancer:
...
- added automatic time delay in case that a large number of urls come from the same domain
- added additional time delay in case that an url is a dynamic (CGI) url. This shall cause less IO on targets
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5128 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3c6e8d2015
set default ppm when network is switched
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5127 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3288c19c1a
reduce remote crawl PPM for fresh peers in freeworld to 6 PPM
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5124 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
5ce9a100bb
fix(2) for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1416
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5122 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
cf29ca19d4
possible fix for POST character encoding http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1374
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5121 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago