orbiter
dbdd10da84
better logging and startup behaviour for referenceHash computation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5690 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
borg-0300
d612430fce
copy paste mistake
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5689 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
borg-0300
acbdac1b67
corrected examples
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5688 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d64836c34f
added statistical analysis of URL reference
...
use that with the following command on a linux shell:
java -Xmx1000m -cp classes de.anomic.data.URLAnalysis -incollection DATA/INDEX/freeworld/TEXT/RICOLLECTION used.dump
for freeworld indexes.
For more details please see discussion below:
http://forum.yacy-websuche.de/viewtopic.php?p=13204#p13204
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5687 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3b28daab40
code-beautification (to be consistent with external documentation paper)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5686 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
396a4451be
increased timeout in ViewFile
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5685 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
485c9406e5
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1915&hilit=&p=13249#p13249
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5684 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
858f800a07
more logging in httpd to detect shutdown cause. See also:
...
http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1914&hilit=&p=13246#p13246
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5683 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
b80db04667
- refactoring of IntegerHandleIndex and LongHandleIndex (better method names)
...
- fix for problem in httpdFileHandler: mising close of open Files if tempate cache was disabled
- more memory for DHT selection required
- stub for URL reference hash statistics in index collections
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5682 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
9b6fac4a82
RichClient: better handling for small screens/windows
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5681 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
92375cfaa3
translation update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5680 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
8ee946bf1d
show upnp status
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5679 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f0947a20a8
- RichClient: increased ajax timeout to 10 sek.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5678 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e73ac67f7e
- for testing JsonP cross domain request I added apfelmaennchen-JsonP as search peer to RichClient
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5677 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
16f5c6a85e
fixed merge method initialization in ReferenceContainer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5676 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f7fd3d30c2
- various changes to RichClient
...
- improved search stability
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5675 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
4f3bdc64b5
- added ?callback= parameter for JsonP support
...
- this is needed for json ajax cross domain calls
- see: http://bob.pythonmac.org/archives/2005/12/05/remote-json-jsonp/
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5674 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
d84264946b
- Randspalte für Navigatoren in Suchergebnissen (display=3)
...
- http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p13195
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5673 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d7a493b4f5
added experimental timeline api
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5672 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
efcd95dc37
simplification of (internal) query process / refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5671 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
f1b712c29a
small corrections to image loading methods in result presentation
...
especially loading of favicons in search results. This is a fix that
affects only searches in intranet/repository configurations.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5670 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
98f36a801a
- small update to search result layout
...
- some more mime types
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5669 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
4f6658b115
* non-sliding api icon
...
* regex doc links update
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5668 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d4b56d5819
added more asserts to BLOBHeap.flushBuffer() to fix the problem described in
...
http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1679&hilit=&p=13109#p13109
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5666 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
c545fcb9fa
* add class to handle keys and signatures
...
* fix bug in serverCharBuffer
* add build-target to sign tar.gz (run ant dist sign)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5665 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
aa44d9bad9
more refactoring of kelondro.text / deleted de.anomic.index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5664 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6ffc6e3389
more refactoring of indexer and kelondro classes;
...
- integrating the indexer into kelondro as package 'text'
- renaming of classes in kelondro.index
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5663 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
404bc21da9
simplification of (internal) query process / refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5662 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
76ef5f0f14
refactoring of index package: better names for the classes (to be continued)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5661 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
2df57b1fd1
refactoring of index collection class
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5660 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
39a177649b
* added upnp listener for devices that do not respond to discovery but advertise themselves
...
* moved package
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5659 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d1d9fbae5c
enabling the URLAnalysis to operate on multime input files, just use a wild card when calling the class from the command line
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5658 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
c728879ab8
fixes to yacyURL - more exceptions in case that urls are strange
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5657 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7542336ae5
performance enhancement to yacyURL: omit second processing of resolveBackpath. This method is already applied during initialization of the object and was called a second time when the url was exportet.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5656 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7ea53fe47b
added another url list transformation option:
...
- check the list and kick out entries with lines that contain not valid urls
- normalize the urls
- remove doubles
- sort the list
- split the list in smaller chunks
This is all done in one process which can be called with a new -sort option
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5655 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
e521e81148
bugfix in yacyURL (for latest performance hack)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5654 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
54625360f7
performance update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5653 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d884c4718a
added gzip support for URLAnalysis:
...
url lists can also be compressed with gzip
If such a file is handed over to URLAnalysis, the output will also be written as .gz-file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5652 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
46632f4385
performance update to yacyURL
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5651 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
cf9b74e6e3
added another method to process url lists: extract hosts only
...
This can be used like
java -Xmx2000m -cp classes de.anomic.data.URLAnalysis -host DATA/EXPORT/20090224213823.txt
changed als the call method to generate statistics, please use now
java -Xmx2000m -cp classes de.anomic.data.URLAnalysis -stat DATA/EXPORT/20090224213823.txt
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5650 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
89d8e824ed
memory protection for URLAnalysis
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5649 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
0f6fa804ff
performance update to URLAnalysis
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5648 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
8444357291
added new row interator in kelondro tables files that enumerates rows
...
without an order by the primary key. The result is a very fast enumeration of the Eco table data structure. Other table data types are not affected.
The new enumerator is used for the url export function that can be accessed from the online interface (Index Administration -> URL References -> Export). This export should now be much faster, if all url database files are from type Eco
The new enumeration is also used at other functions in YaCy, i.e. the initialization of the crawl balancer and the initialization of YaCy News.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5647 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
e8f5f2f612
added tool to analyse url strings
...
and to generate statistics about words occurring in urls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5646 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
72cc1d3a6c
YaCy-UI: fix for query string handling in yacyuisearch.html: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1869#p12878
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5645 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
784a7bb7fd
YaCy-UI: small fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5644 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
aa13d03b99
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1874#p12914
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5643 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
6117e083e5
option to customize tray label (tooltip) with tray.label
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5642 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
b8c3803bfc
don't panic when canceling server sessions
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5641 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
daburna
1df1fd91b0
small update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5640 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago