e6d51363ee
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
a231d0eeb9
Run from Java the whole app YACY
...
start for java webStart
allow for better integration with IDE
Conflicts:
source/net/yacy/gui/framework/Browser.java
13 years ago
72adbeae90
!Important: move from Hashtable to HashMap
...
Hashtable is an obsolete collection v1, now since v2 offers HashMap with same or better
functionality. Please review, almost all code was already moved, so only a few changes. That is not the issue,
but I found notices that some (ugly big) helper classes had to be created in past
to compensate missing Hashtable's functionality. I'd like input if we can remove some of them.
look for //FIX: if these commits
Signed-off-by: Marek Otahal <markotahal@gmail.com>
13 years ago
c1af123ddd
just a little faster toString
...
Signed-off-by: Marek Otahal <markotahal@gmail.com>
13 years ago
64e4bcee82
serverSwitch get(App/Data)Path() use common helper method
...
Signed-off-by: Marek Otahal <markotahal@gmail.com>
13 years ago
371fbb4deb
just comment + shorter code in serverSwitch
...
Signed-off-by: Marek Otahal <markotahal@gmail.com>
13 years ago
ed253b7aff
update javadoc, does not throw IOException
...
Signed-off-by: Marek Otahal <markotahal@gmail.com>
13 years ago
f40efb39af
Blacklist loadList() remove duplicates by using Set
...
Signed-off-by: Marek Otahal <markotahal@gmail.com>
13 years ago
f75b5e40e0
little fix in copy()
...
Signed-off-by: Marek Otahal <markotahal@gmail.com>
13 years ago
1dc5d9f0f3
make ConnectionInfo comparable and sort list of connections in Connections_p
...
ConnectionInfo compare by initTime
Connections_p implement wish to sort connections, descending
Signed-off-by: Marek Otahal <markotahal@gmail.com>
13 years ago
fa8da7f89d
vocabularies are now also used as source for a did-you-mean computation
13 years ago
eaec14ecc4
Dictionaries from words caches can now be used as autotagging vocabulary
13 years ago
91940fdf56
redesign of WordCache to be prepared to hold multiple
...
independent dictionaries. Such dictionaries can then be also used as
simplified vocabularies.
13 years ago
bd40a10230
added autotaggig stub .. only reading and parsing of vocabularies at
...
this time
13 years ago
2ee8cbeb2c
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
...
Conflicts:
source/net/yacy/search/Switchboard.java
13 years ago
992dbdf4bb
added noload statistic to servlets
13 years ago
354b976110
fix for concurrency problem and endless loop in /suggest.json
13 years ago
c21966bb43
fix
13 years ago
13b05f9c08
fix
13 years ago
e5d878c59e
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
...
Conflicts:
source/de/anomic/crawler/CrawlQueues.java
13 years ago
ec26b2bea4
Merge commit 'fa08ed5ae5d72bddc3cc6a662b23103579e86109' into quix0r
...
Conflicts:
source/de/anomic/crawler/CrawlQueues.java
13 years ago
eebc02f5c1
fix
13 years ago
216a287a85
Merge commit '6d4e08ed06c5cd28c45981b2ebe31c7f7ec6fd83' into quix0r
...
Conflicts:
source/de/anomic/crawler/CrawlQueues.java
13 years ago
d18095dc48
Patch fuer Issue 0000102
...
and fixes to Patch (private peer status is a property of a peer, not a
status)
13 years ago
9f1b1b4604
Type for Robinson-Mode/Private Perr added
13 years ago
20962a4ed7
added metadata node stub for metadata from blobs
13 years ago
575dbbaa93
enhancements in Blob retrieval: try to use less CPU resources by testing
...
a blog first that most certainly has wanted entries.
13 years ago
585a8f3c44
fixed a bug in search sequence (caused emtpy results)
13 years ago
361146dd7a
better error handling for file loader
13 years ago
6d4e08ed06
Rewrote filesize() to (hopefully) avoid a NPE, rewrote Blacklist class to concurrent classes to avoid a CME
13 years ago
901f37d608
Also this ... :( #2
13 years ago
a985717ed2
Also this ... :(
13 years ago
5f490de554
Fix for ported fix from my old days ...
13 years ago
fa08ed5ae5
Fixed a lot CHMOD rights (no need for execute flag on *.java/*.html) and introduced local/remote crawl size ratio based check
13 years ago
319fd1f4aa
A concurrent access can happen on the blacklist (with latest introduced blacklist check in media snippet computation)
13 years ago
a3083d13bf
Blacklist checks are now always turned on, in media searches (e.g. image search) images matching blacklist entries are no longer shown to the user
13 years ago
52184a1170
fix for search process
13 years ago
85bd4cc8bc
better lookup for peer names
13 years ago
20e3084bd4
redesign of fining of peers by ip: more leightweight method to read the
...
seed databases
13 years ago
0797b0de99
new handling of remote search processes: looking for seeds will now not
...
block the whole search process any more. A deadlock with a DHT selection
process may have been the cause for interface lockings in the past.
13 years ago
ee9aae5cc0
more about CreativeCommons license vocabulary
13 years ago
ecd74fe34f
less dramatic upnp failures
13 years ago
c75e1a3125
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
13f5b5f80d
the component part in the YaCy Metadata is filled using the Dubling Core
...
vocabulary
13 years ago
8d2cbfb685
more vocabularies and more semantics for lod data structures
13 years ago
9cd36b4c44
added vocabulary for geolocalization as used in georss
13 years ago
9e5894c784
Removed handling of components objects for URIMetadataRows.
...
This is a preparation to replace this rows with nodes from the node
store.
13 years ago
66ab51f89d
added rdf vocabulary
13 years ago
c04bfaa51b
refactoring
13 years ago
136b514f52
added a Triple Store based on Nodes that fit to the new storage classes.
...
Added also a first Vocabulary for the node store - Dublin Core.
13 years ago
613ab6a69d
added BEncodedHeapBag and BEncodedHeapShard which are storage container
...
for a new metadata store. An abstraction of the content for this storage
is defined with MapStore. A MapStore is an abstraction of a RDF Node
store.
13 years ago
6fecd0db88
one more performance hack to prevent costly md5 computation
13 years ago
e13441b069
better digest pool size (smaller by default but unlimited)
13 years ago
1f4afb4dc0
performance hacks
13 years ago
675d557e88
removed debug logging
13 years ago
e9dc99fe15
added rules to set specific RWIs as private RWIs which are not
...
transmitted to remote peers. This will be used for private index copies
and phonetic indexes.
13 years ago
4243ace863
added phonetic classes
13 years ago
0bcef2d156
added feature as requested in
...
http://forum.yacy-websuche.de/viewtopic.php?f=18&t=3461
The search can now be configured with a non-display host list.
the search will always exlude the given list of host unless they are
requested directly using the host navigation
13 years ago
204c29f010
small bugfixes for search result display and cache display
13 years ago
17f962fceb
translator updates:
...
- config string for chinese
- do not copy the language file to DATA/LOCALE any more (and do not use
them there, this is really confusing for new translators)
13 years ago
752b092b8a
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
078fcde0dd
bad initialization
13 years ago
391fc9bd57
Merge branch 'master' of gitorious.org:yacy/rc1
13 years ago
23afee58fe
Merge branch 'master' of git://github.com/f1ori/yacy
13 years ago
14e45e90fd
patch for a bug that I don't understand by now.
13 years ago
3eccdca63c
protection against too long running snippet fetch processes
13 years ago
86b3385847
fixed a deadlock during secondary remote search
13 years ago
ff19fcdb28
bugfix for YMarks XBEL import and export; thanks to Dominic
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8138 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
c715d19c09
fixes for dependency on svn
13 years ago
404758698a
less io operations
13 years ago
0bc5d76bee
ups
13 years ago
044f83feed
added some pauses into the search process which shall produce
...
better-ranked search results. without that pauses the result page will
only contain links from the peer that answers first which is not a good
average picture of all the peers that provided results
13 years ago
943b670738
less terrible warning if uPnP fails
13 years ago
448656087a
probably fix for http://bugs.yacy.net/view.php?id=94
...
(don't know how to force this exception)
13 years ago
f14faf503b
better ranking because we wait a very little time during the search
...
process more to get better remote sear results into the ranking priority
stack
13 years ago
762e0ecfb6
fixed localization dictionaries, see
...
http://forum.yacy-websuche.de/viewtopic.php?f=5&t=3418&view=next
13 years ago
6e66c9d7f1
fix for http://bugs.yacy.net/view.php?id=87
13 years ago
d35bdc2df6
removed npe
13 years ago
e7e429705a
- less automatic indexing after a search (needs to reset the default
...
crawl profiles)
- fix for concurrency problem in storage of serverSwitch Properties
- markup update
13 years ago
a4ac051029
Merge branch 'master' of git://github.com/f1ori/yacy
13 years ago
7cfdc2c092
Improved CGI capabilities:
...
*) CGI respects shebang now (should solve problems with MS Windows)
*) better error handling (more correct HTTP error codes)
*) logging
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8136 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
9cd469e6d6
added pull request from als plus an NPE fix
13 years ago
484c4ad339
Merge branch 'master' of git://github.com/f1ori/yacy
13 years ago
402e9d71ef
changed ording on release files: main criteria is not the svn any more; releases are now ordered by
...
- release number
- date
- svn number
additionally there is a new option to remove the svn number completely
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8135 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
29f07fea33
Merge branch 'master' of git://github.com/f1ori/yacy
13 years ago
11729061f2
added an option in the bookmark import process to put everything into the crawler
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8134 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
b9c5ce6cae
Merge branch 'master' of git://github.com/f1ori/yacy
13 years ago
70bcfc150a
- small bug fix to ymarks html importer
...
- import of delicious.com exports has successfully been tested
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8132 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
56ce8488e4
Merge branch 'master' of git://github.com/f1ori/yacy
13 years ago
4b8ff84705
- search bugfixes (page counter and number of results per page; recognition of new search)
...
- experiments to speed-up the network image production (commented out)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8130 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
aeeae75b8a
the timeout of httpclient is not absolut, but till a connection is
...
established or between bytes send
trying this to reduce count of client-connections to /yacy/search.html
of other peers
13 years ago
2ac272cfbf
Fix for PeerSelection.seedsByAge() for big networks (>1000 Peers)
...
To get the most(least) recent peers search those with highest(lowest) LastSeen instead of the first by peerhash
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8129 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
b5d9f631e3
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8128 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
83335c3b09
fix for http://bugs.yacy.net/view.php?id=78
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8127 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
39898cb94a
Added try/finally protection to ensure streams are closed. Added initial size guess for the CharBuffer
13 years ago
4c67a964a1
Added try/finally protection to ensure streams are closed. Added initial size guess for the CharBuffer
13 years ago
3f9b9f953f
Added close() to ensure buffer close actions are invoked
13 years ago
d73c84f9a0
Allow initial buffer size definition in TransformWriter, and use available() method to set it in htmlParser. In this situation a ByteArrayInputStream is used so the available() method gives a good size estimation and avoid the buffer needing to be continually grown
13 years ago
f02ea27b31
Added missing closure of ByteArrayInputSteam
13 years ago
0796b54601
- some speed hacks for network image
...
- panic patch for 'AD' hashes until it is clear where the problem comes from
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8126 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
Michael Christen