orbiter
118d589eff
replaced the very very old data structure 'Records' with a simple table to fix the problem from
...
http://forum.yacy-websuche.de/viewtopic.php?p=20066#p20066
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6876 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
734298facd
*) added missing namespace declarations in yacysearch.rss
...
*) minor change in yacysearchtrailer.java
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6875 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
2a8f70f0ca
- fix for caching of OSM tiles. if you want that this fix applies to your peer, please delete the crawl profiles
...
- fix for initial generation of crawl profiles (one more reason to remove your crawl profiles)
- more String -> byte[] migration
- more logging for cache store/hit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6874 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
2126c03a62
- removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer
...
- migrated the opengeodb downloader to a new version of the opengeodb-dump
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6873 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
3661cb692c
added dictionary loader servlet that can be used to get the geolocalization file:
...
/DictionaryLoader_p.html
Will also be used for more dictionary files in the future
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6872 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
90fa8fd4d4
- support gpx file extension
...
- non-blocking location search (time-out handling was wrong)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6871 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
b0927d26e0
*) fix for "more options" link
...
*) removed suplus code
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6870 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
439b44be9e
removed exit from computation in ReferenceContainerArray.get merge method
...
an warning is still given, but method computes at normal operation
see also: http://forum.yacy-websuche.de/viewtopic.php?p=20038#p20038
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6869 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
7b880d73d0
adjustments to granted query size
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6868 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4cd56d3966
- fix for http://forum.yacy-websuche.de/viewtopic.php?p=20036#p20036
...
- enhancement to kml search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6867 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
586bc4d920
- remove superfluous entries in remote search tracker handles
...
- avoid concurrent access from same client
this is a fix for http://forum.yacy-websuche.de/viewtopic.php?p=20045#p20045
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6866 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
789c6b26ce
added a location search service: using the following servlet/example:
...
http://localhost:8080/yacysearch_location.kml?query=berlin&maximumTime=2000&maximumRecords=100
This will open any application that can consume kml data (which will probably be google earth) on your computer and displays the search result as positions on a map
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6865 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
f23cbd2dab
more bugfixes to date parser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6864 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
cf43bdc87e
This is a large bugfix and enhancement commit to support a better location detection for data
...
- fixes to http file server session handling
- fixes and enhancements to metadata date/time handling
- added dc:publisher metadata field and updated all document parser
- fixed bug in metdata read procedure
- enhanced dublin core and rss parser to understand more fields more properly
- enhanced url selection in case that multiple urls are given in surrogates
- fix for condenser; failure when last word does not end with termination symbol
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6863 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
6eba2cb96b
fix in bmp parser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6862 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
c6d9a12a99
fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2810
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6861 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
c45117f81f
fixed dates in metadata
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6860 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
0a5fd15703
:-(
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6859 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
ac16f582aa
fix for http://forum.yacy-websuche.de/viewtopic.php?p=20017#p20017
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6858 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
a7d038bb7a
The oai ListFriends source list becomes configurable: just write them into defaults/oaiListFriendsSource.xml
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6857 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
cf13c65bdd
added another network definition file for the open access (decentral OAI) search network
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6856 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
06ff0c5b06
fixes for metadata retrieval and presentation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6855 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
5c5e6accdb
Fixes for (X)HTML compatibility.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6854 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5d87379be6
fix for yacy search urls in compare search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6853 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
31f30f0925
added compare search for OAIster and oai.yacy.net
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6852 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
7ab207d93a
better presentation of search result metadata and fixes to htcache loading
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6851 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5fbf866cae
- fixed resumption token generation for oai-pmh import
...
- relaxed dublin core parsing: the dc:reference tag may replace dc:identifier if this does not contain a valid url
- parsing of completeRecords number and presentation in the download list of oai import
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6850 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
af13a02307
YaCySearchhtmlFF.html - fixes for XHTML compatibility.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6849 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5efc0dce0b
fix for domain options in search box
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6848 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
fc5efcc05a
enhanced and fixed OAI-PMH import
...
- now importing OAI-PMH server list fron two sources
- simultanous import from several servers (even > 2000)
- check buttons on OAI-PMH server list to select multiple servers for import start
- it is possible to select all servers at once for import
- imported XML data is gzipped after import from surrogate reader
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6847 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
sixcooler
c2098f9399
close unused connections if there to many for DHT
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6846 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
455a763d7c
performance hacks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6845 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
40a8d132d9
tried to fix 100% CPU when calling Balancer.top()
...
see also: http://forum.yacy-websuche.de/viewtopic.php?p=19978#p19978
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6844 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b6cce08019
fixed a bug in rwi storage data size allocation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6843 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
90c3e5d6f6
- cleanup, removed unused imports
...
- added crawling queue sizes to /api/status_p.xml, syntax same as in queues_p.html
- fixed a bug in queue enumeration that caused a out of bounds exception
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6842 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
3aad50d38e
:-(
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6841 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
9edd38fbc5
connectionCount limit too low?
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6840 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
7a05db0fcb
fixed to prevent that too many open connections exist
...
- create less connections at maximum (smaller httpc connection pool size)
- create less connections per host (2, standard required by RFC)
- do not start DHT distributions if there are too many open connections
- clear open/idle connections earlier; run cleaner more often
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6839 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
a9b9bf667b
fix for http://forum.yacy-websuche.de/viewtopic.php?p=19910#p19910
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6838 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b18a7606a0
some performance hacks and fixed after reading dump in
...
http://forum.yacy-websuche.de/viewtopic.php?p=19920#p19920
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6837 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
2bc3cba6f1
- fix for 'do not write to cache' rule.
...
- do not read from cache if byte[] array is still filled from response object (will do less IO)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6836 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4cd5418963
removed finalize methods because of a hint in
...
http://java.sun.com/javase/6/webnotes/trouble/TSG-VM/html/memleaks.html#gbyvh
The finalize method prevents that the memory, used by the objects containing the finalize method, is collected and available for the garbage collector. Instead, the memory allocated by such classes are enqueued to a java-internal finalize queue runner. This slows down all operations that uses a lot of object containing finalize methods.
this fix does not remove all finalize method, but such that may be used for throw-away objects that are allocated many times. This should cause a better run-time performance and less OutOfMemoryErrors
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6835 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
bfa35d6d20
possible fix for ZURL.list counter
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6834 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b7efbe55cf
i guess these documents are here by mistake
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6833 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
cff8ed134f
added index check to prevent blocking in synchronization
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6832 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
65f383e70b
some adjustments to the httpc after testing with a very slow httpd
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6831 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5ab5ac80fe
fix for NPE in TextParser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6830 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b95ae2518b
fix for assert
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6829 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
3247f0e901
fix for deadlocks caused by self-blocking access to TreeMap in concurrent environments. The TreeMap was replaced by a ConcurrentHashMap and additional care that the strings are compared all in lowercase
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6828 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
027b971bde
fix for concurrent quicksort: catch jobs from ThreadPoolExecutor that had been rejected because of full processing queues.
...
Non-catched jobs may have been the cause for blockings and freezes in case of overloading during strong processing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6827 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago