mikeworks
e78fd21fca
Added German translation in de.lng for new DictionaryLoader_p.html Geolocalization component loader page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6927 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
3a1cebb598
bugfixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6922 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4eab6473d3
option to set more than 9999 MB RAM in input field :-)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6919 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b03caaa57a
better handling of OOM situations
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6918 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
56ff9d5fd4
- extended news size from 512 to 1024 characters
...
- a new news db will be created (news1024.db), the old one (news.db) can be deleted
- peers with too large news payload are not ignored any more (they may have been invisible because they had a too large news payload!)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6917 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
353a924760
- changed default memory to 500m
...
- now xms is lower than xmx (lets try what happens)
- removed default path for intranet crawl starts to avoid confusion as seen on linuxtag
- added time-out to upnp request (i have a new router which may need that)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6916 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
0f3a3e34e1
Updated German translation de.lng and fixed typos in html files (english)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6915 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
5251a18e65
de.lng: Added new Network.html German translations
...
Network.html: shortened some <br /> tags to <br/>
ConfigBasic.html fixed some typo cann for German translation file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6914 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
a33f39832e
- small change in display of use cases
...
- explain usage of ftp, smb and file search domains
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6913 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1610c81dff
fixes for embedded search / search widget
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6911 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
60e71876ad
- more abstraction (HashMap -> Map)
...
- more concurrency-awareness (HashMap -> ConcurrentHashMap)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6910 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
2e679b1302
Small Fixes - no functional Changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6904 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
3f93a0cc8f
redesign of remote proxy settings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6903 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
11639aef35
- added new protocol loader for 'file'-type URLs
...
- it is now possible to crawl the local file system with an intranet peer
- redesign of URL handling
- refactoring: created LGPLed package cora: 'content retrieval api' which may be used externally by other applications without yacy core elements because it has no dependencies to other parts of yacy
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6902 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
2fd795207c
adaptive network peer counter table
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6901 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
0eafd94b22
corrected colors of network legend
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6899 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
9977fb9cf5
more enhancements to Network servlet: own peer in overview
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6898 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
bfdb9f4e06
extended statistics on Network servlet page
...
- added number of online peers at the last day and the last week
- changed design of statistic table
- network picture now shows exactly those peers that are counted in the statistic overview for one day
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6897 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
431852f0a7
testing new 'seach on map' image (slightly larger)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6896 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
e40542579e
fixes for wrong attribut name search->query (SRU)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6895 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
903ff21478
increased default time-out
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6894 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
98c1d65415
- show up to 10 locations (maps) after search (instead of a max of 5)
...
- order locations by (primary) population and (secondary) longitude (reverse ordering, both)
- added population from GeoNames, OpenGeoDB does not have that information
- changed default viewpoint of map to (30,15); shows more land and europe in the center
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6893 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
9842fab6e4
- fixes to query parameter
...
- replaced/removed search query attribute (was old style, new is 'query' according to SRU)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6892 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
6ec9ced4cd
- fix for multi-word search for locations
...
- changed description text to 'title' entity (subject is a list of keywords and was very messed)
- added ViewFile in location pop-up
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6891 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
7f35e1955e
Added alt tag and width and height properties to earthsearch.png in yacysearchtrailer.html for HTML validity
...
Added alt tag to page tabs in yacysearch.java for HTML validity
Added new German translations for geo search phrase in de.lng
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6890 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1defd580bc
- added option to localization search to distinguish between a search for a location according to the search word only or for the relation between a web search results and locations found in the metadata fields
...
- used that to display two layers on map: cities and search result locations
- added many marker grafics for the display of the markers on the map
- some refactoring of the yacy news code plus bugfixes for latest move from Tree to Table data structure
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6889 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1e8c6cefae
- added 'search on map' - Link to search result page
...
- added default search option to location search
- show default search in search window on location search page
- added icon for location search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6886 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
227ebc6651
- added more map layers to the new location search: openstreetmap (mapnik, osmarender, cycle map)
...
- cycle map is default because it looks best at 'world view'
- added control elements to map
- increased map size
- added deletion of search results for each time when a new search is done
- moved search box up and added yacy icon in such a way that the search page looks exaclty the same as the standard search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6885 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b7556893c6
removed terminate buttons for build-in crawl profiles in crawl profile editor
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6883 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
a5ec7db4ab
*) Oops!
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6882 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
b02078b58c
*) added visualization of GeoRSS search (very basic, but it's a start...)
...
*) removed double code
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6881 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
bd2587954a
?
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6880 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
e43e61e502
added another geolocalization data source: GeoNames
...
- added downloader option in DictionaryLoader
- added generalization (interfaces and overarching localization)
- more abstraction using the libraries
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6879 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
c9862e0ca9
*) removed unnecessary imports
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6878 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
76aea981ec
*) added W3C geo GeoRSS (see http://en.wikipedia.org/wiki/Georss )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6877 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
734298facd
*) added missing namespace declarations in yacysearch.rss
...
*) minor change in yacysearchtrailer.java
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6875 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
2a8f70f0ca
- fix for caching of OSM tiles. if you want that this fix applies to your peer, please delete the crawl profiles
...
- fix for initial generation of crawl profiles (one more reason to remove your crawl profiles)
- more String -> byte[] migration
- more logging for cache store/hit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6874 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
2126c03a62
- removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer
...
- migrated the opengeodb downloader to a new version of the opengeodb-dump
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6873 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
3661cb692c
added dictionary loader servlet that can be used to get the geolocalization file:
...
/DictionaryLoader_p.html
Will also be used for more dictionary files in the future
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6872 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
90fa8fd4d4
- support gpx file extension
...
- non-blocking location search (time-out handling was wrong)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6871 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
b0927d26e0
*) fix for "more options" link
...
*) removed suplus code
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6870 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
7b880d73d0
adjustments to granted query size
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6868 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4cd56d3966
- fix for http://forum.yacy-websuche.de/viewtopic.php?p=20036#p20036
...
- enhancement to kml search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6867 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
586bc4d920
- remove superfluous entries in remote search tracker handles
...
- avoid concurrent access from same client
this is a fix for http://forum.yacy-websuche.de/viewtopic.php?p=20045#p20045
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6866 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
789c6b26ce
added a location search service: using the following servlet/example:
...
http://localhost:8080/yacysearch_location.kml?query=berlin&maximumTime=2000&maximumRecords=100
This will open any application that can consume kml data (which will probably be google earth) on your computer and displays the search result as positions on a map
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6865 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
cf43bdc87e
This is a large bugfix and enhancement commit to support a better location detection for data
...
- fixes to http file server session handling
- fixes and enhancements to metadata date/time handling
- added dc:publisher metadata field and updated all document parser
- fixed bug in metdata read procedure
- enhanced dublin core and rss parser to understand more fields more properly
- enhanced url selection in case that multiple urls are given in surrogates
- fix for condenser; failure when last word does not end with termination symbol
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6863 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
c45117f81f
fixed dates in metadata
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6860 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
a7d038bb7a
The oai ListFriends source list becomes configurable: just write them into defaults/oaiListFriendsSource.xml
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6857 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
06ff0c5b06
fixes for metadata retrieval and presentation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6855 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
5c5e6accdb
Fixes for (X)HTML compatibility.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6854 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5d87379be6
fix for yacy search urls in compare search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6853 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
31f30f0925
added compare search for OAIster and oai.yacy.net
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6852 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
7ab207d93a
better presentation of search result metadata and fixes to htcache loading
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6851 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5fbf866cae
- fixed resumption token generation for oai-pmh import
...
- relaxed dublin core parsing: the dc:reference tag may replace dc:identifier if this does not contain a valid url
- parsing of completeRecords number and presentation in the download list of oai import
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6850 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
af13a02307
YaCySearchhtmlFF.html - fixes for XHTML compatibility.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6849 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5efc0dce0b
fix for domain options in search box
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6848 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
fc5efcc05a
enhanced and fixed OAI-PMH import
...
- now importing OAI-PMH server list fron two sources
- simultanous import from several servers (even > 2000)
- check buttons on OAI-PMH server list to select multiple servers for import start
- it is possible to select all servers at once for import
- imported XML data is gzipped after import from surrogate reader
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6847 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
90c3e5d6f6
- cleanup, removed unused imports
...
- added crawling queue sizes to /api/status_p.xml, syntax same as in queues_p.html
- fixed a bug in queue enumeration that caused a out of bounds exception
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6842 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b18a7606a0
some performance hacks and fixed after reading dump in
...
http://forum.yacy-websuche.de/viewtopic.php?p=19920#p19920
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6837 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b7efbe55cf
i guess these documents are here by mistake
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6833 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
7417425e6a
Added (b)log notice in header of table in Network.html
...
Added some missing translations for German de.lng in Network.html page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6818 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1a8a134e0c
continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 and continued in SVN 6790
...
The result should be a less usage of new String() and less memory usage (since a String-encapsulated byte[] has 40 bytes overhead)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6815 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
0d04ab1422
new access tracking data type strategy; previous data types may have caused deadlocks of httpd when performing statistic cleanups
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6809 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
55d8e686ea
performance hacks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6807 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5d8238680f
better thread dump statistic evaluation in threaddump servlet when creating multiple dumps for profiling: no distinguishing between thread states
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6803 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
2bc459252e
*) changes for better code readability
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6797 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
hermens
4ec0092677
more null == proxy fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6794 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
25aef069a6
continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6790 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
aad0a3045a
Fixed CSS file yacyui-portalsearch.cs
...
border-width: small; --> border-width: thin;
margin-botton --> margin-bottom
Forum Thread: http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2767
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6789 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
6ef4900ec5
Changed function name status() -> statuscheck() in yacyui-portalsearch.js fixing the "status is not a function" bug visible in Firefox error console:
...
http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2625
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6788 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
7a3c19846f
Updated German translation de.lng: added new Table_RobotsTxt_p.html and some other changes
...
Changed 'Sprache' -> 'Language' in yacydoc.html and added translation in de.lng
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6783 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
000dad034b
*) better usage of JS timers (intervals)
...
*) added messages when status is checked
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6781 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1e8e79b9ef
redesign of reference hash (URL-hash) parameter hand-over:
...
pass value as byte[], not as String. This should cause that less
byte[] <-> String conversions are made during time-critical tasks.
This redesign is not yet complete, more to come ..
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6775 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
9ddb8e4a43
set an option for the java-internal image parser that prevents that the image is cached using the file-system in a temporary file. This should speed up image parsing during image indexing dramatically and should also cause better performance when showing the yacy banner and OSM tiles.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6772 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
0018163c07
moved table row/column matching method from front-end to back-end
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6770 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
21fcbcc35f
added sorting function in network table, reverting SVN 6736 (not removing new sorttable)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6768 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
fad3abb524
Tables_p.html servlet can now show tables with selected rows using a search field
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6765 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
low012
4c6dc396d8
*) more beautyful (IMO) code, no functional changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6764 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
6c093d6aed
- enhanced domain navigator computation
...
- fixed domain navigator content in case that a mustmatch constraint was given
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6763 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
bb63c5d075
using a Pattern object with precompiled regular expressions to apply must-match constraints to search results: should speed up pre-sorting of search results and should cause richer search result sets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6762 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
5233177a7f
A small typo fixed
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6761 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
ea69300857
fix bad floating navigators on little results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6758 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
bfb518cd47
some refactoring to get the LoaderDispatcher a little bit more independent from the switchboard
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6755 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
0465f28f7f
applied 'null in rss2.js' fix from Quix0r, see
...
http://forum.yacy-websuche.de/viewtopic.php?p=19612#p19612
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6752 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
748abfcffa
added patches to prevent yacy-protocol DoS settings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6751 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
e820ed061a
avoiding excessive DNS lookups to determine localhost
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6750 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
0f8004f9da
enhanced html parser to recognize a href tags inside header tags
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6743 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
3300930fc5
- (almost) fixed FTP crawler
...
- integrated/fixed SMB crawler
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6742 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
61493a9a9f
added more information about metadata in ViewFile.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6740 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1198b9989d
bugfixes, more sorttable
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6739 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
27b2998eb4
added searchtable function to more tables in interface
...
you can now sort by any column in most tables in YaCy just by clicking on the headline column of the table
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6738 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
9623d9e6d2
added a smb loader component for the YaCy crawler
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6737 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
c77fbd0390
added sorttable ( http://www.kryogenix.org/code/browser/sorttable/ )
...
javascript library to make tables sortable
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6736 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
3014e5f6f9
- integrated live search in the IndexControlURLs input window for URLs:
...
this searchs for occurrences of the given word in URLs and presents them
in a pop-up list below the input line
- some bugfixes for the new robots table viewer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6735 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
0769517129
added a robots.txt monitor in the crawler monitor submenu
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6733 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
72f00dee59
removed never-used server access account function
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6731 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
474bb4de82
ups
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6730 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
8c88abf685
added follow-me link for twitter in status hints
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6729 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
58d75a6bde
allow more results for a single query at the same time if the client is not authorized. This is necessary for the search widget where the default number of results is now set to 20 instead of 10 to cause that a scroll bar is shown which is necessary to get a trigger for new searches for more results.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6728 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4144927d94
show less errors
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6725 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
c4bdb1e7f2
added one more option in ViewFile to show an iframe like for the orginal web page content but using the cache than the direct link to the content in the web. Upgraded the very old and previously not any more used CacheResource_p servlet to a new and working version.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6719 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
884b262130
- added a new Wiki Namespace Navigator
...
- some redesign of Navigator data structures
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6716 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b0c6d0108b
fix for select-all toggle in tables servlet
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6715 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
270fb38674
- fixed some bugs in Table viewer
...
- added 'select all' feature in Tables_p
- enhanced ViewFile.html: has now an input field to load arbitrary resources from the web and analyze them (!!!)
- included the ViewFile servlet into the Index Administration menu
- show in ViewFile if ressource is in url-db and/or in Web cache
- bugfixes to BEncodedHeap and Tables management
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6713 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
38d7a28cd2
fix in viewfile needed when ViewFile is called only with 'url' parameter
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6712 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
599c3766c4
added authentication to automated API call
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6711 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
727dd9b193
- fixed a bug in robots.txt parser
...
- moved storage of robots.txt entries to WorkTables, so it is now possible to browse the robots entries with the table browser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6710 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
f336ed568d
fir for parameters on reload
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6708 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
ddc21e7b73
adapted banner colors to current standard template
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6707 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
e76f1e6cc0
Update property name bookmarks to display_bookmarks (changed in SVN 5554) to fix the broken Bookmark RSS feed
...
- Fixes RSS part of http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1824
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6706 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
8a19be24de
tell non-windows users about the tray-icon
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6703 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
6b89f681c5
added bing, dbpedia and wolfram alpha to the compare-search options
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6701 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4b6efe3b48
more ergonomic default values for crawl start
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6698 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
f175f9a2d3
changed way how number of search requests are counted:
...
so far only search requests at the remote search interface had been counted.
This was done to protect the privacy of searchers, because counting was not done and published at the own search interface.
This caused that no search requests of robinson peers had been counted, becuase they cannot be counted at remote peer.
This change introduces a distinction of locally done search requests at the local search interface from search requests that are on the local interface but had been submitted from a remote IP without authentication.
Now 3 counters are maintained:
- partial count of remote searches
- total count of local searches on robinson peers from non-authenticated clients
- total count of local searches on robinson peers from localhost or authenticated clients
In the global statistic of search requests now the first two counters of the three cases are added
Because we habe a large number of robinson peers with a large number of remote non-authenticated requests the statistic should show at least three times of the number of search requests.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6696 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
23bf81d225
new buttons to select/deselect all entries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6681 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
564927ce72
redesign of CrawlResult data structures because of OOM occurrences during URL deletion processes.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6675 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
d378ca4604
better handling of concurrency in seed
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6669 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
6538043d89
fix for http://forum.yacy-websuche.de/viewtopic.php?p=19189#p19189
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6668 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
047f8718a7
added kiosk-mode button on standard search page and interactive search page
...
see also:
http://forum.yacy-websuche.de/viewtopic.php?p=19178#p19178
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6667 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
ac492fa2a5
added a close button image
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6666 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
1a4cb51744
ups, unclosed HTML tag fixed....
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6664 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
9e14958115
minor corrections and bug fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6663 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
945e0ba5a5
allow global search if res. observer disabled index transmission
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6658 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
063b29060c
Minor Changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6656 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
11188cd7eb
resource observer now uses the Java 6 method to check for free space. thus, disk observing now needs Java 6 installed.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6652 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
be18b5d8cd
fix for 'cannot switch back to default language'-bug
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6649 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
fe78edac32
- view API calls in correct date-order
...
- execute recorded API calls in date-order
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6646 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
308a973503
refactoring of tables data organisation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6644 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
8a76f38d26
Added a new steering servlet that can be used to repeat actions that had been made on the yacy interface. This can be used to:
...
- start again a previously started crawl
- submit settings (again). This option will be used to transmit
all settings of one peer to another peer if the remote-peer
steering function is ready
This steering framework will also be used for a 'schedule-everything'
which will also include a new scheduler for crawling.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6642 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
530b77d05a
adapted loglevel for accepted urls
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6641 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
5f661d9f5d
fix receive of crawl receipt in private peer mode
...
http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2655
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6640 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
840527689b
more simplification of bookmark class
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6639 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
ada0ce9de3
refactoring of bookmarks: there is a big performance problem in the bookmarks code and furthermore the bookmarks
...
will loose its leading role for the re-crawl funtion when the new api tables will work. To be prepared for a replacement
of such functions the bookmark class is re-organised.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6637 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
24060885b6
- added Tables abstraction in data.Tables.java
...
fix for
http://forum.yacy-websuche.de/viewtopic.php?p=18910#p18910
http://forum.yacy-websuche.de/viewtopic.php?p=18894#p18894
http://forum.yacy-websuche.de/viewtopic.php?p=18814#p18814
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6631 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
7fdf59a77f
misc NPE check
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6630 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
a29b17a2fd
Minor HTML Changes, Images recompress.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6627 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
suessthomas
67b8d5149e
Small Changes on Network.html - Specifying image dimension
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6625 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
e87f0e83a2
Updated German translation:
...
- Fixed a typo in ConfigPHPBB3Search.html
- Added section for ConfigPHPBB3Search.html and translation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6620 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
d915deaa2b
Fixed type in CrawlStart_p.html
...
Changed to German language file:
- Updated Crawl Start Page
- Added section for indexing MediaWikis
- Fixed some more start and end tags so that syntax highlighting works correctly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6617 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
3889438db6
fix for bookmarks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6615 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
597a410f58
ups
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6609 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
8ce936bcdd
added an api recording function: it shall be possible to record
...
all operations on YaCy in a database that should make it possible
1) to re-create a setting on fresh peers
2) to transmit a setting from one peer to another
3) to re-create crawl starts after a complete deletion of the index
This functionality will also support
4) scheduled re-crawls (new implementation)
To implement this, a new database structure has been crated that stores maps into blob heaps. to encode maps the b-encoding technique was used (this is the same encoding that torrent files use)
- added a b-encoder
- enhanced the b-decoder
- added a b-encoded map heap data structure
- added a table organisation based on b-encoded heaps
- added a servlet to maintain such tables (see Tables_p.html)
- integrated the servlet into the Advanced Settings menu
- added an api recording based on the new tables
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6606 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
8df1694288
- added options to switch on/off search domains (text, image, audio, video, app)
...
- more memory by default
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6605 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
eac3b696ab
Fixed typos in WikiHelp.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6599 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
03fb4a1980
Fixed typos CrawlProfileEditor_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6598 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
78daea95c3
show more navigation pages if there are too less locally
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6595 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
25c545c4b0
first commit fixing two typos
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6594 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
234f733a3d
- relocation of seed db is better for network switch than re-initialization because of the embedding of the peers object in other objects
...
- small refactoring of blacklist interface code to remove PMD warnings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6593 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
763e0d447c
removed unnecessary cast
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6586 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
34354cf9b2
added a servlet that has been removed in SVN 4881; this servlet is now splitted and will be used for a simple crawl start and a remote crawl monitor (not yet integrated into the interface)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6582 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago