f1ori
def4253555
* add option to network definition to provide a domainlist (syntax like in blacklists)
...
* crawler and search allow only urls matching one in domainlist (if list is provided)
* this may be useful to prevent dedicated networks from being "polluted"
* FilterEngine is improved Backlist-object, Blacklist may inherit from FilterEngine in the future
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7285 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
lotus
2db6ca8104
- do not allow user to disable java installation
...
- java version update
- build cleanup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7284 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
482127e777
removed release key from location 2 because the signature of that source can not be verified. But the source is ok.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7283 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
ac6b503adf
untar files without gzip decompression even if the file has gz extension. this is done when the decompression fails.
...
decompressed gzip files with gz extension may appear if the server sets a gzip compression header
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7282 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
efe0667fdd
more new bookmark (ymarks) code with experimental html and xbel import
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7281 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
mikeworks
caabebf9be
Fixed spelling mistake omiting -> omitting in debug messages in ConfigUpdate_p.java and Switchboard.java
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7280 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
fb92f9ae8e
added mime type image/jpeg (image/jpg is wrong but it is left here because it does not harm and this error also exists in configuration of web servers)
...
see also:
http://forum.yacy-websuche.de/viewtopic.php?p=21129#p21129
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7279 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
155d556568
- better memory protection
...
- more logging
- little bit of refactoring
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7278 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
mikeworks
a16e5e7a63
ConfigPortal.html: Added safe space character because empty <dt> produces a warning in HTML validator
...
de.lng: Added translation for added ConfigPortal selection for target selection and WikiHelp changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7277 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
f1ori
7d8de34778
* add a bit documentation to DigestURI, use DigestURI(string) instead of DigestURI(string, null)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7276 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
25a8e55bc9
more logging about bad seeds
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7275 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
959b8c6fa0
- allow greater seed size
...
- more logging for bad seeds
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7274 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
e103419a56
- removed <3 peers barrier for peer ping feedback
...
- more logging
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7273 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
d0e6c03b51
some updates to the new bookmark code...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7272 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
facfd204e9
added a parent configuration option.
...
see /ConfigPortal.html
requested here:
http://forum.yacy-websuche.de/viewtopic.php?p=21099#p21099
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7271 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
e3964f2c31
better catch of network definition load error; continue with secondary network load definition location
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7270 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
7adfe4a1c1
fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=35#p21092
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7269 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
low012
b8d6784410
*) WikiCode help page update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7268 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
low012
65a0381f76
*) cleaning up code (still not done)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7267 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
e3e3b49d52
- enhanced main release recognition
...
- yacybot user agent now includes the yacy network name (not the peer name!)
- refactoring and clean-up (mostly turned tab into spaces)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7266 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
9c94ebdee4
small changes to new bookmark code...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7265 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
244b56e9d3
an update to the new bookmark code...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7264 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
mikeworks
96e625c541
AccessTracker: Fixed table output while no results are displayed --> all of AccessTracker should now validate XHTML 1.0 Strict, also tfoot must be defined before tbody
...
Connections_p: Added static protocol "http" for incoming connections because only http pool is queried and -UNRESOLVED PATTERN- is not really useful
de.lng: Minor changes and removed one old line
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7263 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
low012
dc40f51b8d
*) added headlines as proposed by Vega
...
*) <pre> will be displayed monospaced in wiki and blog again
*) bugfix for <pre> spanning multiple lines
*) replaced deprecated <s> tag with <span> equivalent
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7262 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
f035f257da
added some more bookmark code...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7261 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
low012
22ed9c380c
*) fixed bug which was introduced in r7226 (shame on me) which made wiki unusable (all entries were stored with empty subject as key -> edits were lost)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7260 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
f1ori
60fd2e549d
* log failures when writing config file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7259 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
58e74282af
added a word counter statistic in condenser which is used by the did-you-mean to calculate best matches for given search words.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7258 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
2a0eb09e08
enhanced html id names and tag cloud visualization
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7257 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
863065abc4
added user agent logging to access tracker
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7256 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
mikeworks
61e87c0b14
IndexControlRWIs_p.html, IndexControlURLs_p.html, ViewFile.html/.java: changes to HTML output and in case of empty values for XHTML strict / transitional validation
...
de.lng: Added missing translation for Show Content and changed existing line
--> Index Administration should now correctly validate XHTML 1.0 Strict / Trans
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7255 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
a79728b97d
some updates to experimental bookmark code...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7254 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
ef782cd026
and even more experimental bookmark code...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7253 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
ed4371dcf3
enhanced navigation implementation and enhanced tag cloud computation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7252 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
ca738ac924
- added a tag cloud to search results (using the topics)
...
- some refactoring of score classes
- added default package for new classes add_ymark and delete_ymark
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7251 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
7aca763ca8
Some more experimental bookmark code...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7250 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
4270ed696c
Experimental code (I need to transfer the code to my macbook, sorry) for the new bookmarks API based on the Tables concept (same as for crawl starts). Currently you can add a bookmark by api/ymarks/add_ymark.xml?url= http://www.yacy.net&title=YaCy and watch the result via the standard view Tables_p.html.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7249 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
e4d561971e
added more score cluster options and made score cluster usage more transparent
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7248 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
e8f90201a5
fix for scheduling of rss feeds
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7247 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
7cd9d9d22a
- enhanced DidYouMean computation using a faster count on index entries; this causes that results can be ranked better
...
- added limitations on DidYouMean result sets according to input and output string length
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7246 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
beb65437d2
additional fix for the widget - now a second result page is loaded automatically in case of too little search results for the scroll event to trigger
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7245 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
2bb0c9b503
Fix for search widget keyup event handling. ESC will close the widget window and RIGHT will load additional search results, especially when the scroll event won't work because of too litte results.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7244 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
de722090b5
enhancements in did-you-mean guessing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7243 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
a59c885ee0
autocomplete and did-you-mean can now understand _all_ languages and can generate suggestions in all languages and character types
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7242 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
b7acd92ce4
Auto-Suggestions for YaCy Search:
...
- added a suggest servlet according to opensearch and firefox standard
- integrated the suggest servlet into opensearch description file
- integrated a autocomplete plugin for jquery
- added a autocomplete addition to the yacy search windows showing autosuggest queries
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7241 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
mikeworks
67b3b4b13b
de.lng: Added translation for skin color picker on http://demo.zuum.net:8080/ConfigAppearance_p.html
...
ConfigAppearance_p.html: Some HTML 1.0 Strict changes on the Customization page http://demo.zuum.net:8080/ConfigAppearance_p.html
--> Now all Customization pages should validate XHTML 1.0 strict
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7240 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
24f1cba7b2
performance hacks:
...
- faster generation of index abstract compression during remote search
- less synchronization in IO record reading
- request index abstract generation only if necessary and faster time-out in remote search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7239 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
6a166c2040
patches for bad proxy behaviour
...
- accept ipv6 localhost clients
- index media files (url only)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7238 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
d607b30b6a
performance enhancements for search and code review for database functions
...
- removed read cache from Records data structure because the read cache had no cache hit during search operation
- copied old read-cache class to CachedRecords and the old, now new Records class does not have the cache any more and a code review checked that data structures and synchronization is clean
- removed unnecessary synchronization from Table class during get()
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7237 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
6d61b80fb6
added ColorPicker to WatchWebStructure
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7236 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago