Michael Peter Christen
1b9ec9a1c5
- added popover to p2p/stealth mode button to explain the peer mode and
...
privacy issues.
- added popover to first-time use case to explain that specific servlets
are only visible after customization and/or crawl starts
11 years ago
Michael Peter Christen
8d35fcb1c7
transition.js is also included in bootstrap.js
11 years ago
Michael Peter Christen
3abc3c4c4c
removed alert.js, modal.js and tooltip.js as these libraries are all
...
included in bootstrap.js
11 years ago
Michael Peter Christen
898f78258e
fix for naming bug
11 years ago
Michael Peter Christen
39b641d6cd
added tutorial mode - some menu items will only appear if you 'qualify'
...
for them. Thus, the first-time user will only see four menu items. The
other items will unfold as the user interacts.
11 years ago
Michael Peter Christen
7a49f72480
fix for crawler column width
11 years ago
Michael Peter Christen
46a1a15441
added more bootstrap libraries
11 years ago
Michael Peter Christen
5ccbfeb803
show host list by default in host browser
11 years ago
Michael Peter Christen
ba0e3fb0dc
fixed crawl start links after renaming them in latest commit
11 years ago
orbiter
d29b6db270
made crawl start pages public since they do not reveal individual
...
information and they are also not used as servlet to actually start the
crawl (which is Crawler_p.html).
11 years ago
Michael Peter Christen
e41db47cac
added (again) underline to a tags
11 years ago
Michael Peter Christen
ff82a80eb3
Integrated HostBrowser back to administration interface; it can appear
...
with and without navigation bar.
11 years ago
Michael Peter Christen
94366ba2e5
added template for latest commit
11 years ago
Michael Peter Christen
701df02ead
Complete redesign of administration top-level menu. This follows two
...
principles:
- provide an easy tutorial-like "what should I do first" menu
- provide all elements which are subject to most first questions to YaCy
exibition people on top level: Resource limitation, Parser and Ranking
settings
I apologize to everyone who are used to the old style and need to find
the menu items (again) after this change. I hope that this will make the
interface more usable for new users who see a web indexer/crawler the
first time.
11 years ago
Michael Peter Christen
a3b7366aee
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
Michael Peter Christen
6b66bb7109
redesign of search page integration menu structure
11 years ago
reger
92811d7850
fix: 3 more links pointing to old /xml path
11 years ago
reger
c183d66d40
fix: blacklist xml export path to xml template
11 years ago
Michael Peter Christen
656e2ce62a
replacing direct html table cellspacing with css set-up for cellspacing
11 years ago
reger
e11504309f
adding a hint to javascript browser short cut on Url-Proxy page (AugmentedBrowsing_p.html)
11 years ago
reger
7f29eee9ac
fix: cut-off button in WatchWebStructure_p.html
...
(by header css dd hight/line-hight)
11 years ago
reger
2953ebe701
fix: port in local target adress
...
& button style
11 years ago
Michael Peter Christen
fda591695c
fixed visibility of custom icon
11 years ago
Michael Peter Christen
a9b9950d7f
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
Michael Peter Christen
bd54b85d46
fix for relative sitemap urls
11 years ago
Michael Peter Christen
8b44fcf0f4
added missing @Override annotation
11 years ago
reger
1898175566
fix: button style IndexReIndexMonitor_p.html
11 years ago
Michael Peter Christen
bb21d825f9
fix for thread dump line spacing
11 years ago
Michael Peter Christen
a7bc130e27
removed performance settings
...
- they are incomplete and buggy
- it was not easy to explain
- it did not comply with a KISS strategy
- setting a performance of low priority actually caused crashing of a
peer
- there was nobody who would maintain that functionality
11 years ago
Michael Peter Christen
3290375493
changed the protocol navigator: turned into switch buttons
11 years ago
Michael Peter Christen
3272c885ea
fixed auto-activation of search field
11 years ago
Michael Peter Christen
cbdfef7ce1
changed protocol facet to show also all other counts if one facet is
...
selected
11 years ago
Michael Peter Christen
36e92e898f
moved host facet up
11 years ago
Michael Peter Christen
d873304381
added typeahead library to re-implement search suggestions for bootstrap
...
framework.
11 years ago
Michael Peter Christen
f686ae30a4
- added (previously removed) autocomplete
...
- removed autocomplete from yacyinteractive.html
- todo: replace old jquery-1.3.2.min.js with latest which is already a
part of bootstrap.css
11 years ago
Marc Nause
809b4e1fd9
Team added support for URLs with unicode characters in host part to
...
blacklist. Punycode is used to handle unicode characters.
11 years ago
Michael Peter Christen
af82b57a2b
corrected line-height in tagcloud
11 years ago
Michael Peter Christen
8424d2b743
fixed search field
11 years ago
orbiter
b87a94da56
fix for embedded header: the new css framework always need a headline,
...
which is the location for the search input frame. The new embedded
header is a clone of the simpleHeader with removed menus and without a
link to the index administration.
11 years ago
Michael Peter Christen
be93bff281
added /date -ranking button
11 years ago
Michael Peter Christen
e3cb0ffe16
- added text/image/audio/video/app search option to new navigation bar
...
- changed colors of privacy selector
11 years ago
Michael Peter Christen
395837b3b6
from the administration search bar, do global searches
11 years ago
reger
6d17468f21
fix: set text color black in select field in table.th in CrawlResults
...
(default inherite white)
11 years ago
Michael Peter Christen
721178dc84
misc style bugfixes
11 years ago
Michael Peter Christen
e6dec011ea
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
Michael Peter Christen
69d1d067ac
- do not show external link icon on navbar icon
...
- do not show navbar icon on index.html
11 years ago
orbiter
22618e3ba2
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
936d2ef656
bring api icons to the front
11 years ago
Michael Peter Christen
d1091e79f8
- added stealth button to navigation menu
...
- more fixes to progress bar
11 years ago
Michael Peter Christen
f0f22e68bb
fix for page navigation bar
11 years ago
Michael Peter Christen
deae992d47
fixes to progess bar
11 years ago
Michael Peter Christen
e2f2586429
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
reger
c297de5145
remove check for unused virtual path /currentyacypeer/
...
- del jqueryheader.template (not used)
11 years ago
Michael Peter Christen
9125bedb87
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
Michael Peter Christen
617dd9c97b
- added new input field in index.html
...
- changed progress bar in yacysearch.html
- moved pagination navigation to page bottom
- moved search term input field to headline
11 years ago
reger
c53c52e210
ConfigSearchPage.html first adjustment to new layout
11 years ago
orbiter
f8f88d4e81
replaced pdblue-homebrew buttons with bootstrap standard buttons
11 years ago
orbiter
3c8d6e1eee
added adminAccount switch to ConfigAccounts_p servlet to switch on
...
protection of all pages; some refactoring as well
11 years ago
orbiter
f8e998d660
added bootstrap-switch to turn checkboxes into toggle switches
11 years ago
Michael Peter Christen
3d6bcbaa22
reduce number of facets to 10
11 years ago
Michael Peter Christen
ed7ad2ef0a
replaced old navbar with bootstrap pagination
11 years ago
Michael Peter Christen
a25799f735
removed underline for anchor refs and replaced it with
...
underline-on-hover. Please update your style (switch and switch back)
11 years ago
reger
1fe26550a0
remove AugmentedBrowsing_p.html augmented browsing switch
...
(has no function in code, previously used in conjuction with http://reflect.ws )
11 years ago
Michael Peter Christen
381781613b
enhanced api menu entries
11 years ago
Michael Peter Christen
5ea5bb3549
redesign of menus; usage of bootstrap buttons and dropdown-menus
11 years ago
Michael Peter Christen
21f1d1a7df
added dropdown menu in test dashboard
11 years ago
Michael Peter Christen
dc796ebc8d
fixed bold label setting in bootstrap which causes a bad look in YaCy
11 years ago
Michael Peter Christen
9d35455f3f
use default header for user front-ends and inverted header for
...
administration front-end
11 years ago
Michael Peter Christen
1944df6df1
enlarged facet column slightly
11 years ago
Michael Peter Christen
523dde9160
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
ab0e6ba9a6
- removed usage of jquery and yacy/ui in standard search interfaces as
...
possible
- re-implemented formerly jquery-based tagcloud with simple html
- fixed minimized menu for mobile/minimized view (try that: make window
very narrow...)
11 years ago
Michael Peter Christen
453bfd0f17
removed unused variables and warnings
11 years ago
orbiter
dbd7f77568
removed superfluous import of portalheader.template
11 years ago
Michael Peter Christen
353d9c523f
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
Michael Peter Christen
92655c7fd9
- added bootstrap css framework
...
- adopted all YaCy administration pages to new framework
- created new search page layout (working, but still work in progress)
- old skin files are fully appliable! (and looking good)
- target is a new style based on bootstrap examples, see /test.html
- icons in YaCy may be replaced by glyphicons (to be done)
11 years ago
reger
e972b87a8a
remove AugmentedBrowsingFilters_p.html as none of the settings are used currently
...
config settings frome the page also removed from yacy.init
augmentation.reflect
augmentation.addDoctype
augmentation.reparse
interaction.overlayinteraction.enabled
11 years ago
Michael Peter Christen
05655d98df
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
reger
9f02d2c47b
fix: remove link to triplestore in Vocabulary_p (triplestore does not longer exist)
...
- should be investigated in more detail to look for additional implications
Remove "yacyaction" from proxyservlet as it was only needed for removed interaction routines.
11 years ago
orbiter
e9abb25b03
tried javascript hack to make statistic divs equal height
11 years ago
reger
d052bbdfe1
prevent exception on Site Crawl if no start url is given
11 years ago
Michael Peter Christen
85a427ec54
support for multiple sitemaps in robots.txt
11 years ago
Michael Peter Christen
b08375da33
fix for bad/missing values of size_i
11 years ago
Michael Peter Christen
8cf4d04ae0
fix for facets in search rss result: some facets had been missing, all
...
had missing url properties
11 years ago
Michael Peter Christen
51800007c4
- added concurrency to postprocessing of webgraph document
...
- bundeled separate webgraph postprocesing steps into one
11 years ago
reger
351c2be68d
fix: make sure adminAccount changes made via ConfigAccounts_p are effective immediately
...
force to remove current credentials from knownuser cache
11 years ago
reger
5c9dcc269d
improve OAI-PMH import identifier recognition
...
- find best fittng identifier (url) by checking all given dc:identifier in record (many entries proviede several identifiers)
as identifier is currently a multivalued field use "getParams" in preference of splitting the 1st string by ";"
- add resolve DOI:... identifier via http://dx.doi.org/
11 years ago
Michael Peter Christen
bcd9dd9e1d
enhanced concurrent loading by using a fixed set of concurrent loader
...
processes in favor of throwaway-processes. The control mechanism does
less often report a 'queue full' message to the busy loop which then
does not perform a long busy waiting; instead all requests are queued
and new loader processes are started if necessary up to a given limit
(as set before)
11 years ago
Michael Benz
c7ea0f123b
Added German translation for Config Search and Ranking RWI and Solr
11 years ago
reger
61e51d47a5
fix: unused / incorrect default username parameter
...
(removed setting)
11 years ago
Michael Benz
a87aef83b4
Improved Image Collage and WatchWebStructure page display with CSS changes
11 years ago
Michael Benz
0813f5f82e
Added German translation for AccessGrid_p.html, CrawlCheck_p.html, RegexTest.html and env/templates/submenuTargetAnalysis.template
11 years ago
reger
a2e5ea2026
status panel link to set max mem
...
+url proxy same error text as in transparent
11 years ago
Michael Peter Christen
fdaeac374a
- enhanced postprocessing speed and memory footprint (by using HashMaps
...
instead of TreeMaps)
- enhanced memory footprint of database indexes (by introduction of
optimize calls)
- optimize calls shrink the amount of used memory for index sets if they
are not changed afterwards any more
11 years ago
Michael Peter Christen
1245cfeb43
small change to crawler monitor to fit in larger translations
11 years ago
orbiter
1960aafd6c
better height for statistic windows
11 years ago
orbiter
b0e3e2100d
better width for Progress table
11 years ago
orbiter
d2f7ce27a7
fix for switch back to localhost (why did this not work? it worked all
...
the time)
11 years ago
Michael Peter Christen
a632b0d2a4
added a forced commit to index deletion to enable synchronized index
...
updates
11 years ago
Michael Peter Christen
9c41527e9c
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
malykhin.dmitry
29a7598991
update russian lang-file and small improve web-interface
11 years ago
Michael Peter Christen
1bbc0fe6d2
added a properties file format for the status_p api to support reading
...
of that information with the java Properties class (very easy for small
clients)
11 years ago
Michael Peter Christen
e40511f307
extended the status_p api with disk space information
11 years ago
sixcooler
99635e15b4
fix for switching 'simulate short memory status' and 'Memory Strategy'
...
thx Thomas
11 years ago
Michael Peter Christen
0f6b72f24b
do not use luke requests for remote solr servers if the result is
...
different from normal requests. This happens if the remote solr is
actually a solrCloud; in such cases the luke request returns only the
result of the single solr peer, not the whole cloud.
also done: some refactoring.
11 years ago
Michael Peter Christen
a2b66fe2eb
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
Michael Peter Christen
d8e79731df
fixed wrong used memory display
11 years ago
orbiter
da5d4128bf
prevent npe
11 years ago
Michael Benz
072d4aa0c0
Updated German translation and Blacklist_p.html
11 years ago
orbiter
f6e441dd77
refactoring
11 years ago
orbiter
c3f6c06f2c
removed host increment on stored documents from crawler (that was wrong)
11 years ago
Michael Peter Christen
a86c2fe77d
fixed usage of media flag when started by automated process
11 years ago
Michael Benz
f11314aae7
Improved German de.lng translation and fixed adresses -> addresses in \htroot\CrawlStartScanner_p.html
11 years ago
Michael Peter Christen
f0eec6d0f3
Merge branch 'master' of git://gitorious.org/~copro/yacy/copros-rc1
11 years ago
Michael Benz
6278af4993
Edit German de locale and improved translation
11 years ago
Michael Peter Christen
69391e5d9e
changed strategy to test existence of documents in Solr: using the
...
update time. The reason for that is a better caching for the crawler
double-check, which needs the update time for crawler steering.
11 years ago
reger
a02e33dcb6
add edit-link to PK field of table admin
11 years ago
Michael Peter Christen
9eb668e951
enhanced the resource observer
...
The resource observer is now able to recognize free disk space AND
available space for YaCy. The amount of space which is assigned for YaCy
are defined in new settings in the configuration file.
Furthermore, there is now a cleanup process which deletes files in case
that an autodelete is activated. The autodelete is now BY DEFAULT ON if
the disk space is low, which means that YaCy starts to delete documents
when the disk is full!
11 years ago
Michael Peter Christen
cb2c25d930
in case that the crawler is running and the search user is the peer
...
admin, we expect that the user wants to check recently crawled document
to ensure that recent crawl results are inside the search results, we do
a soft commit here.
11 years ago
Michael Peter Christen
bf97e38b83
removed clearURLIndex, which is a stub remaining from the old metadata
...
database and not needed any more
11 years ago
Michael Peter Christen
bc28247089
Added methods in resource observer to calculate the available and the
...
occupied disc space. These values are also shown on the status page.
The disc space calculation shall be used for a disk-limitation of the
search index.
11 years ago
reger
365f77ea8c
make internal page links relative to ease any future development for context aware servlets
...
note also http://bugs.yacy.net/view.php?id=106
11 years ago
Michael Peter Christen
d9858e1b8a
removed warnings and superfluous logging
11 years ago
Michael Peter Christen
7e71dcc417
removed interaction fragments
11 years ago
Michael Peter Christen
94245ce0a8
fixed "Size in KBytes" calculation in PerformanceQueues_p.html,
...
see http://bugs.yacy.net/view.php?id=362
11 years ago
Michael Peter Christen
726e8c3ad5
removed unused classes and servlets
11 years ago
Michael Peter Christen
6e59ca4ebf
removed jena library and all code that depended on jena. When jena was
...
introduced, it was also used for search facets. The generic search
facets are now deduced from generic solr fields which makes jena as tool
for facet semantics superfluous.
11 years ago
Michael Peter Christen
0e6729f9bc
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
Michael Peter Christen
9228214f9b
enrichment of PerformanceMemory display of SolrInfoMBean table
11 years ago
Michael Peter Christen
e8bdf16ea7
added statistic information for solr resources in PerformanceMemory
11 years ago
reger
1a2b298a65
fix: select all checkbox Tables_p
...
(needs form name attribute)
11 years ago
Michael Peter Christen
931541d198
re-inserted default value re-set button to performance queues and
...
patched missing values for recent new queues
11 years ago
reger
bd1685c94a
fix not needed getFileExtension().toLower (double)
...
add missing .getFileExtension
11 years ago
orbiter
a11f072504
enhanced didyoumean
11 years ago
Michael Peter Christen
bc395c7439
reduced color depth of star icons (for smaller file sizes)
11 years ago
Michael Peter Christen
9e0e39a9a4
small change to start/stop/pause icon style
11 years ago
orbiter
22e3524797
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
c40ba51ca6
added new suggest method which replaces more-than-one suggestions:
...
instead of computing suggest permutations of the given words, the
completion of a phrase using the given words is searched in the fulltext
index.
11 years ago
reger
ad4b213145
remove unused static var from HTTPDProxyHandler
11 years ago
reger
6c6056836d
fix vocabulary navigator checkbox selection (from last commit)
11 years ago
reger
cb71413d19
fix page nav, to keeping modifier
...
(was new issue)
11 years ago
orbiter
ba5ab11cc4
less logging
11 years ago
Michael Peter Christen
322854a5f8
fix auth for forced ping
11 years ago
Michael Peter Christen
fbf4f77d80
fixed missing corona in network picture
11 years ago
Michael Peter Christen
d2b8f2b477
enhancements for staticIP and ipv6 handling
11 years ago
reger
91d79c1ac4
disable wrong forward to https on port change
11 years ago
reger
193b8235c2
remove double jquery-1.3.1.js and adjust header links to jquery-1.3.2
11 years ago
reger
f307d65dcf
prepare for a language navigator
...
works fine to restrict language for local solrSearches.
More work needs to be done to make rwi/remote searches respect the modifier.language restriction.
11 years ago
orbiter
768b1306b8
Added a write-enabled checkbox for remote solr servers.
...
It is now possible to assign every peer other YaCy peers as remote solr
server which are only used for read operations during search. This also
affects crawling: it will exclude urls from crawls which exist on remote
solr/remote YaCy peers.
11 years ago
orbiter
f7d6dd136f
changed solr paths according to new default paths
11 years ago
Michael Peter Christen
8b14e92ba4
added button in host browser to re-load 404/failed documents
11 years ago
reger
f47067b0ce
fix search navigator not showing activated nav
...
introduced with 97e84439fb
11 years ago
reger
9a96a7d73f
put list quick navigator buttons belowon BlackList_p editor
...
replacing the dropdown -> go navigation
11 years ago
Michael Peter Christen
6ada0daae9
making latency_factor and maximum number of same hosts in loader queue
...
settings available in Crawler_p.html servlet for steering.
11 years ago
Michael Peter Christen
be5e808236
- removed hardcoded load-test which is now handled in BusyQueues
...
steering, see /PerformanceQueues_p.html
- changed default values for crawler queue load limit (high, because
these jobs are started upon user request)
11 years ago
sixcooler
40a4030b55
configurable max-load values for YaCy-Threads:
...
try lower values on smal systems like a Pi
11 years ago
Michael Peter Christen
77531850b5
reverted crawling strategy from latest commit.
11 years ago
Michael Peter Christen
c0da966dfa
enhanced crawler speed
11 years ago
Michael Peter Christen
1ea17bd9f3
- removed old metadata database and all migration code
...
- refactored all code which uses URIMetadataRow as standard for word
hash length and word hash ordering and moved that to the class 'Word',
becuase the class URIMetadataRow defined the old metadata data structure
and should be superfluous in the future
- removed unused methods from URIMetadataRow as preparation for further
removal of that class
11 years ago
reger
97e84439fb
adjusted ConfigHeuristic and changed QueryGoal.getOriginalQueryString to .getQueryString
...
- since specific heuristic Twitter & Blekko is not longer available or redundant with OpenSearchHeuristic,
adjusted ConfigHeuristic to use OpensearchHeuristic settings only.
For this the default OSD search target list is made available (copied) by default and the other configs are removed.
- the return of QueryGoal.getOriginalQueryString includes the queryModifier, which are held separately in a modifier object,
but in most (all) cases just the query term is expected, clarified and renamed it to QueryGoal.getQueryString which returns
just the search term (if needed a .getOrigianlQueryString could be implemented in Queryparameters, adding the modifiers)
- started to adjust internal html href references from absolute to relative (currently it is mixed).
For future development we should prefer relative href targets (less trouble with context aware servlets)
11 years ago
orbiter
fd4abc0565
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
d5b8e473c8
added load limit for DHT transfer: RWI acceptance only if local load is
...
not too high
11 years ago
reger
41c126978b
fix bug: Crawl Start (Expert) crawls "?-URLs" even if told not to do so
...
http://bugs.yacy.net/view.php?id=329
11 years ago
Michael Peter Christen
a9ed28c0b5
no commit if no action is requested
11 years ago
reger
0c754dd794
implemented DIGEST authentication, which is for remote login more secure
...
as BASIC were pwd is transmitted near clear text (B64enc).
This has some implication as RFC 2617 requires and recommends a password hash MD5(user:realm:pwd) for DIGEST.
!!! before activating DIGEST you have to reassign all passwords !!! to allow new calculation of the hash
- default authentication is still BASIC
- configuration at this time only manually in (DATA/settings) or defaults/web.xml (<auth-method>
- the realmname is in defaults/yacy.init adminRealm=YaCy-AdminUI
- fyi: the realmname is shown on login screen
- changing the realm name invalidates all passwords - but for security you are encouraged to do so (as localhostadmin)
- implemented to support both, old hashes for BASIC and new hashes for BASIC and DIGEST
- to differentiate old / new hash the in Jetty used hash-prefix "MD5:" is used for new pwd-hashes ( "MD5:hash" )
11 years ago
Michael Peter Christen
f8ce7040ab
remote search peer selection schema change:
...
- all non-dht targets (previously separated into 'robinson' for dht-like
queries and 'node' for solr queries) are non 'extra' peers, which are
queries using solr
- these extra-peers are now selected using a ranking on last-seen,
peer-tag-matches, node-peer flags, peer age, and link count. The ranking
is done using a weight and a random factor.
- the number of extra peers is 50% of the dht peers
- the dht peers now exclude too young peers to prevent bad results
during strong growth of the network
- the number of dht peers (and therefore extra-peers) is reduced when
the memory of the peer is low and/or some documents still appear in the
indexing-queue. This shall prevent a peer from deadlocks when p2p
queries are made in a fast sequence on weak hardware.
11 years ago
reger
6932aa4d7a
use configured admin-username for api calls
...
- the admin user name can be configured, in apiExec calls the default "admin" username is used.
TODO: the bin/apicall.sh script should likely take that into account.
11 years ago
reger
c656e67c97
fix: display proper error msg on admin user change
11 years ago
orbiter
2ead4e44d9
introduced a new storage path ARCHIVE inside of DATA which will be used
...
as path for solr index dumps (instead of the SEGMENTS path). This will
make a maintenance of index backups easier. It will also provide a tool
to migrate from an freeworld index to a webportal index.
11 years ago
reger
30d925a96e
reimplemented server access restriction
...
via Jetty IPAccessHandler to allow only configured IP's to access.
Handler is only loaded if a restriction is configured.
Since IPAcessHandler (Jetty 8) does not support IPv6 system property java.net.preferIPv4Stack=true
Testing showed system.setProperty seems to be sensitive to point of calling (earliest possible time seems to be best = early in yacy.main).
Moved the "isrunning..." just open browser check also to the new routine to preread the yacy.config only once.
11 years ago
orbiter
3cb6c7861f
fixed shutdown authenticaton problem
11 years ago
Michael Peter Christen
7005ecdabd
cleanup
11 years ago
Michael Peter Christen
2939b47986
removed non-working realm setting in http client (auth for localhost was
...
added in previous commit)
11 years ago
Michael Peter Christen
9bd71fdbb4
made the access tracker class static because it shall be used by the
...
jetty auth module
11 years ago
Michael Peter Christen
7d6fc79eb8
refactoring (usage of constant names for attributes of authentication
...
check)
11 years ago
reger
cabe0943cd
fix opensearch resultcount in yacysearch.rss
...
see merge request https://gitorious.org/yacy/rc1/merge_requests/24
use result count in searchtrailer.xml which is on p2p search more accurate (timing)
11 years ago
reger
eaf596a257
adding proxy status to (private) status box
...
(show also transparent and url proxy status)
show search result via url proxy only if status=on
11 years ago
reger
e3d8459906
extend ssl enabled msg on status page
...
- post the portnr
11 years ago
reger
58ecf5e4dd
add to blacklist button in CrawlResults
...
http://bugs.yacy.net/view.php?id=220
introduced Blacklist.add with sourcefile only parameter
11 years ago
reger
17b454f957
fix external link (open in new tab)
11 years ago
reger
dd8ea0cdd6
fix "add to blacklist" button style in IndexControlRWIs_p
...
- added default filename filter to select field (as only addition to *.black list is permanent)
- modified Blacklist_p header/legend to show all active blacklists
(to support understanding that all configured lists are active)
- removed obsolete code in Blacklist_p servlet
11 years ago
orbiter
2861183359
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
4035e20f0b
unescaping the path
11 years ago
orbiter
7e21d1ff70
"inaccessible" better describes the state of a server which cannot be
...
reached (while 30c3: too many users)
11 years ago
reger
7f9b9315fe
Merge origin/master
11 years ago
reger
8eaabb9600
remove dependency from old serverCore.java
...
- remaining getPortNr not needed
(as current release allows only to set plain integer as port,
see ConfigBasic)
11 years ago
orbiter
2018e55f8b
switched back on index deletion (was accidently off because new jetty
...
framework delivers never null to post arguments .. there may be more of
that kind of problems)
11 years ago
orbiter
d4942ad5e0
startRecord fix; this is not according to SRU definition because this
...
states that the first record has number 0; but +1 is not consistent with
other places where the number is used.
11 years ago
reger
3d913558ab
display configured adminUserName in ConfigAccounts_p
...
- fix read default username in in loginservice
11 years ago
reger
fbdd89e198
Merge origin/master
11 years ago
reger
65a2f3d5e7
tweak Jetty credentials to work with YaCy UserDB
...
- user entry in UserDB with admin right can login to access protected pages
- dto. admin user, choosen username is stored in conf (adminAccountUserName=)
11 years ago
Michael Peter Christen
ee17bd0b69
added option to attach remote solr servers in read-only mode
11 years ago
Michael Peter Christen
25f9c35033
add patch which shall prevent that naive search mistakes like usage of
...
regular expressions cause no results. Usage of '*' followed by a dot or
any expression will now cause that this expression is used as a filetype
search.
11 years ago
reger
e05320b776
upd: to open more external links in new browser-tab
11 years ago
reger
cbb5dc01e4
remove obsolete htroot/solr htroot/gsa YaCy-servlets
...
- now handled by standard servlets
11 years ago
reger
71cac1a278
added SSL/HTTPS connector to support SSL/https connection on port 8443
...
!!! attention !!! to make sure YaCy can start, https will be disabled if port 8443 is used
- added ping test for above to migration
- as of now port for https is hardcoded to default 8443
- if not urgend required I'd leave it this way (it's standard) to use different ports for http and https
- post https port on ConfigBasic.html (if active)
11 years ago
reger
f681ce15ae
remove obsolete HTTPServer input field
11 years ago
Michael Peter Christen
20b48f894f
refactoring: moving all servlets to the same package (the solr servlet
...
is currently actually a filter which should be changed somehow)
11 years ago
Michael Peter Christen
84167adb49
removed unused anomichttpd code after migration to jetty
11 years ago
Michael Peter Christen
b461a27abb
fixed the SolrServlet
11 years ago
Michael Peter Christen
7603e879dc
Merge branch 'master' into HEAD
...
Conflicts:
.classpath
source/net/yacy/cora/federate/solr/SolrServlet.java
11 years ago
Michael Peter Christen
25250405f1
solr servlet preparation for join with jetty branch
11 years ago
reger
c84c313fe1
Merge origin/master into jetty
11 years ago
Michael Peter Christen
74466d731a
use pre-compiled patterns in ymark
11 years ago
Michael Peter Christen
09412ea3a4
counting search requests in solr interface
11 years ago
Michael Peter Christen
67e7dc0cc6
added more properties to seedlist servlet
11 years ago
Michael Peter Christen
79771c60c0
IPv6 fixes
11 years ago
reger
92d9c56f9f
Merge origin/master into jetty
11 years ago
Michael Peter Christen
da380343c2
perform greedy learning heuristic only if load < 1.0
11 years ago
Michael Peter Christen
81926c055d
fixed bug with image search in yacyinteractive
11 years ago
Michael Peter Christen
edda0699e4
changed default timeout for port scanner
11 years ago
Michael Peter Christen
f1b5db2c45
- performance graph does not shop peer ping in memory monitor any more
...
- after a forced GC, the PerformanceMemory view switches to automatic
update by default
11 years ago
Michael Peter Christen
0db8e34625
enhanced webgraph processing
11 years ago
Michael Peter Christen
9d8b32c63a
fixed a division by zero
11 years ago
Michael Peter Christen
957f6297fb
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
reger
effea4bca0
Merge origin/master into jetty
...
Conflicts:
source/net/yacy/cora/federate/solr/SolrServlet.java
11 years ago
reger
b49e90d2e9
remove reference to solrServlet from YaCy servlet select
...
- reference is not used
- solrServlet is used in Jetty branch and adjustments there conflict with unused solrServlet here.
11 years ago
Michael Peter Christen
38e1e3a707
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
sixcooler
2c2ebb0d92
tried some hardening in order not letting any Solr-Searchers open
11 years ago
Michael Peter Christen
cca79d12ef
setting of some default values to make an client development start easy
...
using the description at
http://www.yacy-websuche.de/wiki/index.php/Dev:APIhello
11 years ago
Michael Peter Christen
3d4b5e66ce
disallow remote robots to crawl the HostBrowser servlet
11 years ago
Michael Peter Christen
234ca720f5
only admins should be able to force a commit
11 years ago
Michael Peter Christen
2c39b65409
fixes for searches containing stopwords. The fix was done using a
...
reconstruction of the search word set access method to protect that
words are deleted from the sets from the outside of the QueryGoal class.
11 years ago
orbiter
61409788eb
less word hash computations (removing some overhead because of MD5
...
calcs) using the clear word in a normalized form.
11 years ago
reger
5c4a3d1c01
Merge origin/master into jetty
11 years ago
Michael Peter Christen
caa20d63d9
fixed seedlist (hash was missing)
11 years ago
Michael Peter Christen
ccf2f4e43b
refactoring of seed attributes (introduced more constants)
11 years ago
Michael Peter Christen
c927b428d3
fixed json
11 years ago
Michael Peter Christen
64048ff217
fir for XSS
11 years ago
orbiter
b7f1e5af51
added new servlet which generates the same file as the principal peers
...
upload to a bootstrap position
you can call it either with
http://localhost:8090/yacy/seedlist.html
or to generate json (or jsonp) with
http://localhost:8090/yacy/seedlist.json
http://localhost:8090/yacy/seedlist.json?callback=seedlist
11 years ago
orbiter
3e552550d1
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
c2d720cdaf
purge a lucene cache - possible memory leak fix
11 years ago
reger
f111f30ace
Merge origin/master into jetty
11 years ago
Michael Peter Christen
f4172cbb3d
fix for another XSS bug
11 years ago
orbiter
ff86cb683f
fixed some XSS bugs reported by Marius from http://ctf365.com/
11 years ago
orbiter
19a051bec8
more monitoring for postprocessing and enhanced layout in Crawler
...
monitor page
11 years ago
Michael Peter Christen
fceac8cffd
more monitoring for postprocessing
11 years ago
Michael Peter Christen
9d5895f643
enhanced and fixed postprocessing
11 years ago
Michael Peter Christen
087df05e24
added option to Config_Network_p.html to enable remote search while
...
DHT-Receive is switched off.
11 years ago
Michael Peter Christen
1a4a69c226
set more logger to 'final static'
11 years ago
Michael Peter Christen
69b8d61c47
fix for search requests in GSA interface which contain 'funny'
...
characters (like ':' etc.)
11 years ago
orbiter
4234b0ed6c
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
orbiter
74c86a72a0
better default value for crawler user agent
11 years ago
reger
1437c45383
merge rc1/master
11 years ago
Michael Peter Christen
87a956e881
calculating and showing the number of files and the average size of a
...
file in the HTCACHE in ConfigHTCache_p.html
11 years ago
Michael Peter Christen
acc1f8a749
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
Michael Peter Christen
81bb50118e
found and fixed a huge memory leak in solr caching (inside Solr). The
...
not-flushed Solr cache is now handled in this way:
- it is smaller by default
- an Solr-internal process is started to flush the cache periodically
(this does NOT clean the cache, just removes old objects)
- a Solr-external process (the standard YaCy cleanup-process) now has
direct access to the solr internal cache and flushes them completely.
The time frame for such a flush is defined by the cleanup-process
frequency, by default 10 minutes.
11 years ago
sixcooler
987f410011
URL-export:add query and fix for cast-class-exception
11 years ago
Michael Peter Christen
ffe8276063
replaced referrer link masking to 'pure' links to the referring page
...
(that was more useful during testing)
11 years ago
reger
b38de92a16
Merge origin/master into jetty
11 years ago
Michael Peter Christen
434e13b46d
in host browser also show the properties of failed documents including
...
referrer urls (this is a VERY USEFUL SEO and Web Admin feature!!)
11 years ago