Michael Peter Christen
cef5fde343
adding message to UI to make port change transparent
4 years ago
Michael Peter Christen
52228cb6be
added a gc to cleanup process (once every 10 minutes)
4 years ago
Michael Peter Christen
22841ffbf1
creating a threaddump during every cleanup process
...
to be able to find out what a peer did (not) last time before a crash
4 years ago
Michael Peter Christen
36e616271b
do better documentation on how to set a default password
4 years ago
Michael Peter Christen
df2bf9ef28
try to fix maven build error
4 years ago
Michael Peter Christen
264bab6700
trying to fight the UI unavaiability
...
this path addresses a possible issue with too many open connections to
remote peers
4 years ago
Michael Peter Christen
7947baeb49
removed all remaining deprecation warnings
4 years ago
Michael Peter Christen
c0f6d6e11d
removed one deprecation warning for jetty library initializing ssl
...
server port
4 years ago
Michael Peter Christen
133440a7a6
some debug lines
4 years ago
sgaebel
3431f91db9
removes unused 'unused' tokens
4 years ago
sgaebel
fc03c4b4fe
removes some warning and unused objects
4 years ago
sgaebel
4a495df63a
removes some deprecation-warnings
4 years ago
sgaebel
dd9d4b1188
replace org.junit.Assert.assertThat by
...
org.hamcrest.MatcherAssert.assertThat from hamcrest 2.2 to avoid
deprecation-warning
4 years ago
sgaebel
df9ea0a42a
removes some warnings: unused imports, params
4 years ago
sgaebel
9bc2297161
fixes deleting during recrawl
4 years ago
sgaebel
80785b785e
adds deleting during recrawl
4 years ago
Michael Peter Christen
e0ad8ca9da
replaced json library from JSON.org with libandroid-json-java
...
This fixes https://github.com/yacy/yacy_search_server/issues/347
5 years ago
Michael Peter Christen
053e54a2c7
grand CORS for json files
5 years ago
Michael Christen
cfa27d2fd5
fixed links
5 years ago
Michael Christen
cb20aa7e54
removed donation message in search result column
5 years ago
Michael Christen
25227676ae
removed some warnings
5 years ago
luccioman
6b45cd5799
New optional crawl filter on the URL a doc must match to crawl its links
...
For finer control over which parsed documents can trigger an addition of
their links to the crawl stack, complementary to the existing crawl
depth parameter.
6 years ago
luccioman
d16bc99835
Added "Show Metadata" links to the ViewFile.html links mode
...
To conveniently follow parsed links in the file viewer
6 years ago
luccioman
a5771b1f14
Made SNI extension user configurable without the need for server restart
...
TLS Server Name Indication (SNI) extension activation can now be
configured with the new Settings_p.html?page=httpClient administration
page.
SNI extension is also now enabled by default, as in 2019 the
unrecognized_name(112) alert is more properly handled by major web
servers TLS implementations, following the RFC 6066 standard.
Related YaCy issues : #153 #189 and #272
JDK 1.7 bug :
https://bugs.java.com/bugdatabase/view_bug.do?bug_id=7127374
Apache httpd issue :
https://bz.apache.org/bugzilla/show_bug.cgi?id=56241
RFC 6066 : https://tools.ietf.org/html/rfc6066#section-3
6 years ago
luccioman
e90405b6f0
Support parsing audio URLs without file extension
...
Added also a Junit for the audio tag parser
6 years ago
luccioman
a8316c79da
Allow JS resorting of search results by unauthenticated users
...
Acces rate limitations to this search mode by unauthenticated users are
set low by default to prevent unwanted server overload but can be
customized through the SearchAccessRate_p.html configuration page
Fixes #291
6 years ago
luccioman
0ab2b49c31
Made /yacysearch access rate limitations user configurable
...
With a new admin page at /SearchAccessRate_p.html in menu Network Access
> Local Search > Access Rate Limitations
6 years ago
luccioman
5b7e41202a
Added Solr GSA writer support for responses from remote instances
6 years ago
luccioman
4d8a948455
Properly close PDF snapshots loaded with pdfbox library
6 years ago
luccioman
74e6d6e984
Added Solr GrepHTML writer support for responses from remote instances
6 years ago
luccioman
5e6501974d
Added Solr snapshots writer support for responses from remote instances
6 years ago
luccioman
384c37102c
Improve accuracy of total results count on latest pages in Stealth mode
...
Previously, when mixing results from local RWI and local Solr (Stealth
mode), total local Solr count could be ignored on last result pages,
when the page offset was higher than local Solr count but lower than
total RWI count.
6 years ago
luccioman
5e9a08355a
Improved logging for federated search
...
- Do not use spaces in logger identifier name so the log level can be
configured in yacy.logging
- Hold the logger instance to avoid the logging system to look for it
from its name at each appended log message
6 years ago
luccioman
9782a98a9c
Added the possibility to customize facets sort type and direction
...
Previously search navigators/facets elements were sorted only by counts.
Now from the ConfigSearchPage_p.html admin page, sort direction
(ascending/descending) and type (on counts or labels) can be customized
independently for each navigator.
6 years ago
sgaebel
c2398fd890
remove warnings: 'Statement unnecessarily nested within else clause'
6 years ago
sgaebel
811d40a6c4
taking care of closing inputstreams, HTTPClient
6 years ago
sgaebel
8d2e7262d9
Recrawl:
...
- set the chunksize to 100 to meet the max of the embedded solr
- re-enable sorting (the case where we switched it of should be away)
- enable recrawling on remote-solr
6 years ago
sgaebel
8f58c1dcfa
extend the SolrServlet to be usable as remote solr (incl. update)
...
this feature needs to be enabled by uncomment the url-pattern
6 years ago
luccioman
7223a2fdb1
Removed usage of now deprecated Jetty function
6 years ago
luccioman
440d9f2fa0
Exclude peers with empty or disabled RWI from remote RWI search
6 years ago
luccioman
08ea0b0397
Added a configurable timeout to wkhtmltopdf calls for pdf snapshots
...
Necessary to prevent blocking the indexing workflow when some
wkhtmltopdf renderings fail without terminating
6 years ago
luccioman
3fb449b3b6
Properly resolve relative URLs against document URL in html base tags
...
Fixes issue #256
6 years ago
luccioman
73a6e45524
Extended detection of external tools used for Snapshots generation
...
This enable detecting wkhtmltopdf and Imagemagick convert executables
when they are at system Path in addition to common installation paths.
6 years ago
luccioman
7dc1f60619
Fixed detection of absolute data folder path on MS Windows
6 years ago
luccioman
595e144797
Trace a message on incomplete proper server finish when killing process
6 years ago
luccioman
9daeea823b
Fixed concurrency issue on cache used for circles rendering
...
Without synchronization lock, concurrent rendering of images including
circles could lead to glitches as reported in issue #248
6 years ago
Michael Peter Christen
c347e7d3f8
Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
6 years ago
Michael Peter Christen
848e9304d9
evil bots may crawl harder
6 years ago
luccioman
a997133260
Fixed gzip decompression regression on index transfer APIs
...
Processing of gzip encoded incoming requests (on /yacy/transferRWI.html
and /yacy/transferURL.html) was no more working since upgrade to Jetty
9.4.12 (see commit 51f4be1
).
To prevent any conflicting behavior with Jetty internals, use now the
GzipHandler provided by Jetty to decompress incoming gzip encoded
requests rather than the previously used custom GZIPRequestWrapper.
Fixes issue #249
6 years ago
luccioman
e85f231bdf
Fixed termination of Host browser and link structure Solr query threads
...
On some conditions (especially when reaching timeout), concurrent Solr
query tasks used by the /HostBrowser.html and /api/linkstructure.json
never terminated, thus leaking resources, as reported by @Vort in issue
#246
6 years ago