Michael Christen
42ea2a1c6f
Merge pull request #405 from jfhs/jfhs/support-all-html-entities
...
Improve HTML entities support
4 years ago
Michael Christen
b2af745dd6
Merge pull request #404 from lnceballosz/master
...
NGI0 - Updating licensing aspects according REUSE
4 years ago
jfhs
10bddc2c2d
Decode HTML entities in all property values by default
4 years ago
jfhs
2135d259e3
Replace hardcoded html/xml entities with a file, support decoding all defined HTML entities
4 years ago
Michael Peter Christen
8f876a8c72
added concurrency to enhance indexing speed during json surrogate import
4 years ago
Michael Peter Christen
f8cbaeef93
Merge branch 'master' of git@github.com:yacy/yacy_search_server.git
4 years ago
Michael Peter Christen
a857e3d3d5
fix for json importer
4 years ago
sgaebel
7fecd859e5
fixes showing metadata from Searchresult, by removing defType=edismax
...
also removes defType=edismax from IndexBrowser, but still does not show
dates
4 years ago
sgaebel
1546232c94
adds ranking for multi document queries only
4 years ago
sgaebel
93b353d22d
does not boost or add fields for zero-row-queries (exists())
4 years ago
sgaebel
f16cd154f7
removes unused imports and variables
4 years ago
sgaebel
c69c462a15
replaces a expensive getLoadTimeURL() by exists()
...
refactors urlExists to getHarvestProcess as that is what it does
4 years ago
sgaebel
a5488ac8f5
uses edismax queries on query counts > 1 only
4 years ago
sgaebel
26223dc25a
replaces getLoadTime() by exists() with a simpler query
...
since solr-8.8.1 getLoadTime() causes a high cpu usage
4 years ago
sgaebel
8e4d014c06
removes useless SolrRequestInfo.clearRequestInfo(), avoids spamming the
...
log
4 years ago
sgaebel
88c6bc8cd7
adds missing solr lib: opentracing 0.33.0
4 years ago
Lina Ceballos
139b5a4033
improving license info in README
4 years ago
Lina Ceballos
a96752f5ab
adding SPDX license and copyright headers
4 years ago
Lina Ceballos
221038f16d
creating LICENSES directory
4 years ago
Michael Peter Christen
e18d0ef544
trying to set a higher priority to the process that is involved in index
...
export
4 years ago
Michael Peter Christen
c552a2845f
added new commons library (missed in latest commit)
4 years ago
Michael Peter Christen
8b4394a6c5
fixes for solr 8.8.1 migration
...
- replace new guava 30 with older 25 because that is the correct
dependency for solr 8.8.1. The newer one did actually not work!
- index will be crated in a DATA/INDEX/freeworld/SEGMENTS/solr_8_8_1
subfolder. The older solr_6_6 index is not touched but also not
migrated. The index starts with fresh (empty) content.
- Older indexes must be migrated by hand (export/import) so far until a
better solution is found.
- Large schema adoptions for lucene 8.8.1
4 years ago
Michael Peter Christen
3befaaf4f1
reformatting pom.xml to make it easier to update it with recent library versions
4 years ago
Michael Christen
dffe9e1c23
Merge pull request #402 from SebastianoPistore/junitUpdate
...
Workaround for CVE-2020-15250
4 years ago
Michael Peter Christen
7c86826db3
new version for solr 8
...
ATTENTION: old indexes from solr 6 CANNOT be migrated to solr 8
DO NOT use this version if you still have a solr 6 index.
4 years ago
Michael Peter Christen
ed9789214e
fixed seed initialization problem
4 years ago
Michael Peter Christen
f4f3808d43
added missing new dependencies for migration to Solr 8
...
after pulling https://github.com/yacy/yacy_search_server/pull/403
4 years ago
Michael Christen
ffe8786d69
Merge pull request #403 from alsutton/address_security_issues
...
Update dependencies to address vulnerabilities.
4 years ago
Al Sutton
f4dd6e6d41
Update Lucene to 8.8.1
4 years ago
Al Sutton
721dd3e1ba
Update Guava to match version pulled through from solr dependencies
4 years ago
Al Sutton
b5203de923
Update ant build solr dependency to 8.8.1
4 years ago
Al Sutton
8ade8b8775
Remove forced clear to match new behaviour in 2da71c2a40
4 years ago
Al Sutton
09695fc6d3
Update exceptions to match updated API
4 years ago
Al Sutton
69014a701e
Update API Usage
4 years ago
Al Sutton
9ba0fa1beb
Update dependencies to address vulnerabilities.
...
JUnit 4.13.1 addresses a vulnerability in 4.13 -
https://github.com/junit-team/junit4/blob/HEAD/doc/ReleaseNotes4.13.1.md
Solr has a number of vulnerabilities which should be patched, the
main one being something that affects all versions under 8.4.0;
CVE-2019-17558 - Remote code execution in Solr 5.0.0 - 8.3.1
https://nvd.nist.gov/vuln/detail/CVE-2019-17558
To address this I've updated the dependency to be the latest version
(8.8.1).
4 years ago
Sebastiano Pistore
78bd82f8ef
Workaround for CVE-2020-15250
4 years ago
Michael Peter Christen
b46513f4a1
added stub of rc3assembly style
...
a little bit late but whatever
4 years ago
Michael Peter Christen
3da7628117
use environment variables to overwrite configuration variables
...
you can i.e. do:
export YACY_PORT=8092 && ./startYACY.sh
Just append "YACY_" to uppercase version of environment variables and
replace all "." with "_".
4 years ago
Michael Peter Christen
13a2e6dc6e
Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
4 years ago
Michael Peter Christen
0ae8ccf657
Make it possible to set an empty password disabling the authentication
...
protocol completely
If you set now an empty password, then the http server will not ask to
authentify. This is required for environment where we attach an outside
authentification service like keycloak or similar using authentication
in an ingress proxy.
This change is part of the approach to run YaCy inside of a kubernetes
cluster where we do not want individual authentication of peers and want
to apply a ingress authentication.
4 years ago
Michael Peter Christen
96592a10cf
added option to set yacy configuration values using environment
...
variables
To use that feature, set an environment variable with prefix "yacy." and
suffix identical to the yacy configuration attribute name.
Additionaly we implemented a way to set a peer name using the setting
"network.unit.agent". This can therefore now be used to set a peer name
with the java call parameter
-Dyacy.network.unit.agent=anonymous
The purpose for this feature is the ability to set peer names in
mass-deployed kubernetes clusters to the same name to prevent that we
are flooding peer name statistics with auto-deployment-generated names.
4 years ago
Michael Peter Christen
198826c362
added network scanner process to discover all YaCy peers in the intranet
...
this will be used to wire YaCy peers in a kubernetes cluster
4 years ago
Michael Peter Christen
d9602e8325
Implemented a new syntax in the template engine to simplify json APIs
...
Added also an example for one of the existing APIs. The problem is the
comma separator between objects which must not be there for the last
entry in a sequence. The new syntax adds the separator symbol
automatically.
4 years ago
Michael Peter Christen
5a7f12a9c1
allow network scans for non-standard http/https ports
4 years ago
Michael Peter Christen
022fb15670
fix for https://github.com/yacy/yacy_search_server/issues/385
4 years ago
Michael Peter Christen
17672fcbb4
adding hint how to shrink the disk size after an index deletion.
...
implements https://github.com/yacy/yacy_search_server/issues/360
4 years ago
sgaebel
b8d264f7ec
fixes logging
4 years ago
Michael Peter Christen
13e42c2dd2
aded dockerfiles for 32 and 64 bit ARM/Raspberry Pi
4 years ago
Michael Peter Christen
062111a003
improved dockerfiles
...
They do not use git pull to get the latest YaCy code.
Instead they copy from local file system.
4 years ago
Michael Peter Christen
4c920d05b5
removed superfluous lines
4 years ago