6006 Commits (c4659f0fb01be0f68ce3dcccc1955c8662a5345f)

Author	SHA1	Message	Date
Michael Peter Christen	15b7461bc7	removed Xms java memory startup parameter ... We will use the default value for now on. This is much better for resource economy and fits better into a container/docker/kubernetes strategy. Furthermore, a small memory footprint is essential for the usage on small devices like RaspberryPi.	4 years ago
Michael Peter Christen	4377bd2b70	fix for wrong crawlName construction	4 years ago
Michael Peter Christen	e81b770f79	enabled crawl starts with very large sets of start urls ... i.e. 10MB large url list with approx 0.5 million start points	4 years ago
Michael Peter Christen	dbd211a1ad	removed/replaced reflection in memory tool	4 years ago
Michael Peter Christen	1cdb21592b	added hazelcast and some modifications to align legacy YaCy with ... YaCyGrid	4 years ago
sgaebel	7fecd859e5	fixes showing metadata from Searchresult, by removing defType=edismax ... also removes defType=edismax from IndexBrowser, but still does not show dates	4 years ago
sgaebel	f16cd154f7	removes unused imports and variables	4 years ago
sgaebel	c69c462a15	replaces a expensive getLoadTimeURL() by exists() ... refactors urlExists to getHarvestProcess as that is what it does	4 years ago
sgaebel	26223dc25a	replaces getLoadTime() by exists() with a simpler query ... since solr-8.8.1 getLoadTime() causes a high cpu usage	4 years ago
Michael Peter Christen	b46513f4a1	added stub of rc3assembly style ... a little bit late but whatever	4 years ago
Michael Peter Christen	3da7628117	use environment variables to overwrite configuration variables ... you can i.e. do: export YACY_PORT=8092 && ./startYACY.sh Just append "YACY_" to uppercase version of environment variables and replace all "." with "_".	4 years ago
Michael Peter Christen	13a2e6dc6e	Merge branch 'master' of https://github.com/yacy/yacy_search_server.git	4 years ago
Michael Peter Christen	0ae8ccf657	Make it possible to set an empty password disabling the authentication ... protocol completely If you set now an empty password, then the http server will not ask to authentify. This is required for environment where we attach an outside authentification service like keycloak or similar using authentication in an ingress proxy. This change is part of the approach to run YaCy inside of a kubernetes cluster where we do not want individual authentication of peers and want to apply a ingress authentication.	4 years ago
Michael Peter Christen	96592a10cf	added option to set yacy configuration values using environment ... variables To use that feature, set an environment variable with prefix "yacy." and suffix identical to the yacy configuration attribute name. Additionaly we implemented a way to set a peer name using the setting "network.unit.agent". This can therefore now be used to set a peer name with the java call parameter -Dyacy.network.unit.agent=anonymous The purpose for this feature is the ability to set peer names in mass-deployed kubernetes clusters to the same name to prevent that we are flooding peer name statistics with auto-deployment-generated names.	4 years ago
Michael Peter Christen	198826c362	added network scanner process to discover all YaCy peers in the intranet ... this will be used to wire YaCy peers in a kubernetes cluster	4 years ago
Michael Peter Christen	d9602e8325	Implemented a new syntax in the template engine to simplify json APIs ... Added also an example for one of the existing APIs. The problem is the comma separator between objects which must not be there for the last entry in a sequence. The new syntax adds the separator symbol automatically.	4 years ago
Michael Peter Christen	5a7f12a9c1	allow network scans for non-standard http/https ports	4 years ago
Michael Peter Christen	022fb15670	fix for https://github.com/yacy/yacy_search_server/issues/385	4 years ago
Michael Peter Christen	17672fcbb4	adding hint how to shrink the disk size after an index deletion. ... implements https://github.com/yacy/yacy_search_server/issues/360	4 years ago
Michael Peter Christen	907f121d0c	do not overwrite PW with random PW	4 years ago
Michael Peter Christen	256fa3d985	new limitation documentation ... just replaced two by four	4 years ago
Michael Peter Christen	7997836506	fixed lock image	4 years ago
Michael Peter Christen	d0abb0cedb	enabling all crawl profiles in all network modes ... also: increased default internet crawl speed to 4 urls/s/host	4 years ago
Michael Peter Christen	a9befbba5f	Merge branch 'master' of git@github.com:yacy/yacy_search_server.git	4 years ago
Michael Peter Christen	fed8bd6325	automatically refresh css cache when switching skin ... and setting of default skin to current skin in selector	4 years ago
Michael Peter Christen	9a5694261a	design update ... more space	4 years ago
Michael Peter Christen	4ec55289a8	using a lock symbol which looks also good in dark designs	4 years ago
Michael Peter Christen	43a9f4f574	updated solr 6.6.6 -> 7.7.3 ... dropped GSA support (GSA API is still in YaCy Grid) The 6.6.6 solr index works without migration also with 7.7.3	4 years ago
Michael Peter Christen	c0d9a3e9a7	turned HostBrowser into a admin-only page, now called IndexBrowser ... This was required because spiders and bots crawled through this page and created load on the peer without use for the user or the YaCy network.	4 years ago
Michael Peter Christen	d359d521a1	fixed warc importer ... The importer tried to import a gziped files as plain warc. It will now check the file extension and use a unzip automatically on-the-fly.	4 years ago
Michael Peter Christen	cef5fde343	adding message to UI to make port change transparent	4 years ago
Michael Peter Christen	22841ffbf1	creating a threaddump during every cleanup process ... to be able to find out what a peer did (not) last time before a crash	4 years ago
Michael Peter Christen	d7b2d82faa	showing MB instead of KB in PerformanceMemory	4 years ago
sgaebel	3431f91db9	removes unused 'unused' tokens	5 years ago
sgaebel	dd9d4b1188	replace org.junit.Assert.assertThat by ... org.hamcrest.MatcherAssert.assertThat from hamcrest 2.2 to avoid deprecation-warning	5 years ago
sgaebel	df9ea0a42a	removes some warnings: unused imports, params	5 years ago
sgaebel	80785b785e	adds deleting during recrawl	5 years ago
Michael Peter Christen	e0ad8ca9da	replaced json library from JSON.org with libandroid-json-java ... This fixes https://github.com/yacy/yacy_search_server/issues/347	5 years ago
Michael Peter Christen	6d7dc01670	Merge branch 'master' of git@github.com:yacy/yacy_search_server.git	5 years ago
Michael Peter Christen	0a7bda2a21	removed JSON-evil license line ... These classes had been my own creative work. Just the copyright line had been appeared possibly due to a bad copy-paste activity, unaware that the line is a non-free addition.	5 years ago
Michael Christen	57484eb1cc	xss protection	5 years ago
Michael Peter Christen	37827b6788	removed doubes from getpageinfo	5 years ago
Michael Peter Christen	f03e16d3df	enhanced crawl start url check experience ... urls are now urlencoded and a check is also performed in case that an url is copied into the url field using copy-paste	5 years ago
Michael Christen	41f9b8517f	Merge branch 'master' of https://github.com/yacy/yacy_search_server.git	5 years ago
Michael Christen	4ccd1ea3c0	new servlet path "p2p" ... with a test class. Call the class with http://localhost:8090/p2p/seeds.json	5 years ago
Michael Peter Christen	f7c97fd99e	scanner crawl starts wants non-parseable files	5 years ago
Michael Peter Christen	a20b61f5c0	fix for bad json	5 years ago
Michael Peter Christen	d62a8ec542	masking connects	5 years ago
Michael Peter Christen	5eb0033aef	typo	5 years ago
Michael Peter Christen	2c0742fc43	added json version of peer list	5 years ago