5268ae2ce9
check the document protocol & host values before proceeding to form final url.
5 months ago
962aaec0c0
Improve the clarity of deep crawl feature UI text on AutoCrawler
5 months ago
d958d1c0c4
ensure that returned SolrDocument is not null
5 months ago
66cf7d4ca5
disables autowarm of filtercache, corrects luceneMatchVersion
5 months ago
70454654f3
by default open the https url for a given host, not the http url
...
(http does almost not exist any more)
6 months ago
71a6074cc5
added setting of cache configuration for solr
...
according to recommendation from
https://community.searchlab.eu/t/yacy-support-gpt-chatgpt-assistant/1622
However it is not clear if this configuration actually works (has an
effect at all) or is the solution for performance issues.
6 months ago
b8479430b6
400 is too small
6 months ago
5f4ea9ac5d
reduced memory amount for network image
...
reduced also the number of memory allocation for image storage
6 months ago
fe4c0aa890
refactoring of RAG reverse proxy: extracted code for ollama code to
...
their own classes
6 months ago
8b65a4d14e
fixed build clean
6 months ago
f1c70dce33
Merge branch 'master' of github.com:yacy/yacy_search_server
6 months ago
8eb0d490aa
migrated solr to 9.0
...
This is a major step because solr removed support for embedded solr
instances in 9.0 and we want to keep it because we want to ship
YaCy with an embedded solr. It was necessary to add parts of solr
code into YaCy to make this migration possible. Further on with
Solr 9.1 they removed even more parts which are required for embedded
operation, therefore we cannot migrate yet further without big
changes.
If you are running a YaCy instance with Solr 8.x, the migration should
be done automatically. If not you require to first migrate to a YaCy
version 1.93 with Solr 8.x to migrate to Solr 8 data.
6 months ago
b8417e5619
removed Mac specific code which is not working any more on recent Macs
6 months ago
13fbff0bff
Added a RAG Proxy for AI Chat with YaCy
...
RAG (Retrieval Augmented Generation) is a method to combine a search
engine with a LLM (Large Language Model). When a new prompt is
submitted, a search engine injects knowledge from a search into the
content. This is done using a reverse proxy between the Chat Client and
the LLM. In this case, we used the following software:
LLM Backend - Ollama:
https://github.com/ollama/ollama
Install ollama and then load two required LLM models
with the following commands:
ollama pull phi3:3.8b
ollama pull llama3:8b
Chat Client - susi_chat:
https://github.com/susiai/susi_chat
just clone the repository and the open the file
susi_chat/chat_terminal/index.html
in your browser. This displays a chat terminal.
In this terminal, run the following command:
host http://localhost:8090
This sets the LLM backend to your YaCy peer.
Then start YaCy. It will provide the LLM endpoint to the client
while using ollama in the backend. It then injects search results
only from the local Solr index, not from the p2p network (so far).
6 months ago
59c0cb0f30
fixed aarch64 dockerfile
6 months ago
0405ec8ad2
Merge pull request #642 from HeliosLHC/reduce_image_size
...
Reduce Docker Image Size
6 months ago
c2ad1950e8
updated jetty to 9.4.54.v20240208
6 months ago
b295e38969
fine-tuned the import process of jsonl files which had been missing
...
to actually be able to make searches and browse the index with the host
browser
6 months ago
262b23532d
reduce image size
6 months ago
de941c6fee
Merge pull request #633 from LillySchramm/fix/632/remove-sayat-link
...
fix: Remove SayAt.Me Link
7 months ago
160e346d4c
fix: Remove SayAt.Me Link
7 months ago
656d47c1ac
Merge pull request #628 from frankenstein91/vagrant
...
Vagrant demo
9 months ago
9a406d310c
switch user
9 months ago
6864486196
add Yacy vagrant
...
untested
9 months ago
331e0a24fc
Merge pull request #621 from OFA54/patch-1
...
turkish translation tr.lng
11 months ago
d825a85a01
Merge pull request #619 from pr0vieh/initrecrawl
...
bring defaults for recrawlindex to init config
11 months ago
35620762ac
bring defaults for recrawlindex to init config
11 months ago
d097a642c2
Merge pull request #615 from okybaca/logging2
...
Logging unclutter
12 months ago
6d5e9ff53f
Merge pull request #616 from okybaca/logging3
...
changed the log entry REJECTED to CRAWLER * REJECTED, loglevel fine
12 months ago
d5d4e8fe3a
Merge pull request #617 from pr0vieh/master
...
Add setting for DHT receive loadprereq insted of hardcoded load < 2.0
12 months ago
dfb2b79609
Add setting for DHT receive loadprereq insted of hardcoded load < 2.0
12 months ago
5dee8dbcbd
changed the log entry REJECTED to CRAWLER * REJECTED, loglevel fine
12 months ago
4c603e23f0
Merge pull request #610 from okybaca/cr-text
...
UI: added a more descriptive message, CitationRank instead of cr
12 months ago
040cd8be6d
Merge pull request #612 from okybaca/sitemap-fix
...
updated apache libs
12 months ago
0233ecd481
Merge pull request #614 from okybaca/logging
...
added some logging prefixes to yacy.logging
12 months ago
7831f294a9
changed regular peerping messages to level fine
12 months ago
553c859703
logging: moved some log-cluttering DHT messages to level 'fine'
12 months ago
1c5fca9a58
changed network operation log category from YACY to NETWORK
12 months ago
2f44fc0257
added some logging prefixes to yacy.logging
12 months ago
89c2a92cfb
tr.lng
1 year ago
3d3bdb0f5f
added zim importer rule for mdwiki
1 year ago
4a611ac6a3
another possible fix for
...
https://github.com/yacy/yacy_search_server/issues/500
1 year ago
9c59c6814b
updated apache libs
1 year ago
d72cd7916c
Merge branch 'master' of https://github.com/yacy/yacy_search_server
1 year ago
0663ae3c99
adds synchornized dumplog
1 year ago
cba84632ee
UI: added a more descriptive message, CitationRank instead of cr
1 year ago
cff0991d85
test if this is helpful for https://github.com/yacy/yacy_search_server/issues/500
1 year ago
ceb07a5218
fixed problem with zim importer which crashed when non-valid urls appeared
1 year ago
656b3e3e77
updated guava to latest and added missing library for failureaccess
1 year ago
3268a93019
added a 'minified' option to YaCy dumps
1 year ago
zutto