c2b6b6e7b9
Fixed a large number of problems in the ZIM reader.
...
This library was not prepared for large data because it was missing long
data types for pointers. I had to modify the code-base in a fundamental
way:
- Proof-Reading,
- unclustering,
- refactoring,
- naming adoption to https://wiki.openzim.org/wiki/ZIM_file_format ,
- change of Exception handling,
- extension to more attributes as defined in spec (bugfix for mime type
loading)
- bugfix to long parsing (prevented reading of large files)
The code is furthermore very inefficient and requires more attention.
However the format is very useful for YaCy as there are numerous data
sources for ZIM-Files.
1 year ago
5ba5fb5d23
upgraded pdfbox to 3.0.0
1 year ago
c10944bd4a
updated bcmail-jdk15on 1.75 to bcmail-jdk18on 1.67
1 year ago
1fefae9baf
integrated the source code of a openzim file format reader. These are
...
the raw format reader files with no integration in YaCy yet, which will
maybe follow as a next step. The zim file format is documented in
https://openzim.org and the reader code was taken from the archived,
non-maintained repository at https://github.com/openzim/zimreader-java
1 year ago
ec2d14e973
fine tuning the dark-green color scheme
1 year ago
4308aa5415
removed concept of empty passwords as "no passwords used",
...
because we now start YaCy with a default password (yacy).
This has impact of all function that check the current state of
password-protection that included the empty password situation,
including the warnings to set a password in case that none is set (which
cannot be the case any more).
1 year ago
2c60ff14bb
fixed default pw comparison
1 year ago
4da320bebf
added a warning message in ConfigBasic in case that the default password
...
was not changed.
1 year ago
7830268be1
fix 756c817b5a
...
must be applied to all code where a transaction token is generated.
1 year ago
dc6f218520
set the default password for the admin account to "yacy"
1 year ago
756c817b5a
fix for https://github.com/yacy/yacy_search_server/issues/544
1 year ago
bab1cfc7ea
added required build tools installation
1 year ago
03bf259601
fix for https://github.com/yacy/yacy_search_server/issues/363
...
We still need to set the load in the process because a demand for higher
crawl speed may require to increase the maximum load limit. However,
following the criticism in the bug, we do never reduce the load limit
again.
1 year ago
5bc09af426
Merge pull request #600 from okybaca/scheduler-sort
...
UI: modified link to Process Scheduler in left menu
1 year ago
4c1eb34e85
modified link to Process Scheduler in left menu
1 year ago
aeb4c7a660
removed warnings during normal build
1 year ago
095a444aa7
removed wiki links and added more shields badges
1 year ago
ca2a21008a
added screenshots
1 year ago
961d3cc8af
Merge pull request #597 from joestr/issue/574-fix-mac-script
...
Fix macOS script
1 year ago
a035b21f63
Merge pull request #598 from joestr/improvement/remove-travis-yml
...
Remove .travis.yml
1 year ago
b29c0ef133
remove .travis.yml since YaCy is not build on Travis CI anymore
1 year ago
09783ae89e
apply patches from @HenryLoenwind
1 year ago
94db89a757
small remaining changes in readme
1 year ago
0c4478cd71
migrated jetty to 9.4.52.v20230823
1 year ago
938724caa8
new development on-boarding process in eclipse with changes for ivy
1 year ago
8fc51f66c6
fixed a test class which prevented compilation on latest jvm
1 year ago
bda118af5d
Merge pull request #594 from joestr/master
...
Match more YaCy versions
1 year ago
53bafa1544
consistent formatting in string concatenation
1 year ago
22c4188001
additionally match release stub for YaCy version
1 year ago
4a5820eb03
7zip parser was removed previously.
...
see also https://github.com/yacy/yacy_search_server/issues/491
1 year ago
ff8fe7b6a4
fix for ',' or '.' appearing within a word or number. This will not
...
tokenize the query into parts around that character to make it possible
to search for numbers or version numbers.
1 year ago
0689f4f0ae
Check if the character is a minus sign and is followed by a letter or a
...
digit. Treat it as part of the word/number.
1 year ago
5db97a8928
parser can now separate numbers from words also when they are not
...
separated by space, i.e. 4.7Ohm
1 year ago
079eafe7f1
removed 7zip from eclipse classpath
1 year ago
e3797de7de
enhanced the word tokenizer to recognize numbers in a proper way
1 year ago
88cd17ea57
migrated solr from 8.9.0 to 8.11.2; activated also migration script. A YaCy index with solr 8.9.0 will automatically be migrated to 8.11.2. This is a preparation step to migrate to 9.0.0 soon.
1 year ago
0089f234f4
added npe protection
1 year ago
8285fe715a
tab to spaces for classes supporting the condenser.
...
This is a preparation step to make changes in condenser and parser more
visible; no functional changes so far.
1 year ago
ce4a2450da
fixed workflow for ci process/2
1 year ago
a3ca4eac08
fixed workflow for ci process
1 year ago
6bd5f49c41
Migrated from java 8 to java 11. This step is required to upgrade certain packages, most important solr which will be migrated from 8.9 to 9.x
1 year ago
376bcfd54c
Merge pull request #588 from okybaca/crawlurl
...
modified crawl list so the URL links to external URL
1 year ago
d353202489
Merge pull request #589 from okybaca/restartbuild
...
added restartYACY.sh so it's included in release package
1 year ago
1de37bc60b
added restartYACY.sh so it's included in release package
1 year ago
08b769f63a
modified crawl list so the URL links to external URL
1 year ago
195bd2e444
extended the maximum header size to 16k to prevent http error 431
1 year ago
0554056c63
added .txt search result page (just replace '.html' with '.txt' in yacysearch.html page to get a url list)
1 year ago
117e2d0663
Merge pull request #580 from okybaca/restartyacy
...
added a restartYACY.sh script
1 year ago
c3809fbc36
Merge pull request #575 from okybaca/readme-ant
...
added link to faq and more ant build instructions to README
1 year ago
eeeec0b8fe
Merge pull request #585 from okybaca/stopYacyDots
...
instead of WAITING lines, WAITING FOR STOP and dots are echoed
1 year ago
Michael Peter Christen