102277e946
Merge branch 'master' of https://github.com/yacy/yacy_search_server
3 years ago
6a8d351df3
Enable Gradle test and add manifest to yacycore.jar, set outputdir to lib
...
as part of migration from Ant to Gradle builds.
3 years ago
46cb485e3e
Update README.md
...
removed the obsolete "Build with Maven" paragraph
3 years ago
d411566c45
Obsolete since replacement of Maven by Gradle build script
3 years ago
c94b9b8197
Merge pull request #439 from otteresk/master
...
Adding sort functionality to Crawler Queue tables
3 years ago
590f39b403
Add Sorting functionality to Crawler Queue Table
...
Allow to sort for count and host
3 years ago
41e87a44bc
Merge pull request #6 from yacy/master
...
Update fork #6
3 years ago
7abfeb221b
Merge pull request #436 from ZeroCool940711/master
...
Improved the Image search page to have bigger thumbnails, use a more area for results and have a smaller sidebar.
3 years ago
870319e769
Fix typo + remove dead seeds
3 years ago
7e765b8483
Improved the Image search page to have bigger thumbnails, use a bigger area for results and a smaller left sidebar.
3 years ago
6fe905bb82
feature https://github.com/yacy/yacy_search_server/issues/434
3 years ago
d7b17d8935
fixed missing thread name revert after balancer waiting
3 years ago
9c38b1254e
proper deletion of loadtime index
3 years ago
bd3f2483a1
replaced url and date retrieval by only url retrieval
...
This should prevent that the search index is used for freshnes of the
index entry.
3 years ago
163ba26d90
replaced check for load time method
...
instead of loading the solr document, an index only for the last loading
time was created. This prevents that solr has to fetch from its index
while the index is created. Excessive re-loading of documents while
indexing has shown to produce deadlocks, so this should now be
prevented.
3 years ago
1ead7b85b5
remove compiler warning
...
"warning: [try] explicit call to close() on an auto-closeable resource"
3 years ago
3dc6613096
updating slf4j 1.7.25 -> 1.7.32
3 years ago
cd0ff48e99
there is no (more) log4j in YaCy
3 years ago
59777010dc
Merge branch 'master' of git@github.com:yacy/yacy_search_server.git
3 years ago
7898815c41
disabling concurrent logging
...
(maybe temporary)
3 years ago
4bf6954474
uses clientBuilder not HttpClients.custom() to have these inside the
...
Pool too
3 years ago
cdf901270c
always use HTTPClient by 'try with resources' pattern to free up
...
resources
3 years ago
69adaa9f55
makes our HTTPClient closable
3 years ago
fc4275f901
handle all references for client, response, request to be able to close
...
them
3 years ago
1cdc55a425
lets SOLR merge bigger segments (up to 50GB)
...
+ some setting to reduce caches
3 years ago
e7d3a363f2
refactor to use finish()
3 years ago
4fc876f4a3
revert back to use EntityUtils.consumeQuietly - as it simply closes the
...
underlying stream
3 years ago
4f0392e93e
refactor use of AuthSchemeProvider
3 years ago
b74f337859
removes double setting of UserAgent
3 years ago
965748fefb
some refactoring using try with resources
3 years ago
f4834e8e31
link fix
3 years ago
7f5d3e3a12
fixed name
3 years ago
552ab7051b
fix for warc importer
3 years ago
3c86b7b780
attempt to make a Mac Release using gradle
...
This is almost working with many workarounds:
- run rm lib/yacycore.jar
- run ./gradlew clean build bundleNative
- run ant clean all
- run again rm lib/yacycore.jar
- run ./fixMacBuild.sh
The build is then inside build/mac/YaCy.app
Right now this works so far but it does not have the correct release
number inside.
Target is to make this working for Windows releases and to embedd jre
entirely.
3 years ago
49cae8ca62
network bootstraping addresses update
3 years ago
8e4383c49e
downgrading gradle to 6.9
...
to be able to support org.mini2Dx.parcl
3 years ago
999c819e3e
Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
3 years ago
fd770e90e2
spike to identify paths for YaCy within mac application bundles
3 years ago
d19872fd26
making sure that crawl queues are closed correctly to prevent data loss
3 years ago
90507c0fdc
comments out printing query params to std.out
3 years ago
be0aebad84
fixes https://github.com/yacy/yacy_search_server/issues/424
3 years ago
63ad8ce6b2
removed ymarks
...
had not been used since a long time
3 years ago
ef5a71a592
enhanced crawl start response time
...
for very very large crawl start lists
3 years ago
1bab4ffe20
calculating the correct size of an export.
...
This can be seen as a fix for
https://github.com/yacy/yacy_search_server/issues/343
however, the export was not flawed, it is just the impression that
something is wrong, but the export size must be smaller than the index
size because the index also containers error documents.
Now an information line is presented that shows i.e.:
"The local index currently contains 181,319 documents, only 106,887
exportable with status code 200 - the remaining are error documents."
3 years ago
4cadd557dc
removed synchronization in table creation
...
to avoid possible deadlocks when handling OnDemandOpenFileIndex
which happens quite often during wide crawling
3 years ago
8084960392
disabled citation index
...
that was created but never used
3 years ago
9b7668fa58
reduced memory footprint during indexing/crawling
3 years ago
fbf8ddd32d
upgrade of jsoup 1.12.1 -> 1.14.2
3 years ago
53518a91ab
In case of reload404, load only failed documents
3 years ago
4c889b7ff9
fixed build paths
3 years ago
reger24