boxtec
/
yacy_search_server
mirror of https://github.com/yacy/yacy_search_server
4
1
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '4df29edd03'
${ noResults }
yacy_search_server/build.gradle

265 lines
11 KiB
Raw Normal View History Unescape

attempt to make a Mac Release using gradle This is almost working with many workarounds: - run rm lib/yacycore.jar - run ./gradlew clean build bundleNative - run ant clean all - run again rm lib/yacycore.jar - run ./fixMacBuild.sh The build is then inside build/mac/YaCy.app Right now this works so far but it does not have the correct release number inside. Target is to make this working for Windows releases and to embedd jre entirely.
3 years ago
buildscript {
dependencies {
classpath "org.mini2Dx:parcl:1.7.1"
}
}
replaced maven with gradle
3 years ago
plugins {
id 'java'
id 'maven-publish'
id 'com.github.johnrengelman.shadow' version '5.1.0'
}
apply plugin: 'java'
apply plugin: 'eclipse'
apply plugin: 'application'
attempt to make a Mac Release using gradle This is almost working with many workarounds: - run rm lib/yacycore.jar - run ./gradlew clean build bundleNative - run ant clean all - run again rm lib/yacycore.jar - run ./fixMacBuild.sh The build is then inside build/mac/YaCy.app Right now this works so far but it does not have the correct release number inside. Target is to make this working for Windows releases and to embedd jre entirely.
3 years ago
apply plugin: "org.mini2Dx.parcl"
replaced maven with gradle
3 years ago
repositories {
Enable Gradle test and add manifest to yacycore.jar, set outputdir to lib as part of migration from Ant to Gradle builds.
3 years ago
mavenCentral()
replaced maven with gradle
3 years ago
}
sourceSets {
main {
java {
srcDirs = ['source']
}
}
Enable Gradle test and add manifest to yacycore.jar, set outputdir to lib as part of migration from Ant to Gradle builds.
3 years ago
test {
java {
srcDirs = ['test/java']
}
}
replaced maven with gradle
3 years ago
}
group = 'net.yacy'
version = '1.925'
description = 'YaCy Search Server'
java.sourceCompatibility = JavaVersion.VERSION_1_8
java.targetCompatibility = JavaVersion.VERSION_1_8
mainClassName = "net.yacy.yacy"
applicationDefaultJvmArgs = ["-Xmx1024m"]
Modified GitRevNr Ant-Plugin to work in Gradle - new support library GitComInf to generate a property file for use in Gradle - adjusted build.gradle to make use of it to create the yacyBuildProperties.java - including additon of properties ext.filterTokens as store for Gradle - added gradle-compile-htroot (w/o depends) to old build.xml as target until complete migration as it is imho important imho: much to complicated to get a running number - should be supplied by repo or simplified
3 years ago
// create property store for filterTokens (here, to make sure it exist)
project.ext.filterTokens = new Properties()
attempt to make a Mac Release using gradle This is almost working with many workarounds: - run rm lib/yacycore.jar - run ./gradlew clean build bundleNative - run ant clean all - run again rm lib/yacycore.jar - run ./fixMacBuild.sh The build is then inside build/mac/YaCy.app Right now this works so far but it does not have the correct release number inside. Target is to make this working for Windows releases and to embedd jre entirely.
3 years ago
parcl {
exe {
exeName = "YaCy"
}
app {
vmArgs = ["-Xmx1g"]
appName = "YaCy"
icon = "addon/YaCy.icns"
applicationCategory = "Search-Engine"
displayName = 'YaCy Search Engine'
identifier = 'net.yacy'
copyright = 'Copyright 2021 Michael Peter Christen et al.'
zipName = 'YaCy.zip'
}
linux {
binName = "YaCy"
}
}
replaced maven with gradle
3 years ago
tasks.withType(JavaCompile) {
options.encoding = 'UTF-8'
}
dependencies {
Set all dependencies in Gradle build script - with currently used version - updated support/subproject J7Zip-modified (in libbuild) to be compilable via Gradle - added dependency reference as sub-project - skip the before applied copy of jars to lib directory (no benefit)
3 years ago
implementation project ('libbuild:J7Zip-modified') // support library in libbuild
Prepare to use Gradle dependencies while mimic current config with jars/dependencies in lib directory (w/o overwriting existing jars)
3 years ago
Fix naming mismatch of build.xml and jar in ./lib version part differs (dot) build.xml snippet <pathelement location="${lib}/bcmail-jdk15on-1.69.jar" /> <pathelement location="${lib}/bcpkix-jdk15on-1.69.jar" /> <pathelement location="${lib}/bcprov-jdk15on-1.69.jar" />
3 years ago
implementation 'org.apache.james:apache-mime4j:0.6'
implementation 'org.apache.calcite.avatica:avatica-core:1.13.0'
implementation 'org.bouncycastle:bcmail-jdk15on:1.69'
Set all dependencies in Gradle build script - with currently used version - updated support/subproject J7Zip-modified (in libbuild) to be compilable via Gradle - added dependency reference as sub-project - skip the before applied copy of jars to lib directory (no benefit)
3 years ago
implementation 'org.bouncycastle:bcpkix-jdk15on:1.69'
implementation 'org.bouncycastle:bcprov-jdk15on:1.69'
implementation 'org.bouncycastle:bcutil-jdk15on:1.69'
implementation 'org.apache.calcite:calcite-core:1.18.0'
implementation 'org.apache.calcite:calcite-linq4j:1.18.0'
implementation 'net.sourceforge.jchardet:jchardet:1.0'
implementation 'com.twelvemonkeys.common:common-image:3.3.2'
implementation 'com.twelvemonkeys.common:common-io:3.3.2'
implementation 'com.twelvemonkeys.common:common-lang:3.3.2'
Fix naming mismatch of build.xml and jar in ./lib version part differs (dot) build.xml snippet <pathelement location="${lib}/bcmail-jdk15on-1.69.jar" /> <pathelement location="${lib}/bcpkix-jdk15on-1.69.jar" /> <pathelement location="${lib}/bcprov-jdk15on-1.69.jar" />
3 years ago
implementation 'commons-codec:commons-codec:1.14'
Set all dependencies in Gradle build script - with currently used version - updated support/subproject J7Zip-modified (in libbuild) to be compilable via Gradle - added dependency reference as sub-project - skip the before applied copy of jars to lib directory (no benefit)
3 years ago
implementation 'org.apache.commons:commons-collections4:4.4'
implementation 'org.apache.commons:commons-compress:1.21'
implementation 'commons-fileupload:commons-fileupload:1.4'
implementation 'commons-io:commons-io:2.7'
implementation 'commons-lang:commons-lang:2.6'
implementation 'org.apache.commons:commons-lang3:3.12.0'
implementation 'commons-logging:commons-logging:1.2'
implementation 'org.apache.commons:commons-math3:3.4.1'
implementation 'org.apache.pdfbox:fontbox:2.0.15'
implementation 'com.google.guava:guava:25.1-jre'
implementation 'com.hazelcast:hazelcast:4.2'
implementation 'org.eclipse.jetty.http2:http2-client:9.4.34.v20201102'
implementation 'org.eclipse.jetty.http2:http2-common:9.4.34.v20201102'
implementation 'org.eclipse.jetty.http2:http2-http-client-transport:9.4.34.v20201102'
implementation 'org.apache.httpcomponents:httpclient:4.5.12'
implementation 'org.apache.httpcomponents:httpcore:4.4.13'
implementation 'org.apache.httpcomponents:httpmime:4.5.12'
Prepare to use Gradle dependencies while mimic current config with jars/dependencies in lib directory (w/o overwriting existing jars)
3 years ago
implementation 'com.ibm.icu:icu4j:63.1'
Set all dependencies in Gradle build script - with currently used version - updated support/subproject J7Zip-modified (in libbuild) to be compilable via Gradle - added dependency reference as sub-project - skip the before applied copy of jars to lib directory (no benefit)
3 years ago
implementation 'com.twelvemonkeys.imageio:imageio-bmp:3.3.2'
implementation 'com.twelvemonkeys.imageio:imageio-core:3.3.2'
implementation 'com.twelvemonkeys.imageio:imageio-metadata:3.3.2'
implementation 'com.twelvemonkeys.imageio:imageio-tiff:3.3.2'
implementation 'com.fasterxml.jackson.core:jackson-annotations:2.11.2'
implementation 'com.fasterxml.jackson.core:jackson-core:2.11.2'
implementation 'com.fasterxml.jackson.core:jackson-databind:2.11.2'
implementation 'oro:oro:2.0.8'
implementation 'net.jthink:jaudiotagger:2.2.5'
implementation 'jcifs:jcifs:1.3.17'
implementation 'org.slf4j:jcl-over-slf4j:1.7.25'
implementation 'javax.servlet:javax.servlet-api:3.1.0'
implementation 'org.eclipse.jetty:jetty-client:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-continuation:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-deploy:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-http:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-io:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-jmx:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-proxy:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-security:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-server:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-servlet:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-servlets:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-util:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-webapp:9.4.35.v20201120'
implementation 'org.eclipse.jetty:jetty-xml:9.4.35.v20201120'
implementation 'com.jcraft:jsch:0.1.54'
implementation 'com.googlecode.json-simple:json-simple:1.1.1'
implementation 'net.arnx:jsonic:1.3.10'
implementation 'org.jsoup:jsoup:1.14.2'
implementation 'org.jwat:jwat-archive-common:1.1.1'
implementation 'org.jwat:jwat-common:1.1.1'
implementation 'org.jwat:jwat-gzip:1.1.1'
implementation 'org.jwat:jwat-warc:1.1.1'
implementation 'com.cybozu.labs:langdetect:1.1-20120112'
implementation 'org.slf4j:log4j-over-slf4j:1.7.32'
implementation 'org.slf4j:jcl-over-slf4j:1.7.25'
implementation 'com.drewnoakes:metadata-extractor:2.11.0'
implementation 'io.dropwizard.metrics:metrics-core:3.2.2'
implementation 'io.dropwizard.metrics:metrics-jmx:4.1.5'
implementation 'io.opentracing:opentracing-api:0.33.0'
implementation 'io.opentracing:opentracing-noop:0.33.0'
implementation 'io.opentracing:opentracing-util:0.33.0'
implementation 'org.apache.pdfbox:pdfbox:2.0.15'
implementation 'org.apache.poi:poi:3.17'
implementation 'org.apache.poi:poi-scratchpad:3.17'
implementation 'org.rrd4j:rrd4j:3.2'
implementation 'org.slf4j:slf4j-api:1.7.32'
implementation 'org.slf4j:slf4j-jdk14:1.7.32'
implementation 'org.apache.solr:solr-core:8.8.1'
implementation 'org.apache.solr:solr-solrj:8.8.1'
implementation 'org.locationtech.spatial4j:spatial4j:0.6'
implementation 'org.codehaus.woodstox:stax2-api:3.1.4'
implementation 'org.bitlet:weupnp:0.1.4'
implementation 'org.codehaus.woodstox:woodstox-core-asl:4.4.1'
implementation 'xml-apis:xml-apis:1.4.01'
implementation 'com.adobe.xmp:xmpcore:5.1.3'
implementation 'org.tukaani:xz:1.8'
implementation 'org.apache.zookeeper:zookeeper:3.4.14'
Enable Gradle test and add manifest to yacycore.jar, set outputdir to lib as part of migration from Ant to Gradle builds.
3 years ago
testImplementation('junit:junit:4.13.2')
attempt to make a Mac Release using gradle This is almost working with many workarounds: - run rm lib/yacycore.jar - run ./gradlew clean build bundleNative - run ant clean all - run again rm lib/yacycore.jar - run ./fixMacBuild.sh The build is then inside build/mac/YaCy.app Right now this works so far but it does not have the correct release number inside. Target is to make this working for Windows releases and to embedd jre entirely.
3 years ago
}
Enable Gradle test and add manifest to yacycore.jar, set outputdir to lib as part of migration from Ant to Gradle builds.
3 years ago
Set all dependencies in Gradle build script - with currently used version - updated support/subproject J7Zip-modified (in libbuild) to be compilable via Gradle - added dependency reference as sub-project - skip the before applied copy of jars to lib directory (no benefit)
3 years ago
// exclude some unused/not needed automatic dependency imports
configurations.implementation {
exclude group: 'com.google.code.findbugs', module: 'jsr305'
exclude group: 'org.eclipse.jetty', module: 'jetty-alpn-client'
exclude group: 'org.eclipse.jetty', module: 'jetty-alpn-java-client'
exclude group: 'org.eclipse.jetty', module: 'jetty-alpn-java-server'
exclude group: 'org.eclipse.jetty', module: 'jetty-alpn-server'
}
Enable Gradle test and add manifest to yacycore.jar, set outputdir to lib as part of migration from Ant to Gradle builds.
3 years ago
// output to lib/yacycore.jar (like with ant with downside by determine class-path)
jar {
archiveFileName = 'yacycore.jar'
destinationDirectory = new File('lib')
manifest {
attributes(
Prepare to use Gradle dependencies while mimic current config with jars/dependencies in lib directory (w/o overwriting existing jars)
3 years ago
"Main-Class": mainClassName ,
Set all dependencies in Gradle build script - with currently used version - updated support/subproject J7Zip-modified (in libbuild) to be compilable via Gradle - added dependency reference as sub-project - skip the before applied copy of jars to lib directory (no benefit)
3 years ago
"Class-Path": configurations.runtimeClasspath.collect { it.name }.join(' ')
Enable Gradle test and add manifest to yacycore.jar, set outputdir to lib as part of migration from Ant to Gradle builds.
3 years ago
)
}
Prepare to use Gradle dependencies while mimic current config with jars/dependencies in lib directory (w/o overwriting existing jars)
3 years ago
}
shadowJar.zip64 = true // saw build error: Execution failed for task ':shadowJar'. shadow.org.apache.tools.zip.Zip64RequiredException: archive contains more than 65535 entries.
// mimic current config with dependencies in lib directory
// @TODO: maybe removed after complete Gradle migration
Set all dependencies in Gradle build script - with currently used version - updated support/subproject J7Zip-modified (in libbuild) to be compilable via Gradle - added dependency reference as sub-project - skip the before applied copy of jars to lib directory (no benefit)
3 years ago
/**
Prepare to use Gradle dependencies while mimic current config with jars/dependencies in lib directory (w/o overwriting existing jars)
3 years ago
task copyDependenciesToLib(type: Copy) {
def destination = project.file("lib")
into destination
from configurations.compileClasspath
eachFile { // prevent overwriting existing files
if (it.getRelativePath().getFile(destination).exists()) {
it.exclude()
}
}
build.dependsOn(copyDependenciesToLib)
}
Set all dependencies in Gradle build script - with currently used version - updated support/subproject J7Zip-modified (in libbuild) to be compilable via Gradle - added dependency reference as sub-project - skip the before applied copy of jars to lib directory (no benefit)
3 years ago
*/
Modified GitRevNr Ant-Plugin to work in Gradle - new support library GitComInf to generate a property file for use in Gradle - adjusted build.gradle to make use of it to create the yacyBuildProperties.java - including additon of properties ext.filterTokens as store for Gradle - added gradle-compile-htroot (w/o depends) to old build.xml as target until complete migration as it is imho important imho: much to complicated to get a running number - should be supplied by repo or simplified
3 years ago
// runs the support tool which creates gitbuildnumber.properties from info of local git repository
task runGitComInf(type: JavaExec) {
classpath = files('libbuild/GitComInf-all.jar')
args = [project.projectDir.getPath(), project.projectDir.getPath() + "/build/tmp/gitbuildnumber.properties"]
mainClass = 'GitComInf'
}
// prepare yacyBuildProperties.java from template (needed after commits or new versions)
// read values from property file generated by GitComInf tool
import org.apache.tools.ant.filters.ReplaceTokens
task prepYaCyProperties (type: Copy) {
mustRunAfter runGitComInf
def propfile = "build/tmp/gitbuildnumber.properties";
if (project.file(propfile).exists()) { // must check otherwise any action may stop after clean on this error
file("build/tmp/gitbuildnumber.properties").withReader {
Properties props = new Properties()
props.load(it)
project.ext.filterTokens.putAll(props)
}
} else
logger.error("prepYaCyProperties: file " + propfile + " is missing, you should re-run runGitComInf")
String fdirname = sourceSets.main.java.srcDirs[0].name + '/net/yacy/peers/operation'
copy {
from fdirname
include('yacyBuildProperties.java.template')
rename 'yacyBuildProperties.java.template', 'yacyBuildProperties.java'
into (fdirname)
filter(org.apache.tools.ant.filters.ReplaceTokens, tokens: project.ext.filterTokens)
filter(ReplaceTokens, tokens: [REPL_VERSION: version, REPL_PKGMANAGER:"false", REPL_RESTARTCMD: "/etc/init.d/yacy restart"]) // gradle.project.version + some defaults from ant
}
}
prepYaCyProperties.dependsOn(runGitComInf)
compileJava.dependsOn(prepYaCyProperties) // must be executed before compile
Import Ant build.xml into Gradle and use old compile of servlets in Gradle to be able to use/reuse Ant targets where task has not been implemented in Gradle build. - use the import to include the compile of htroot as first important task ! it is possible that first build fails an compile of GitRevTask.jar ! ! solution/workaround -> use "ant all" once to compile GitRevTask.jar ! - adjusted build.xml a little - split compile-core into compile-core and compile-htroot to have a target for htroot comp. only - set build-path to reuse Gradles build directory - (fix javadoc failure) - changed the filtered-copy of yacyBuildProperties.java to ! the build path :-( as current (copy,delete,exclude) is complicated and not migration worthy, used simple/straigt forward approach (using a yacyBuildProperties.java.template file as copy source)
3 years ago
Implement the Ant javac task to compile htroot direct in Gradle - import of the build.xml not longer needed and removed
3 years ago
// implement ant task to simulate old Ant build for htroot,
// to avoid import of complete build.xml (as currently used)
task compileHtrootServlets {
Import Ant build.xml into Gradle and use old compile of servlets in Gradle to be able to use/reuse Ant targets where task has not been implemented in Gradle build. - use the import to include the compile of htroot as first important task ! it is possible that first build fails an compile of GitRevTask.jar ! ! solution/workaround -> use "ant all" once to compile GitRevTask.jar ! - adjusted build.xml a little - split compile-core into compile-core and compile-htroot to have a target for htroot comp. only - set build-path to reuse Gradles build directory - (fix javadoc failure) - changed the filtered-copy of yacyBuildProperties.java to ! the build path :-( as current (copy,delete,exclude) is complicated and not migration worthy, used simple/straigt forward approach (using a yacyBuildProperties.java.template file as copy source)
3 years ago
Implement the Ant javac task to compile htroot direct in Gradle - import of the build.xml not longer needed and removed
3 years ago
ant {
path(id:'project.class.path') {
// place yacycore.jar on classpath (not automatically done)
pathelement (location: jar.archiveFile.get())
// construct path elements
configurations.compileClasspath.each { pathelement (location: it) }
}
javac (srcdir:'htroot', excludes:'processing/**',
source:'1.8', target:'1.8',
debug:"true", debuglevel:"lines,vars,source", includeantruntime:"false", encoding:"UTF-8") {
classpath (refid:'project.class.path')
}
}
}
startScripts.dependsOn(compileHtrootServlets)
Modified GitRevNr Ant-Plugin to work in Gradle - new support library GitComInf to generate a property file for use in Gradle - adjusted build.gradle to make use of it to create the yacyBuildProperties.java - including additon of properties ext.filterTokens as store for Gradle - added gradle-compile-htroot (w/o depends) to old build.xml as target until complete migration as it is imho important imho: much to complicated to get a running number - should be supplied by repo or simplified
3 years ago