8fa542a8e1
upd to Jetty 9.2.7
10 years ago
287c528f46
replaced old JavaApplicationStub for Mac Application framework with new
...
script. Adopted the YaCyApp environment and fixed a problem in the
startYACY.sh application wrapper which caused wrong usage of logging
option -l which caused that files had been written to the YaCy
application folder.
As a result of this fix, it is not necessary any more to change path
settings in Info.plist if libraries are changed.
10 years ago
5594c43d2e
bump to Solr-/Lucene-4.10.3
10 years ago
17808898c6
update to SLF4J 1.7.9
10 years ago
5332c9df21
update to commons-fileupload-1.3.1.jar
...
(includes a security fix)
10 years ago
fe5d4e6c7b
update to Jetty 9.2.6
10 years ago
eca578a5fa
update to PDFBox 1.8.8
10 years ago
0f7d4c42e9
include xmpcore.jar in classpath
...
used by metadata-extractor
10 years ago
9edc7308aa
update to metadata-extractor-2.7.0.jar
...
add 2 simple JUnit test cases for jpeg and tif parsing
10 years ago
413eeefed4
added character set detection library from
...
http://www-archive.mozilla.org/projects/intl/chardet.html
10 years ago
8055ed5b2a
update to commons-logging-1.2
10 years ago
aa7122f079
update to guava.18.0.jar and jsch.0.1.51.jar
10 years ago
4c14a8b44d
update to poi-3.10.1.jar
10 years ago
ef5c5b4489
update to Jetty 9.2.4
10 years ago
bad5dd7836
update to httpclient-4.3.6
10 years ago
725b206fb4
update to solr-/lucene-4.10.2
10 years ago
4a35570c90
bump to httpcore-4.3.3
10 years ago
0773c73a19
upd to jsoup-1.8.1.jar
10 years ago
cd0a16cf2e
update to PDFBox 1.8.7
10 years ago
0ecbf32134
update to Jetty 9.2.3
10 years ago
aa3e5f2046
bump to httpclient-4.3.5
10 years ago
516c8c02b1
update to commons-compress-1.8.1
...
(bugfix release)
10 years ago
8d1b764458
update to Jetty 9.2.2
10 years ago
3dcfc717eb
This hopefully fixes http://mantis.tokeek.de/view.php?id=424
10 years ago
477be17c51
Replaced old UPNP library with Weupnp. UPNP should
...
work now, at least it does on my network. UPNP code in YaCy can still
be improved though (see TODO comment: make port on gateway configurable
or find free one).
*) removed old code
*) added new lib
*) changed code to work with new lib
10 years ago
b4b937a046
update to pdfbox 1.8.6
10 years ago
e94efd4d7c
update to JUnit 4.11
...
- fix build.xml -> parserTest error on Windows due to javac encoding
11 years ago
09dcdb9b19
update to solr 4.9.0
11 years ago
282b53db42
update of commons-io and slf4j-api (as preparation for Solr 4.9.0)
11 years ago
66c784c552
bump to httpclient-4.3.4
11 years ago
b9f6acee23
update to Jetty 9.2.1
11 years ago
b803622ac3
changed javadoc publishing path from 'api' to 'javadoc' because there
...
are also other APIs in in YaCy.
11 years ago
ee7416816b
upgraded poi library (office document format parser) from 3.9 to 3.10
11 years ago
a12701ddf6
upgraded bouncy caste libraries (needed for encrypted pdfs, dependency
...
in pdfbox) to 1.46
removed the activation.jar library; I don't know which other library
depends on it.
11 years ago
2520590b45
migrated from pdfbox 1.8.4 to 1.8.5. They have a very long bugfix list
...
for that update:
http://www.apache.org/dist/pdfbox/1.8.5/RELEASE-NOTES.txt
11 years ago
d4157184ec
migration to Solr 4.8.1
...
This includes also an update to zookeeper 3.4.6 and a new library that
Solr initializes by default: org.restlet from
http://restlet.com/download/current#release=stable&edition=jse&distribution=zip
which is included in version 2.2.1 from may 6th 2014
11 years ago
e9060d31bd
update to Jetty 9
...
besides adjustments in code it makes the servlet settings in web.xml significant.
This applies to solr, gsa and proxy servlet. There is no longer a default setup in code during init (as jetty 9 checks for double definition).
11 years ago
ebd44a7080
replaced solr 4.6.1 with solr 4.7.1 and added index migration to
...
lucene_47
11 years ago
1a6e0354db
update commons-compress.jar to 1.8
11 years ago
9afd7db043
bump to httpclient-4.3.3
11 years ago
7eab0a2cb8
replaced guava-15.0 with guava-16.0.1
11 years ago
cb4fd27bbe
replaced pdfbox 1.8.3 with 1.8.4
11 years ago
4fcddcf13b
replaced solr 4.6.0. with 4.6.1
11 years ago
9f921c27f3
removed libraries which had been used by jena and were added together
...
with jena in commit 5d20cd324a5d20cd324a
11 years ago
6e59ca4ebf
removed jena library and all code that depended on jena. When jena was
...
introduced, it was also used for search facets. The generic search
facets are now deduced from generic solr fields which makes jena as tool
for facet semantics superfluous.
11 years ago
0512e46c6a
bump to httpclient-4.3.2
11 years ago
84cf7e8e9f
backmigration from solrj 4.6.0 to 4.5.1. This is necessary because
...
solrj.4.6.0 has a bug which prevents the attachment of a remote solr (as
tested with a SolrCloud). See bug report
https://issues.apache.org/jira/browse/SOLR-5532
This bug shall be fixed in Solr 4.6.1.
Fortunately, solrj-4.5.1 works together with solr-4.6.0 thus the current
index does not need to be changed.
11 years ago
37f2a82a5d
making root context (htroot) a WebAppContext
...
- this allows additional features, like servlet configuration via web.xml and many more things.
- currently the standard servlets are still configured in the code (so the supplied defaults/web.xml is not realy needed, yet),
but could be expanded
- lookup for web.xml - 1. in /DATA/SETTINGS then in /defaults
11 years ago
1b6d173b14
update to Jetty 8.1.14
11 years ago
e03c9306e8
include install/uninstallYaCyWindowsService.bat
...
as wrappers to copy
11 years ago
2507722fbb
updated poi-3.9 / poi-scratchpad-3.9
11 years ago
122d026910
alphabetic order fix
11 years ago
7603e879dc
Merge branch 'master' into HEAD
...
Conflicts:
.classpath
source/net/yacy/cora/federate/solr/SolrServlet.java
11 years ago
8b97489ff2
updated guava to 15.0
11 years ago
34b4eda4a8
upgraded json-simple to 1.1.1
11 years ago
75ae36da9c
upgraded jsch to 0.1.50
11 years ago
db793a2a5e
removed mysql connector which was used only for testing in the past
11 years ago
7ebc74b76a
migrated to pdfbox 1.8.3
11 years ago
2f16770681
migrated to solr 4.6.0
11 years ago
06da6f517c
add YaCyProxyServlet to handle /proxy.html?url=proxyurl
...
- based on Jetty ProxyServlet
- at this time use existing HTTPD ProxyHandler for url rewrite
- add jetty-client jar (dependency in Jetty ProxyServlet)
reuse ProxyHandler.convertHeaderFromJetty in YaCyDefaultServlet
11 years ago
1adb4b8741
merge rc1/master
11 years ago
dfb73c9519
bump to httpclient-4.3.1 - a bugfix release
11 years ago
cf32a92629
- add size check to multipart form data handling of YaCyDefaultServlet (same as in HTTPDemon.parseMultipart)
...
- reduce Jetty logging
- give build.run a bit more memory (set to YaCy.default 600m from 512m)
11 years ago
a44eede8b8
merge rc1/master
11 years ago
71d2655c02
downgrade to Jetty 8 to assure support of JRE 1.6
...
- introduce a YaCyHttp interface to modulize/separate http server
- adjust the Jetty version specific implementation part (in package net.yacy.http)
- putting the version specific code in classes starting with Jetty8xxxx
- moved existing Jetty9xxx implementation into a test class (to keep the code)
- adjust build to the changed jars
- make use of the introduced YaCyHttpServer interface in related htroot servlets
- adjust other test cases/classes
11 years ago
21aa6a0321
migration to Solr 4.5.0
11 years ago
f46771bdf5
upd build script from rc1/master
11 years ago
15b1bb2513
bump to httpClient-4.3
11 years ago
f7f86d8a5d
update to Jetty 9 jars
...
- include javax.servlet 3.0
11 years ago
aafef72a8a
merged current rc1/master into jetty branch to allow further development with latest version
...
ServerSideIncludes and servlet return values need further work (for working jetty integration)
- TODO: added nasty quickfix to allow SSI - needs further work
- TODO: YaCy servlet return values/parameters are not handled
11 years ago
5189620026
add branch to packet-name if not build from master
11 years ago
5b7c0d0745
update to pdfbox 1.8.2
11 years ago
f13df9dbb6
migration to solr 4.4.0
11 years ago
3760e2616b
bump up lib/metadata-extractor-2.6.2.jar (used for image parser) with needed code adjustments
12 years ago
5f92c68f1f
removed block rank ranking and all YBR files in /ranking
12 years ago
9bd2aee180
migrated to solr 4.3.0
12 years ago
ad050ec88d
- upgraded httpclient, httpcore and httpmime
...
- removed httpclient 3.1 which has been used by solrj < 4.x.x and is now
not used any more
- fixed some parts in YaCy which used methods from httpclient 3.1
12 years ago
48e9a54e80
updated pdf parser
12 years ago
27907c9739
added missing library after solr upgrade
12 years ago
cf0acd2cb4
upgrade to solr 4.2.1
12 years ago
461d46101d
- Removed log4j from libraries. This can be removed because the package
...
log4j-over-slf4j is there. From slf4j all loggings are routed to the jdk
logger. Now all loggings are consistently done to the jdk logger.
- added some lines to the logging properties to suppress many solr
logging statements. The number of the logging entries had already become
a performance issue, therefore removing these from the log should
increase performance.
12 years ago
36f9b0fc16
updated wstx-asl to 3.2.9
12 years ago
1951ba61ae
remove CPGEN from Windows batch files
...
(classpath for all needed libraries is defined in manifest of yacycore.jar)
12 years ago
09a2b09c48
guava update
12 years ago
80fe3d7860
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
...
Conflicts:
source/net/yacy/cora/federate/solr/connector/EmbeddedSolrConnector.java
12 years ago
4323621a76
update to Solr 4.1.0
12 years ago
160ce568b3
move testing SolrServlet.main to test, making include of jetty*.jar in distribution and classpath obsolete
...
- move jetty*.jar to test library
- move SolrServlet.main as is to test, add also a junit test simulating main
- add build.xml cleanup for EmbeddedSolrConnectorTest created test/DATA
- adjust some test compile errors
12 years ago
be5d3a1066
adding classpath to Manfiest of yacycore.jar
...
- this allows to start w/o giving explicite java -cp (just java -jar lib/yacycore.jar works)
- especially helpful while running YaCy as Win service,
making it obsolete to adjust classpath cfg of the service wrapper on upgrades of lib/*.jar's
12 years ago
f3e705c4fe
bump to httpclient / httpcore 4.2.3 (bugfix-release)
12 years ago
9dfc9c95d8
updated slf4j and log4j
12 years ago
95712fdc8b
update to pdf parser
12 years ago
e2c4c3c7d3
migration to solr 4.0.0
12 years ago
69aa39d664
update to libraries required by solr 4.0.0
12 years ago
9d062873d2
bump to httpclient-4.2.2
12 years ago
5cb244b79b
Merge remote branch 'origin/master'
12 years ago
88b062210c
Added a parser for audio file tags (e.g. ID3 tags for MP3 files) based
...
on the jaudiotagger library. The parser is disabled by default as it
needs to store temporary files for non file:// protocols, which might be
disliked. For your local MP3-collection it loads nicely Artist,
Title, Album etc. from the audio files meta data.
12 years ago
9aa21506be
bump to httpcore-4.2.2 (maintenance release)
12 years ago
d0015df61c
added lucene memory library which is now necessary as solr has to
...
process more complex queries
12 years ago
80edd8ecd7
some more after-refactoring fixes
12 years ago
bc865ab816
more cleaning (yacy-cora)
12 years ago
e65cecc419
- updated lucene libraries to 3.6.1
...
- added lucene-grouping which enables faceted search; try this:
http://localhost:8090/solr/select?q=*:*&start=0&rows=3&facet=true&facet.field=host_s
12 years ago
2ccf1dba71
upgrade to solr 3.6.1
12 years ago
e74d66e28c
augmented browsing: remove htmlparser library
12 years ago
e2119f4e76
augmented browsing: replace htmlparser by jsoup, which is more stable
...
and reliable
12 years ago
a99ef68422
bump to httpclient-4.2.1
13 years ago
65f56b1fd4
Merge branch 'master' of ssh://gitorious.org/yacy/rc1 into jetty
...
Conflicts:
.classpath
build.xml
htroot/Status.java
source/de/anomic/http/server/HTTPDProxyHandler.java
source/net/yacy/yacy.java
13 years ago
7b53be141f
upgraded to pdfbox 1.7.0
...
changes in http://www.apache.org/dist/pdfbox/1.7.0/RELEASE-NOTES.txt
with many bugfixes, including performance related
13 years ago
fad3b14813
added jetty libraries, needed for future use as web server and as
...
application server for the solr search interface
13 years ago
b9d42fd9c8
using com.google.common.io.Files instead of homebrew methods
13 years ago
1be0025a9c
- added test for EmbeddedSolrConnector
...
- added needed libraries for this test
this includes most (all) files needed for an embedded solr
13 years ago
dbdd697f4d
moved RDFaParser.xsl configuration file to defaults
13 years ago
e12bb254b4
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
3f55dc7c1e
- added solr core and libraries that solr needs (lucene is missing, will
...
follow later)
- added embedded solr connector which can connect to solr
programmatically (without using a server in between)
13 years ago
786be7d175
better integration of RDFaParser
13 years ago
5d20cd324a
Add Triplestore and RDF query interface
...
Conflicts:
build.xml
defaults/yacy.init
source/net/yacy/interaction/AugmentHtmlStream.java
13 years ago
b21048892b
augmentedParser add features and integrate external html parser to
...
modify existing web pages
Conflicts:
addon/YaCy.app/Contents/Info.plist
build.xml
13 years ago
56087c1f23
bump to httpclient- httpcore-, httpmime- 4.2
13 years ago
7acd7e88b3
added all shell scripts in /bin to add also latest passwd.sh file
13 years ago
4d3cc02168
replaced old bzip2 library against better documented commons-compress
...
package from http://commons.apache.org/compress/
13 years ago
ca7de1dbd0
moved files to defaults
13 years ago
6c4f8fdc44
removed superfluous files
13 years ago
62f2554a01
- fixed build problems (deprecated methods using httpclient 3.1)
...
- removed httpclient 3.1 lib which was used by solrj (solrj now uses
httpclient 4)
13 years ago
f838997126
updated commons io from 2.0.1 to 2.1
13 years ago
eeb57ae824
updated http client libraries
13 years ago
ffb72249ea
added missing apicat.sh
13 years ago
a30b028cc0
updated libraries
13 years ago
a231d0eeb9
Run from Java the whole app YACY
...
start for java webStart
allow for better integration with IDE
Conflicts:
source/net/yacy/gui/framework/Browser.java
13 years ago
e1434635d4
changed required setting for package signing
13 years ago
d171a2fa3e
fixed ant build for deb target: no more svn numbers
13 years ago
d14ee8e464
Revision 9000+ hack
...
do not handle the revision in build.properties anymore
(9000 as fallback)
build-date from git-HEAD (instead when build is fired)
(orginal build-date as fallback)
13 years ago
7afcdcd573
release 1.01 - now with virtual svn number 9000
13 years ago
b79da58eac
Ant-Task for getting version from git
...
tries to find svn-version or any tag - what ever comes first
be careful using this with non-numerical tags!
13 years ago
69570fda24
bring my master to stuff from remote
13 years ago
d9c56aa37a
Ant-Task for getting version from git
13 years ago
9f8240b350
script for clean copy of URL-tables
13 years ago
9067ab20b2
- included missing image for portalsearch.tar.gz in build.xml
...
- compressed (minify) yacy-portalsearch.js for better performance
- removed language selector, as it doesn't work really well (at least for me)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8026 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
a425fbd8d6
- created new target 'portalsearch' in build.xml to generate yacy-portalsearch.tar.gz for static hosting
...
- some refactoring for search widget and jquery
- update for ConfigLiveSearch.html to refelct latest changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8023 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
3f606407bc
added new scripts to bin in build
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7991 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
d2ea250d99
refactoring:
...
- moved many classes from de.anomic to net.yacy
- made more sub-packages for search classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7973 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
65ab067491
migration to solrj 3.4.0
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7952 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
dc25c48fc9
added more libraries that are needed by solrj
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7922 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
52b477cf6f
bump to httpclient-4.1.2, httpcore-4.1.3 - bugfixrelease
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7876 6c8d7289-2bf4-0310-a012-ef5d649a1542
13 years ago
48560a44a9
bump to httpcore-4.1.2: a bugfixrelease
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7853 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
d3c89b90ce
temporary adding the old httpclient-3.1 again because the solrj classes need them. should be removed as soon solrj supports httpclient-4
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7831 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
768c59740c
- replaced solrj 3.1 with solrj 3.3
...
- updated also slf4j
- added authentication for solrj
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7829 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
528b59e078
replaced xerces.jar library that was originally added 2005 with SVN 126 to the libx directory and that was moved to lib in SVN 5781
...
the new replacement is taken from http://xerces.apache.org and has the version 2.11.0 and was inside the file Xerces-J-bin.2.11.0.tar.gz
and consists of two files named xercesImpl.jar and xml-apis.jar
The original purpose of that library was to support:
- content parsers
- optional seed uploader
- SOAP API (which will be committed later)
Since the SOAP API does not exist any more the purpose is to support content parser and an optional seed uploader
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7819 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
e7e1a0f328
replaced commons-io v1.4 with v2.0.1
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7818 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
5092a14bcb
replaced fontbox, jempbox, pdfbox v 1.5 with v1.6
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7817 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
ccad615f58
The Java-XMS and Xmx values for the target of "run" (run YaCy) inserted.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7777 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
77fe69395d
added jempbox-1.5.0.jar which is required by pdfbox-1.5 as stated in http://pdfbox.apache.org/dependencies.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7774 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
efcd21e0ed
new httpclient, httcore (bugfixrelease)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7769 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
761b1c71dc
added latest pdfbox
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7761 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
3b578a28ef
some patches to prevent that empty or bad IP information is broadcasted
...
- on client-side: fix bad IP reports from remote Peers by replacing their reported IP with their server IP if the reported IP is bad, broken or disallowed
- on server-side: the same during a peer ping (here the ping'ed server acts also as client during the back-ping) and also when receiving a message or a search where the client sends also its seed. Here the IP is replaced by the client IP if the reported IP is broken or bad
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7687 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
c493f101c0
added one more script file to release build script
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7681 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
f6077b3cc0
added more attributes for html parser and enhanced data structures
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7679 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
a0e4960a4d
YMark:
...
- first attempt for a firefox json bookmark importer
- added JSON library json-simple-1.1.jar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7658 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
19fd13d3bc
Added federated index storage to solr.
...
YaCy supports now the storage to remote solr indexes.
More federated storage (and search) methods may follow.
The remote index scheme is the same as produced by the SolrCell; see
http://wiki.apache.org/solr/ExtractingRequestHandler
Because this default scheme is used, the default example scheme can be used as solr configuration
This is also the same scheme that solr uses if documents are imported with apache tika.
federated solr storage is switched off by default.
To use this, do the following:
- set federated.service.solr.indexing.enabled = true
- download solr from http://www.apache.org/dyn/closer.cgi/lucene/solr/
- extract the solr (3.1) package, 'cd example' and start solr with 'java -jar start.jar'
- start yacy and then start a crawler. The crawler will fill both, YaCy and solr indexes.
- to check whats in solr after indexing, open http://localhost:8983/solr/admin/
Until now it is not possible to use the solr index to search with YaCy in that solr index.
This functionality is now available for two reasons:
1) to compare the functionality of Solr and YaCy and to compare the search speed
2) to use YaCy as a search appliance for people who need a crawler or other source harvesting methods
that YaCy provides (like dublin core reading, wikimedia dump reading, rss feed reader etc) if people still
want to use solr instead of YaCy.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7654 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
4c013d9088
more UTF8 getBytes() performance hacks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7649 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
399d7d6878
* fix permissions of bin/-folder in debian package
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7647 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
21fe5e6c6a
* add bin-folder to debian package
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7638 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
351d264a48
* yacy domain handler for jetty
...
* rewrite from / to /index.html
14 years ago
18ec7fe53c
added a clearall.sh script that deletes the complete index and everything else that belongs to crawling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7611 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
d98884f1d5
added script for importmediawiki.sh in build.xml
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7610 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
68ca0fbb2e
* add copyright info
...
* implement basic authentication
* update jetty to 7.3.0
14 years ago
9956dc9dce
Update jcifs-library to Version 1.3.15. Small Changes, read: http://jcifs.samba.org/ - "Minor adjustments have been applied to DcerpcHandle locking routines in the SID class to fix sporadic occurances of "All pipe instances are busy" errors under high load."
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7587 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
2d2df64870
* jetty works for many pages now
14 years ago
1989ba64c0
* jetty
14 years ago
45dcfa3460
update to httpclient-4.1
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7473 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
d38c739b31
* add ant-target deleteData, to simulate fresh yacy installation
...
* useful in IDEs like eclipse
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7472 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
19711ff6d6
added target that compiles only the cora package
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7423 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
2db6ca8104
- do not allow user to disable java installation
...
- java version update
- build cleanup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7284 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
fc3ee9d8a1
changed paths for new libs also in Info.plist
...
when changing paths in build.xml, please also update the paths in /addon/YaCy.app/Contents/Info.plist
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7198 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
f4357dff03
bump to httpclient-4.0.3 which fixes a number of bugs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7197 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
e670e1ef8e
add charset auto-detection for htmlParser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7186 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
3552476fbe
terminated migration from apache httpclient-3.1 to 4.1:
...
- remove the library
- added two classes from the httpclient-3.1 library as source code to YaCy because these classes were used by the YaCy HTTP Server
- modified the added classes ChunkedInputStream and ContentLengthInputStream in such a way that:
* there are no more dependencies to httpclient-3.1
* these classes had been simplified to serve only the purpose for the YaCy httpd
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7171 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
f9a27a05e5
migrated to log4j 1.2.16
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7153 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
5c67e6ca49
migrated to latest apache commons fileupload 1.2.2
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7152 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
5fe828fa06
- replaced pdfbox and fontbox version 1.1.0 with 1.2.1
...
- added some clear statements that shall clear static cache size within the pdfbox library
- the pdfbox library contains a memory leak; it is unsafe to run a peer with pdf parser permanently on.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7120 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
fa5683adfe
create a mac dmg file (a disc image) for mac releases in ant
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7091 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
091281c9f2
Mac app ant task building a ready-to-distribute zip file
...
extending r7080
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7089 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
e9160ea1e5
Mac ant task according to r7023
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7080 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
189a986ebd
- modified api-call interface to record api calls with references to api-call database (carries pk)
...
- added recording date, last execution date and next execution date for a scheduler (scheduler to be implemented next)
- extended database access methods for more data formats, especially for date insert/retrieval
- extended 'Steering' interface to show new database fields
- migrated Steering to new http client
- extended cora http client to transmit authentication and also added some convenience methods (http response code)
- simplified database back-end (not so much specialized methods for multiple properties)
- extended date formatter to produce a special format to show dates in html ( in spaces of date format)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7049 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
6b13101d18
Collage.html: Fixed problem where the German translation broke the action that contained Collage in a form
...
build.xml: Fixed check for existing private.key, added check for non existing release in target sign and changed the include filenames for changed libs
Added log4j.properties file to eliminate the warning about a not initialized log4j subsystem with parameters for one console appender
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6998 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
c5c67f0504
start migrating to HttpComponents-Client-4.x
...
see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2872
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6965 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
b5e190099d
- updated pdfbox and fontbox to 1.1.0
...
- added license file to sbbi-upnplib
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6946 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
37b8827a7a
- removed the UPnP library sources from sbbi and added the jar library again. The library was included to get support for fedora releases, but after this time the fact that the sbbi cannot be part of fedora should be re-discussed. If this will still not be possible, then we may integrate the sbbi UPnP package using reflection.
...
- cleaned uo the code. The new eclipse helios provided new warnings for dead code. This change cleans up most of these warnings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6945 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
89b4fff1c2
adopted ant script for new exif library
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6746 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
1bbe14d23f
SVN 6716 unfortunately contained parts of the unfinished SMB integration. To fix compile errors the remaining parts of the SMB implementation stub is added with this commit.
...
This adds the jcifs smb library.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6717 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
6fde481ef4
missing for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6692 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
1e2c011c98
updated the jsch lib from 0.1.21 to 0.1.42
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6688 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
c2b505ae87
updated bouncy castle libraries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6687 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
681f4d185f
replaced microsoft office document parser POI 3.5 with latest version 3.6
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6686 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
e9cdddcd0f
updated parser libraries fontbox and pdfbox with latest version of jar files
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6685 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
e9ab130ad7
fixed start/stop using ant
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6472 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
9ee7862710
*) added configuration script
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6469 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
cde1611919
updated junit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6428 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
9db928ce53
replaced fontbox 0.7.3 with fontbox 0.8.0
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6414 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
0975b1b493
update for apache poi library
...
possible solves http://forum.yacy-websuche.de/viewtopic.php?p=17736#p17736
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6411 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
70bda620db
another fix for/against bad debian packages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6329 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
fbd77bd77c
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6328 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
4652b4d299
fixed debian package
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6327 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
11323bcb36
added debug flag to built to enable better debugging of yacycore.jar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6321 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
db1b030276
fixed class path in startup scripts; omitting old classes path; all classes are now in lib/yacycore.jar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6318 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
2e41e10ffd
- updates to yacyVersion parser (remove old targets)
...
- added javadoc target to built script (does not work yet without errors)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6312 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
1ddaf16466
added generation of a yacycore.jar yacy library file:
...
when a ant dist is envoked, the release is built using the new yacycore.jar without the class files in classes
YaCy consists currently of two main parts: the YaCy core and the YaCy interface. This change will make it
possible to use the YaCy core as part of other projects.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6311 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
67da20647f
* add new odf parser based on sax-xml-parser
...
* remove odf_utils-jar
* test metadata in ParserTest
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6231 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
de4f0a006f
removed superfluous windows target
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6230 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
69dfd03985
reactivate unittests
...
* fix old tests
* add buildtarget "ant test"
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6228 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
eea4c17ef2
removed rpm parser
...
- no-one used that thing
- loading huge rpm files bay be causes for crashes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6223 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
477807e0e6
* updated jxpath to latest v1.3
...
* added upnplib as source
without packages:
jmx
remote
samples
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6218 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
049fb23a8d
removed unused/unsupported ant targets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6217 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
49bbb9bd45
replaced tar library with integrated apache ant tar lib
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6212 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
3d26161dd1
removed unused libraries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6204 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
50cf80056f
removed jmimemagic library
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6203 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f814e0fa81
enable warnings and fix most of it
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6196 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
8931c8d6b4
improvments to debianpackage:
...
* autoupdate completely disabled, display hint
* restart-button in interface works!
* moved all build-Variables to yacyBuildProperties
* fixed some warnings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6195 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
0f3246e90a
* fix debian package
...
* add Class containing buildvariables
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6171 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
8544cfd5a6
* remove seperate build-files for parsers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6170 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
48d78166ed
* fix double copy of libraries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6164 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
65888a001e
workaround for missing libs in ant dist
...
now there are some files double :-(
please help!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6163 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
6fc18b9d51
removed unused ant targets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6158 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
302a02cec8
moved all libraries from libx to lib
...
removed libx directory
all libraries are now in lib, instead the test libraries in libt which are not part of releases
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6157 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
2e206e8b27
added up and down scripts (shows peers that are up or down, useful for remote administration of private yacy networks)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6131 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
69b573a8ac
- next release cycle
...
- doku update for phpBB3
- added more files for search test scripts
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6130 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
1457bfce16
added updateYACY.sh to release build
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6085 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
d793bb0d76
the mysql lib was not in releases included; moved library from libx to lib
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5987 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
44daec7936
* introduce signatures to autoupdate
...
as long as there aren't publickeys for the updatelocations set,
no signatures are checked
* wiki-article follows...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5822 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
c2d85b039e
*) added language statistics files
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5796 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
c08f9b36a4
refactoring of wiki parser.
...
This was done to prepare the wiki parser as parser for wikipedia dumps, which will be used for performance test (to omit crawling)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5785 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
4905a17f6a
moved xerces.jar from libx to lib
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5781 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
c545fcb9fa
* add class to handle keys and signatures
...
* fix bug in serverCharBuffer
* add build-target to sign tar.gz (run ant dist sign)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5665 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
4aad461100
added UPnP support
...
YaCy can now automatically forward ports on home routers
off by default
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5609 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
e8ae2599fd
* some refactoring/moves to consoleInterface
...
* added possibility to find maximum possible heap size
you can get it via getWin32MaxHeap.bat
this may cause high system load
moreover the found limit is no guarantee for stable startups since it depends on system configuration
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5583 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
01b97ef3f8
added new cybertag-tracking feature that was inspired by itgrl
...
from the forum discussion in
http://forum.yacy-websuche.de/viewtopic.php?p=12612#p12612
The feature will provide two basic entities:
- you can integrate image links which point to your yacy installation anywhere in the web.
the image can be loaded with
<img src="http://<yourpeer>:<yourport>/cytag.png?icon=invisible&nick=<yournickname_or_community_id>&tag=<anything>">
This will place a invisible 1-pixel image. If you change the icon=invisible to icon=redpill, you will see a red pill
Use this, to track your activity in the web.
- you can view your tracks at
http://localhost:8080/Tracks.html
- There is a public api to your tracks at
http://localhost:8080/api/tracks_p.json
which needs authentication
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5581 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
3367da14fa
* license usually is already on linux systems...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5492 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
0afce376d7
* forgot libbuild/ directory in dist-Target
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5486 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
cb1e887027
* move svnRevNr classes to libbuild
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5425 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
51f1a1927c
* remove saaj.jar and axis.jar and references to it (was for soap-stuff?)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5404 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
a94b3be80b
- modern ui for Windows installer
...
- installer has native system language now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5325 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
d0543a7c39
* fix the debug ant-target
...
* fix yacy-subdomain handling (http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1556 )
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5307 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
88fdd4c4f2
* remove unix wrappers from installonlinux-target, because they are useless on systemwide installations
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5255 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
ed51ccf725
* correct error message
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5253 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
214277dad6
- revert r5202
...
- cleanup
- installer checks for JRE 1.6 only
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5210 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
0a0cc3bf67
added missing classes to build target "run"
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5201 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
7d8f332bbd
* build yacy for debianpackage only once
...
* do not try to sign .changes file
* add some java arguments from ./startYACY.sh to addon/yacyInit.m4
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5053 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
c2d49cc01e
* add build target "deb" to create debian packages from svn
...
still needs testing...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5051 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
31d97f2b9f
replaced httpd.parseMultipart() by a 'right' implementation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5040 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
5627ca1c60
* rename yacy.nsi to build.nsi
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5038 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
d72846f898
* moved nsisant library in seperate libbuild-directory to keep root directory clean
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5037 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
3e26aca356
added startYACY_debug.bat to dist Target
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4998 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
reger