orbiter
5092a14bcb
replaced fontbox, jempbox, pdfbox v 1.5 with v1.6
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7817 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
77fe69395d
added jempbox-1.5.0.jar which is required by pdfbox-1.5 as stated in http://pdfbox.apache.org/dependencies.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7774 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
sixcooler
efcd21e0ed
new httpclient, httcore (bugfixrelease)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7769 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
761b1c71dc
added latest pdfbox
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7761 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
apfelmaennchen
a0e4960a4d
YMark:
...
- first attempt for a firefox json bookmark importer
- added JSON library json-simple-1.1.jar
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7658 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
e402622584
removed httpclient-3.1 (this was added with last commit which was a mistake)
...
the httpclient is required by solrj but no class from solrj is used which references to httpclient-3.1
Instead the YaCy http client library based on the apache http client 4.1 is used using a wrapper class
which is in net.yacy.cora.services.federated.solr.SolrHTTPClient
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7655 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
19fd13d3bc
Added federated index storage to solr.
...
YaCy supports now the storage to remote solr indexes.
More federated storage (and search) methods may follow.
The remote index scheme is the same as produced by the SolrCell; see
http://wiki.apache.org/solr/ExtractingRequestHandler
Because this default scheme is used, the default example scheme can be used as solr configuration
This is also the same scheme that solr uses if documents are imported with apache tika.
federated solr storage is switched off by default.
To use this, do the following:
- set federated.service.solr.indexing.enabled = true
- download solr from http://www.apache.org/dyn/closer.cgi/lucene/solr/
- extract the solr (3.1) package, 'cd example' and start solr with 'java -jar start.jar'
- start yacy and then start a crawler. The crawler will fill both, YaCy and solr indexes.
- to check whats in solr after indexing, open http://localhost:8983/solr/admin/
Until now it is not possible to use the solr index to search with YaCy in that solr index.
This functionality is now available for two reasons:
1) to compare the functionality of Solr and YaCy and to compare the search speed
2) to use YaCy as a search appliance for people who need a crawler or other source harvesting methods
that YaCy provides (like dublin core reading, wikimedia dump reading, rss feed reader etc) if people still
want to use solr instead of YaCy.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7654 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
suessthomas
9956dc9dce
Update jcifs-library to Version 1.3.15. Small Changes, read: http://jcifs.samba.org/ - "Minor adjustments have been applied to DcerpcHandle locking routines in the SID class to fix sporadic occurances of "All pipe instances are busy" errors under high load."
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7587 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
sixcooler
45dcfa3460
update to httpclient-4.1
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7473 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
sixcooler
f4357dff03
bump to httpclient-4.0.3 which fixes a number of bugs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7197 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
f1ori
e670e1ef8e
add charset auto-detection for htmlParser
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7186 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
3552476fbe
terminated migration from apache httpclient-3.1 to 4.1:
...
- remove the library
- added two classes from the httpclient-3.1 library as source code to YaCy because these classes were used by the YaCy HTTP Server
- modified the added classes ChunkedInputStream and ContentLengthInputStream in such a way that:
* there are no more dependencies to httpclient-3.1
* these classes had been simplified to serve only the purpose for the YaCy httpd
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7171 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
f9a27a05e5
migrated to log4j 1.2.16
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7153 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
5c67e6ca49
migrated to latest apache commons fileupload 1.2.2
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7152 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
848ef6937e
licenses for pdfbox
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7121 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
orbiter
5fe828fa06
- replaced pdfbox and fontbox version 1.1.0 with 1.2.1
...
- added some clear statements that shall clear static cache size within the pdfbox library
- the pdfbox library contains a memory leak; it is unsafe to run a peer with pdf parser permanently on.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7120 6c8d7289-2bf4-0310-a012-ef5d649a1542
14 years ago
lotus
965aa97993
including sbbi upnplib as source again
...
http://www.sbbi.net/site/upnp/index.html
renamed package to yacy
all options are also named "yacy" instead of "sbbi"
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6986 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
sixcooler
c5c67f0504
start migrating to HttpComponents-Client-4.x
...
see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2872
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6965 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
b5e190099d
- updated pdfbox and fontbox to 1.1.0
...
- added license file to sbbi-upnplib
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6946 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
37b8827a7a
- removed the UPnP library sources from sbbi and added the jar library again. The library was included to get support for fedora releases, but after this time the fact that the sbbi cannot be part of fedora should be re-discussed. If this will still not be possible, then we may integrate the sbbi UPnP package using reflection.
...
- cleaned uo the code. The new eclipse helios provided new warnings for dead code. This change cleans up most of these warnings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6945 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
24e5faee75
added exif parsing for jpg images
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6745 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1bbe14d23f
SVN 6716 unfortunately contained parts of the unfinished SMB integration. To fix compile errors the remaining parts of the SMB implementation stub is added with this commit.
...
This adds the jcifs smb library.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6717 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
cc074c1a36
Renamed, removed and added license information for each jar archive in external lib folder
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6704 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
f5ec7ad077
replaced four old libraries with latest version
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6702 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
475ffabfa1
Added License (Apache 1.1) information for Jakarta ORO library 2.0.7 (2.0.8 available)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6700 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
mikeworks
50169759ca
Replaced old pdfbox and fontbox LICENSE files with new ones (still Apache 2.0)
...
Testing delete and adding files
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6689 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
1e2c011c98
updated the jsch lib from 0.1.21 to 0.1.42
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6688 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
c2b505ae87
updated bouncy castle libraries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6687 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
681f4d185f
replaced microsoft office document parser POI 3.5 with latest version 3.6
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6686 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
e9cdddcd0f
updated parser libraries fontbox and pdfbox with latest version of jar files
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6685 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
9db928ce53
replaced fontbox 0.7.3 with fontbox 0.8.0
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6414 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
lotus
0975b1b493
update for apache poi library
...
possible solves http://forum.yacy-websuche.de/viewtopic.php?p=17736#p17736
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6411 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
f1ori
67da20647f
* add new odf parser based on sax-xml-parser
...
* remove odf_utils-jar
* test metadata in ParserTest
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6231 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
eea4c17ef2
removed rpm parser
...
- no-one used that thing
- loading huge rpm files bay be causes for crashes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6223 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
477807e0e6
* updated jxpath to latest v1.3
...
* added upnplib as source
without packages:
jmx
remote
samples
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6218 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
49bbb9bd45
replaced tar library with integrated apache ant tar lib
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6212 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3d26161dd1
removed unused libraries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6204 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
50cf80056f
removed jmimemagic library
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6203 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
e3c7f61145
removed unused libraries
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6202 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
low012
b118bdd994
*) Deleted obsolete license file.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6199 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
low012
f242e7d7bc
*) using Apache POI library to parse Word documents now
...
*) removed tm-extractors library (can be found at http://www.textmining.org/ if necessary again)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6193 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6fc18b9d51
removed unused ant targets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6158 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
302a02cec8
moved all libraries from libx to lib
...
removed libx directory
all libraries are now in lib, instead the test libraries in libt which are not part of releases
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6157 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d793bb0d76
the mysql lib was not in releases included; moved library from libx to lib
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5987 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
43bcd192cd
ups
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5786 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
4905a17f6a
moved xerces.jar from libx to lib
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5781 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
4aad461100
added UPnP support
...
YaCy can now automatically forward ports on home routers
off by default
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5609 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
5ce9d81955
* remove class-file from old location
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5442 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
07fc115e90
removed active profiling in kelondroRowSet
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5433 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
cb1e887027
* move svnRevNr classes to libbuild
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5425 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
214277dad6
- revert r5202
...
- cleanup
- installer checks for JRE 1.6 only
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5210 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
danielr
31d97f2b9f
replaced httpd.parseMultipart() by a 'right' implementation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5040 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lotus
f8a1e3175e
new yacyTray
...
this will make a YaCy icon in the tray area on supported platforms
enabled by default
the search page will open on double click
used JDIC 0.9.4 from https://jdic.dev.java.net/
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4992 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
74b1a60043
fixed "java.lang.NoClassDefFoundError: org/a"
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4784 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
a94f6cdca4
HTTPC: allowed self-signed certs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4659 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
4894df71ab
*) moved commons-httpclient from libx to lib (seems to work on my system, I hope one everybody else's too)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4651 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ecd7f8ba4e
- added NEAR operator (must be written in UPPERCASE in search query)
...
- more generics
- removed unused commons classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4310 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
12b8457893
removed svnRevNr jar, (checked in by mistake) this is created automatically
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3980 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
78792893c7
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=168
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3978 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
9bbd39b67c
- removed unfinished auto-updater from roland and martin
...
- added new download-option for releases on the status page
still mising:
- thomas-style restart for linux/mac
- untar/gunzip on shell basis
(comes next)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3931 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
rramthun
4c7644b713
*) Updater update to r4 with first changes toward new naming scheme. For the moment consider only pro-->pro upgrades as stable.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3915 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
rramthun
d5e634d06b
*) Updater r3 - Please test and report major problems (don't use this version for stable-release, r3 updates always to latest dev-version of YaCy)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3703 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
rramthun
d6811ac243
*) Moving tar.jar from libx to lib
...
*) Enhanced interface
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3649 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
6256d89883
*) bugfix for reg.exp to determine svn rev. nr
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3341 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
hydrox
5a00793b2f
*) deleted svnRevNr.jar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3180 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
(no author)
c67d22116e
added exists-check based only on RAM index lookup:
...
- faster double-check during crawling
- less IO
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3179 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
daburna
22a8826515
-typo
...
-small fixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3171 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
daburna
27f5a55f77
updated languagefile
...
-translated Message_p.html and MessageSend_p.html
-excluded translation for DetailedSearch.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3163 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
allo
77c02cf180
build the svnRevNr helper, too.
...
(needed for a clean .deb)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3154 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
allo
782db9099d
version independent name for commons-pool lib
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3082 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
89ee215ff0
*) better detection of svn revision number in old xml format
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2736 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
b5904705ab
*) Bugfix for "determineRevisionNr: build.xml:98: SVN entries file does not exist" bug
...
See: http://www.yacy-forum.de/viewtopic.php?t=2824
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2585 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
99699a4d70
*) bugfix for new svn revision number ant task
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2562 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
da9f67a56d
*) bugfix needed because of new svn version 1.4 (new .svn/entries file format)
...
- lib/svnRevNr.jar: customized ant task to read the revision number out of the .svn/entries file
- build.xml: calling new ant task
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2561 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
(no author)
a1d3e1b896
*) Adding apache license file to lib dir
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@28 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
(no author)
f39812da91
*) Some performance improvements
...
- many classes set to final
- implementation of a session-thread pool
- reusage of the server handler class (normally the httpd object)
within the session thread
- implementation of a httpc object pool
- introduction of a linebuffer in httpd which can be reused
- reusing the properties table in the httpc
- added to apache libs (commons-collections, commons-pool) which
are needed for the object/thread pool implementation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@26 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago