boxtec
/
yacy_search_server
mirror of https://github.com/yacy/yacy_search_server
4
1
Fork 0
Code Issues Projects Releases Wiki Activity

YaCy packages README reworked

Browse Source
pull/333/head
Allan Nordhøy 5 years ago committed by GitHub
parent 749671d945
commit 91742ed945
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 29 additions and 31 deletions
Show Stats Download Patch File Download Diff File

60
yacy-packages.readme
Unescape View File

@ -1,69 +1,67 @@
The YaCy Search Application is build on a set of packages The YaCy search application is built on;
for efficient IO, visualization, parsing and text structure analysis a set of packages for efficient I/O, visualization, parsing and text structure analysis,
and some application-specific classes for the distributed full-text index some application-specific classes for the distributed full-text index, and
and servlets for the user interfaces and protocol implementation. servlets for the user interfaces and protocol implementation.
Packages: Packages:
net.yacy.kelondro net.yacy.kelondro
----------------- -----------------
depends on commons-logging Depends on commons-logging.
The core class for efficient IO: The core class for efficient I/O:
- record-based stream writing - Record-based stream writing.
- blob-based stream writing - Blob-based stream writing.
- large-scale full-ram indexes for up to 100 Million references - Large-scale full-RAM indexes for up to 100 million references
to object entries in record-streams and blob-streams to object entries in record-streams and blob-streams.
- logging, resource observation, work-flow control and utilities - Logging, resource observation, work-flow control and utilities.
net.yacy.visualization net.yacy.visualization
---------------------- ----------------------
has NO dependencies Has NO dependencies
The core class for image drawing that is used in visialization servlets. The core class for image drawing that is used in visialization servlets.
This package contains system-independent drawing class that provide This package contains system-independent drawing class that provides
a unique way to draw graphs and charts and write on these images with a unique way to draw graphs and charts and write onto these images with
a tiny 5x5 font. a tiny 5x5 font.
net.yacy.document net.yacy.document
----------------- -----------------
has many dependencies, kelondro and text parser classes Has many dependencies, kelondro and text parser classes
The core package for document parsing and content analysis. The core package for document parsing and content analysis.
Provides classes for text and image parsing, metadata generation Provides classes for text and image parsing, metadata generation
using dublin core metadata records. Text contents can be processed using Dublin core metadata records. Text contents can be processed
with language detection and annotated with analysis metadata with language detection and annotated with analysis metadata
like geolocalization information (more to come). like geolocalization info (more to come).
net.yacy.repository net.yacy.repository
------------------- -------------------
depends on yacy.kelondro, yacy.document, commons-httpclient Depends on yacy.kelondro, yacy.document, commons-httpclient
The core package for document retrieval and data access connectors. The core package for document retrieval and data access connectors.
Contains a web crawler, a OAI-PMH client and a document cache. Contains a web crawler, a OAI-PMH client and a document cache.
The document cache is integrated in a http client infrastructure The document cache is integrated in a HTTP client infrastructure
to provide a transparent access to documents that may either live to provide a transparent access to documents that may either live
externally in the WWW or inside the repository cache. The cache stores externally in the WWW, or inside the repository cache. The cache stores
http header information and the full document data and is stored HTTP header info, and the full document data and is stored
as a kelondro blob array. The integrated crawler provides support for as a kelondro blob array. The integrated crawler provides support for
robots.txt crawler steering methods and is implemented in such a way robots.txt crawler steering methods, and is implemented in such a way
that target hosts are balanced when the crawler retrieves pages from that target hosts are balanced when the crawler retrieves pages from
the WWW. the WWW.
net.sbbi.upnp net.sbbi.upnp
------------- -------------
has NO dependencies, a "homeless" package (see explanation below). Has NO dependencies, a "homeless" package (see explanation below).
provides upnp functions for the YaCy p2p network bootstraping Provides UPnP functions for bootstraping the YaCy p2p network.
org.apache.tools.tar org.apache.tools.tar
-------------------- --------------------
has NO dependencies, a "homeless" package (see explanation below). Has NO dependencies, a "homeless" package (see explanation below).
provides un-tar functions for the net.yacy.document Provides un-tar functions for the net.yacy.document.
^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v ^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v^v
"homeless" packages (see reference above) "homeless" packages (see reference above)
YaCy contains 'homeless' packages that have not the necessary maintenance YaCy contains 'homeless' packages not meeting the necessary maintenance
sufficient enough for a linux release packagement. It was integrated required for Linux release packaging. It was integrated
in the YaCy package structure because it is needed in the YaCy search in the YaCy package structure because it is needed in the YaCy search
application, but cannot be found in a public available deban/fedora package. application, but cannot be found in a public available Deban/Fedora package.

Write Preview
Loading…
Cancel
Save