You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter 16baa7ad24 To translate a mediawiki dump into the YaCy surrogate format do the following: ... - download a wikipedia dump, i.e. dewiki-20090311-pages-articles.xml.bz2 from http://download.wikimedia.org/dewiki/20090311/ - move dewiki-20090311-pages-articles.xml.bz2 to DATA/HTCACHE/ - start the conversion; open a command shell, move to the yacy home directory and execute java -Xmx2000m -cp classes:lib/bzip2.jar de.anomic.tools.mediawikiIndex -convert DATA/HTCACHE/dewiki-20090311-pages-articles.xml.bz2 DATA/SURROGATES/in/ http://de.wikipedia.org/wiki/ this generates a series of files to DATA/SURROGATES/in if YaCy is running (it may run concurrently), it fetches all new dumps in the surrogate-in directory. The export process is transaction-save, that means YaCy will not start reading a dump while the dump is not completely finished. git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5851 6c8d7289-2bf4-0310-a012-ef5d649a1542		16 years ago
..
de/anomic	To translate a mediawiki dump into the YaCy surrogate format do the following:	16 years ago
dbtest.java	(peak-) performance hacks	16 years ago
genpw.java	more refactoring of kelondro:	16 years ago
migration.java	moved logging partially to kelondro	16 years ago
screenshot.java	added final where possible	17 years ago
yacy.java	* convert byte[] hashes to string for log output	16 years ago