From 204220ecd57bfa00fbc1c46644c218c72a66dad4 Mon Sep 17 00:00:00 2001 From: orbiter Date: Wed, 22 Oct 2008 11:07:14 +0000 Subject: [PATCH] added test files for UTF-8 / Umlaute - Testing: These 3 files contain the same text in different HTML encodings. We use this documents to test if the parser and indexer creates the same set of word hashes for all three texts. To use these files, run a indexing/crawling on them. To get the files inside the localhost-path, do the following: cd rmdir DATA/HTDOCS/repository ln -s test/parsertest DATA/HTDOCS/repository you have then linked the test directory as repository directory which you can reach in yacy if you switch to intranet indexing mode. So the next step is to start yacy, then - switch to intranet use case - go to the crawl start page - the repository directory should be the default path as crawl start - start the crawl - search for any word that appears in the demo texts - search not only for words with umlautel but also for words without umlaute to ensure that you find _all_ three documents - see how yacy presents the snippet with the text containing umlaute git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5293 6c8d7289-2bf4-0310-a012-ef5d649a1542 --- test/parsertest/umlaute_html.html | 10 ++++++++++ test/parsertest/umlaute_iso.html | 10 ++++++++++ test/parsertest/umlaute_utf8.html | 10 ++++++++++ 3 files changed, 30 insertions(+) create mode 100644 test/parsertest/umlaute_html.html create mode 100644 test/parsertest/umlaute_iso.html create mode 100644 test/parsertest/umlaute_utf8.html diff --git a/test/parsertest/umlaute_html.html b/test/parsertest/umlaute_html.html new file mode 100644 index 000000000..02f91f84a --- /dev/null +++ b/test/parsertest/umlaute_html.html @@ -0,0 +1,10 @@ + + + + + + +In München steht ein Hofbräuhaus. +Dort gibt es Bier aus Maßkrügen.
+ + diff --git a/test/parsertest/umlaute_iso.html b/test/parsertest/umlaute_iso.html new file mode 100644 index 000000000..de56c7116 --- /dev/null +++ b/test/parsertest/umlaute_iso.html @@ -0,0 +1,10 @@ + + + + + + +In München steht ein Hofbräuhaus. +Dort gibt es Bier aus Maßkrügen.
+ + diff --git a/test/parsertest/umlaute_utf8.html b/test/parsertest/umlaute_utf8.html new file mode 100644 index 000000000..8954c5c6a --- /dev/null +++ b/test/parsertest/umlaute_utf8.html @@ -0,0 +1,10 @@ + + + + + + +In München steht ein Hofbräuhaus. +Dort gibt es Bier aus Maßkrügen.
+ +