Commit Graph

1667 Commits (af1d89e3814516b09aab109bdd1994418ee49449)

Author SHA1 Message Date
borg-0300 af1d89e381 check url == null added;
18 years ago
theli cc667b0aa5 *) htmlFilterContentScraper.java: adding support for link tag
18 years ago
theli 26dfbb7499 *) Bugfix for UTF-8: url names are now stored properly in stackcrawl, crawler, indexing queue and should be displayed correct on the gui
18 years ago
theli cf6acff2c2 *) Bugfix. htmlFilterInputStream document analysis did not work properly for documents smaller than the
18 years ago
borg-0300 f18304ddd3 unused/not needed imports removes;
18 years ago
orbiter ec031eb993 first version of surftipps
18 years ago
borg-0300 b174fbd0ca "import ...*" removed;
18 years ago
orbiter 807756150e patch for strange bug reported by email
18 years ago
theli 5c6251bced *) some improvements for extended html document charset support
18 years ago
theli 33f0f703c0 *) reinserting type cast again
18 years ago
orbiter 8c11a543dc fixed line ending coding
18 years ago
theli b690597275 *) adding casts to avoid compatibility problems between java 1.4 and java 1.5 writer class usage
18 years ago
theli 5afb0cbce8 *) setting default charset (for unkown documents) to iso-8859-1
18 years ago
orbiter f453c14b5d removed unreacheable catch blocks and unused imports
18 years ago
theli ad7f600f25 *) Bugfix. re-enabling inheritance of serverCharBuffer from writer class
18 years ago
theli 97d2a08ef1 *) restructuring needed to support parsing of documents using various charsets
18 years ago
theli fc594e8eda *) adding httpContentLengthInputStream.java class to allow reading of http response bodies
18 years ago
low012 cd636eb00e *) Fix for the fix...
18 years ago
low012 f9a5b55a9e *) Fixed bug described in http://www.yacy-forum.de/viewtopic.php?p=25448#25448
18 years ago
orbiter 3aac5b26da - added automatic tag generation when a web page from the search results is added
18 years ago
low012 8a30c5343d *) Fixed bug where exclamation marks could get lost between [=...=] and <pre>...</pre>
18 years ago
low012 d8f4b17e31 *) Hopefully fixed bug described in http://www.yacy-forum.de/viewtopic.php?t=2825.
18 years ago
theli 0e84a969d6 *) Bugfix for serverCharBuffer read from file operation
18 years ago
theli 90ef19d778 *) first version of a serverCharBuffer
18 years ago
orbiter d374ef2bbe bugfix for tryRemoveURLs
18 years ago
orbiter f644a1c3a7 better evaluation of index abstracts
18 years ago
orbiter 1b48473bc5 bugfix to utf8 recognition
18 years ago
orbiter 90f7241b59 serverByteBuffer.trim() can now recognize utf-8 characters
18 years ago
allo 2fd610b556 http://www.yacy-forum.de/viewtopic.php?p=25611#25611
18 years ago
theli e34d9b3fec *) charset aware headlines (after the serverByteBuffer.trim problem is solved)
18 years ago
theli 8115ac47b5 *) charset aware metadata parsing
18 years ago
theli 3ac30bdf22 *) some todo markers added for additional charset support
18 years ago
theli 06fa891152 *) htmlFilterContentScraper.java: using proper charset for document title
18 years ago
theli 74c3e7cf29 *) storing document charset into plasmaParserDocument object (is needed later by the condenser)
18 years ago
theli c5d3020941 *) better errorhandling for last commit
18 years ago
theli d0a5a53789 *) changes needed for multi-language support
18 years ago
orbiter d82875c72b removed removal of 'funny symbols' that may have caused utf-8 problems
18 years ago
orbiter 26ab1fa885 fixed null pointer exception
18 years ago
theli b0e8ff6eda *) some TODO makers for UTF-8 problem
18 years ago
orbiter 41e27b85b7 fix for crawler condition
18 years ago
orbiter 0ee7e45413 bugfix for merge method (caused by bad refactoring)
18 years ago
orbiter 5c2f30eaca adjustments to dhtInCache write
18 years ago
theli 9ecf7f0da2 *) some TODO makers for UTF-8 problem
18 years ago
theli e2f8339827 *) some bugfixes for UTF-8 related problems
18 years ago
orbiter c89d8142bb replaced old 'kCache' by a full-controlled cache
18 years ago
orbiter 6e2907135a bugfixes for remote search server part
18 years ago
orbiter cf9884e22b first attempt to implement a secondary search
18 years ago
theli 2a06ce5538 *) next bugfix for UTF-8
18 years ago
theli bdc51591ae *) UTF-8 Bug solved (hopefully)
18 years ago
theli ef751b9d33 *) removing all string operations from the template engine
18 years ago