You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 1b4fa2947d - fixed a problem which ocurred when a document was not recognized with ... the right content domain (i.e. identifying that it is an image, text etc.) because it used the file extension and not an existing mime type assignment. - fixed the new setting that images shall be loaded for a better image search. - both fixes together makes it now possible to crawl commons.wikimedia.org which makes use of 'funny' document names (i.e. ending with .jpg while the document is html)		11 years ago
..
content	- the webgraph shall store all links which appear on a web page and not	12 years ago
importer	- replaced the properties object in AnchorURL with distinct variables	12 years ago
language	- refactoring of log to ConcurrentLog:	12 years ago
parser	set anchor rel attribute of all links to "nofollow" if the html meta	12 years ago
AbstractParser.java	- refactoring of log to ConcurrentLog:	12 years ago
Condenser.java	- fixed a problem which ocurred when a document was not recognized with	11 years ago
Document.java	- fixed a problem which ocurred when a document was not recognized with	11 years ago
ImageParser.java	Added 'final' for all exception blocks as this helps the Java compiler	12 years ago
LargeNumberCache.java	more performance hacks	15 years ago
LibraryProvider.java	- the webgraph shall store all links which appear on a web page and not	12 years ago
Parser.java	- replaced the properties object in AnchorURL with distinct variables	12 years ago
Phrase.java	more performance hacks	15 years ago
SentenceReader.java	fix for url camel case parser and sentence reader	13 years ago
SnippetExtractor.java	Added 'final' for all exception blocks as this helps the Java compiler	12 years ago
TextParser.java	- replaced the properties object in AnchorURL with distinct variables	12 years ago
WordTokenizer.java	refactoring	13 years ago