You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 4540174fe0 memory hacks		13 years ago
..
html	memory hacks	13 years ago
images	smaller bug fixes for search behavior; should produce less unnecessary removals and an exact number of results as shown in counter	13 years ago
xml	some last-minute performance hacks	13 years ago
bzipParser.java	added new configuration property "crawler.embedLinksAsDocuments". If this is switched on (this is default now), the all embedded image, audio and video links from all parsed documents are added to the search index as individual document. This will increase the search index size dramatically but will also enable us to create a much faster image, audio and video search. If the flag is switched on, the index entries are also stored to a solr index, if this is also enabled.	13 years ago
csvParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
docParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
genericParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
gzipParser.java	added new configuration property "crawler.embedLinksAsDocuments". If this is switched on (this is default now), the all embedded image, audio and video links from all parsed documents are added to the search index as individual document. This will increase the search index size dramatically but will also enable us to create a much faster image, audio and video search. If the flag is switched on, the index entries are also stored to a solr index, if this is also enabled.	13 years ago
htmlParser.java	performance hacks	13 years ago
mmParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
odtParser.java	set a limit to CharBuffer object size to fight against bad/too large	13 years ago
ooxmlParser.java	set a limit to CharBuffer object size to fight against bad/too large	13 years ago
pdfParser.java	memory hacks	13 years ago
pptParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
psParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
rssParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
rtfParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
sevenzipParser.java	added new configuration property "crawler.embedLinksAsDocuments". If this is switched on (this is default now), the all embedded image, audio and video links from all parsed documents are added to the search index as individual document. This will increase the search index size dramatically but will also enable us to create a much faster image, audio and video search. If the flag is switched on, the index entries are also stored to a solr index, if this is also enabled.	13 years ago
sidAudioParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
sitemapParser.java	better abstraction of http client identification	14 years ago
swfParser.java	some last-minute performance hacks	13 years ago
tarParser.java	added new configuration property "crawler.embedLinksAsDocuments". If this is switched on (this is default now), the all embedded image, audio and video links from all parsed documents are added to the search index as individual document. This will increase the search index size dramatically but will also enable us to create a much faster image, audio and video search. If the flag is switched on, the index entries are also stored to a solr index, if this is also enabled.	13 years ago
torrentParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
vcfParser.java	some last-minute performance hacks	13 years ago
vsdParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
xlsParser.java	- enhanced html parser: recognized much more details in the content	14 years ago
zipParser.java	added new configuration property "crawler.embedLinksAsDocuments". If this is switched on (this is default now), the all embedded image, audio and video links from all parsed documents are added to the search index as individual document. This will increase the search index size dramatically but will also enable us to create a much faster image, audio and video search. If the flag is switched on, the index entries are also stored to a solr index, if this is also enabled.	13 years ago