45b9bd8403
adjust MultiProtocolURL.protocol detection to handle mailto with "://" in parameters,
...
and feeding hyperlinks to webgraph processing.
9 years ago
67f64af4b4
quick fix: go back to display search results favicon via <img> tag and ViewImage,
...
! until better solution is found !.
Reason: in IE-Browser no individual favicon is displayed with <object> tag
(always the default) and only few individual fav's with Firefox (randomly)
hint: to be able to use <img src=ViewImage/> return of default icon was
added back to it.
relates to http://mantis.tokeek.de/view.php?id=629
9 years ago
d5fd031449
fix reading of ippattern config array in URLProxy
9 years ago
b7e8358645
make use of header.getContentType where possible (mime is normalized afterwards)
...
otherwise use header.mime() differentiated in prev. commit.
9 years ago
7a8c077838
fix HeaderFramework.mime() to strip charset parameter.
...
Differentiate mime() and getContentType() which gives the raw header field.
This improves parser detection if charsets are included in http content-type field.
9 years ago
b4b6910d60
fix (todo): correct doc.id of remote search result if no match with newly
...
calculated doc hash if different.
Testing showed that in some cases delivered url doesn't match the local
calculated hash. In this case replace doc.id (and host_id_s) with calculation
from url.
9 years ago
15e46b2bad
exclude in/outboundlinksnofollowcount_i from default schema fields
...
(not used in any function)
9 years ago
dec3e6ad96
fix: adjust urlstub for mailto links
...
(skip protocol)
9 years ago
cb83e65f89
drop returning document language "en" if unknown (fix todo)
...
which also harmonizes handling of query.modifier for rwi and solr results
(to result must match a given language filter)
9 years ago
0c5548a7ff
fix (todo) remove redundant holding of email link nameproperty in parser document
9 years ago
71c416f383
show mailto links in ViewFile.html linklist
9 years ago
6b7c10cef8
fix dc:date in mediawikiimporter/document.writexml to use lastmodified
9 years ago
14803d58cd
let html scraper accept html5 <link rel="icon"> for favicon links
9 years ago
4d2b934487
prevent mailto links getting into parser result document's in/outbound link collection
...
by checking mailto scheme early.
- fix upper case mailto protocol assignment
- add test case for getProtocol
9 years ago
288acceac3
fix test htmlParserTest, charset parameter
...
+ upd maven templating-plugin version
9 years ago
1be67d9ab6
CachedSolrConnector was replaced by ConcurrentUpdateSolrConnector years
...
ago - time to let it go
Commented out unused table of cache-objects
9 years ago
28b8bc290a
fix use of NETWORK_SEARCHVERIFY for rwi verification
...
was not used to set the searchevent parameter (done in SearchEventCache.getEvent)
- remove unused corresponding QueryParams.filterfailurls param.
9 years ago
020630efd8
remove unused network scanner parameter from queryparameter
...
Search event is not using networkscanner
(removed filterscannerfail param always init to false)
9 years ago
7cda48a9d6
add hint to "default max results per page" limit on ConfigPortal
...
(limit is applied in yacysearch & max. total results by sum result-stack size)
- remove obsolete search.navigation prop (has moved to ConfigSearchPage_p)
9 years ago
b2fac989fd
Merge pull request #32 from luccioman/master
...
Fix for MediaWiki import (mantis 625)
9 years ago
ad5586f8f6
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
8ebefa4233
Fixed MediaWiki import : DCEntry conversion to SolrInputDocument was
...
failing. Looks like it was broken since Commit
b43811d38c
9 years ago
7736ee5a42
Updated MediaWimporter main() : display usage in console and stop
...
properly without calling System.exit
9 years ago
cdb8f3b10d
make current ranking score value avail. to search interface / api
...
Update the result score result field with the result queue ranking value to reflect
the actual calculated/used score,
for rwi & solr stack results.
(calc. etc. is unchanged, it's just that result entry carries the latest val
as api retrieves the number from it)
9 years ago
a622c9b656
upd to Bootstrap v3.3.6
9 years ago
92df100596
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
27d11f8671
Fixed isSolrDump function : PushBackInputStream was not unread when
...
returning false (for example with a WikiMedia dump).
9 years ago
1043fe55a3
add missing bootstrap 3.3.4 glyphicons file
...
see comment @luc http://mantis.tokeek.de/view.php?id=623#c1151
9 years ago
135a123a77
less logging in new language detection
9 years ago
ef8cd80593
fix for npe
9 years ago
0347bfa71f
Apply collection query constraint/modifiert to rwi result stack.
...
Collection is not available in pure rwi entries (but in local solr metadata)
But if user wishes to filter by query constraint also rwi shall adhere to this
(even if only rwi entries with parsed or solr received metadata may fit)
9 years ago
dac8332476
Merge pull request #29 from luccioman/master
...
Modified images render error management
9 years ago
29585e2c5b
Corrected return type when licence is gone to be consistent with other
...
error cases.
9 years ago
df77e90ed7
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
2a67d2ba6f
Corrected error management for unsupported image formats, parsing
...
errors, and unavailable resources : avoid logging to much Exceptions as
these errors easily occur when searching images.
9 years ago
997f18f658
prevent exception on repeated ViewImage with same urlLicense
9 years ago
9cfa847c94
upd maven pom (add langdetect)
9 years ago
5309b99e98
Merge branch 'master' of git@github.com:yacy/yacy_search_server.git
10 years ago
d6e9834040
Merge branch 'master' of
...
https://github.com/Scarfmonster/yacy_search_server
# Conflicts:
# .classpath
# build.xml
10 years ago
c030b9bc5c
Merge pull request #27 from Stepanov-Sergey/master
...
added Russian synonyms
10 years ago
cff152f26e
Merge branch 'master' of git@github.com:yacy/yacy_search_server.git
10 years ago
7e785dac8e
urlproxyheader must be in the default package because all classes in the
...
htroot path must be in the default package
10 years ago
d82d311995
Merge branch 'master' of https://github.com/luccioman/yacy_search_server
...
# Conflicts:
# .classpath
10 years ago
d3ab43e743
fixed classpath
10 years ago
06994b5853
Merge pull request #23 from linkerlin/patch-1
...
Create .travis.yml
10 years ago
de0f3c6ff1
added Russian synonyms
10 years ago
b5371ea8c1
read/init crawl queue in a thread
...
to speed-up YaCy start on large existing crawler queues
10 years ago
f05b34fc35
upd to slf4j-1.7.13
10 years ago
1160b13172
remove unused md5 from ViewFile servlet params
10 years ago
e163ea88f6
fix vsdParser (Visio) parser return statement
...
(final block un-necessary throw)
10 years ago
reger