luccioman
4a8da6fba1
Try for automated build compatibility on dockerhub
...
Added Dockerfile on master
9 years ago
luccioman
b4adbcbd35
Added YaCy icons
9 years ago
luc
3f338777f7
Also check and index eventual icon url information from metadata.
9 years ago
luc
9f712146df
Display icons in ViewFile "links" mode.
9 years ago
luc
8682dfbd5e
Updated getpageinfo outputs to return page icons list.
9 years ago
luc
26f1ead57c
Created ViewFavicon class specialized in favicon viewing.
...
Main image processing is now in ImageViewer, used by both ViewImage and
ViewFavicon.
Fixed URIMetadataNode.getFavicon to use non-standard icons with no size
ass fallback.
9 years ago
luc
07222b3e1a
Added favicon url transmission in RWI chunks.
9 years ago
luc
480772c070
Fixed json search results from commit "Improved URLLicence reliability"
9 years ago
reger
937fbb0b9f
correct isHidden() for smb from last commit
9 years ago
reger
535d4bf75f
respect hidden attribute for file and smb directory listing
...
(hidden directories are not listed, effects crawling of local file system)
9 years ago
luc
53781299d8
Extracted intranet and filtype related rules from getFaviconURL func
9 years ago
reger
cc79ad8de6
compare search page, remove diminished search target
...
(romso.de, dbpedia.neofonie.de )
9 years ago
reger
375d49d536
upd classpath in batches (remove not necessary htroot)
...
see prev commit
9 years ago
luc
3cc5619d93
Improved HTML icons indexing and rendering in search results.
...
See http://mantis.tokeek.de/view.php?id=629
9 years ago
luc
edef6cd0dc
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
reger
c28142095a
add findClass() to servlet class loader (used in YaCyDefaltServlet)
...
In the 2 cases where servlet calls servlet the jvm classloader chain is
invoked and servlet class loaded by jvm loader (successful while requiring
htroot in system classpath). This patch uses the standard override design
for loaders to handle these cases (making in not longer crucial to have htroot
in system classpath, as this classLoader is mainly used for servlets and
looks in this case for the class in the configured path).
+ As the default classloader is parallelcapable we should register this too.
9 years ago
luc
db6fc67b77
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
reger
8e60788c8f
fix json date facet displayname
9 years ago
reger
46772e08d0
upd to pdfbox 1.8.11
9 years ago
luc
f7b854465b
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
reger
a6617ad887
expand initRemoteCrawler() to terminate worker threads if called to deactivate
...
remote crawl.
On startup we save the resources for remote crawler if disabled. Once started
threads are running idle after disable remote crawl. Now threads are terminated
to save the resources also while disabeling during runtime.
+ remove empty class Channels
9 years ago
reger
2048b7e057
support scraping start-/enddate from html tag with property "datetime"
...
This may be used in html5 <time> tag (which we don't explicite support yet for date in content scraping).
9 years ago
reger
900d4584ba
complet resource cleanup of lists in contentscraper's close()
9 years ago
reger
06e5cd6164
add support parsing swf-metadata to swfparser
...
flash supports metadata tag in swf file with metadata in xmp (xml) format.
parse some common data to include it in the head section of the html string
of converttohtml.
9 years ago
luc
e0ac26d63e
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
reger
11b1587067
replace remaining use of java.util.Vector by ArrayList (WebCat-swf)
9 years ago
reger
9331acdb18
add support for DEFINEFONT3 (swf8) to webcat parser
...
experienced issue with JPEGTABLE tag (with length=0) causing abort of parsing (ioexception)
as we don't use/need it for text parsing skip this tag.
9 years ago
reger
bf5fca5d99
add missing swf tag constants according to latest spec
...
reduce use of synced vector in webcat parser
9 years ago
luc
aa60ad1dbc
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
reger
1f18653de0
pass parsed swf content trough htmlscraper
...
Swf may contain subset of html tags which shoul'd appear as text.
Especially <font> tag may totally screw up metadata servlet if not filtered out.
9 years ago
reger
18ecf57792
add support of compressed swf to swfParser
...
from JavaSWF2 (source compatible to WebCat).
Moved swf file signature check to parser
Changed use of synced vector to list swf InStream
9 years ago
sixcooler
5cb7ba0dc4
fix for connections not getting closed to get favicon.ico during seach
9 years ago
sixcooler
e1dd808e1c
fix for 'move test classes to test/java'
9 years ago
luc
ef83e34b8a
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
reger
6c25710a34
replace bugfixed webcat-swf.jar
9 years ago
reger
4213ff84d4
import WebCat swf parser custom source package
...
This package is not available as jar (used jar is a custom compile as we
use just a portion of the package)
WebCat package is not maintained. To be able to fix bugs, source extract
of swf parser imported here.
9 years ago
reger
bceb779414
refactor libbuild/GitRevMavenTask (marvenize)
...
to be able to add additional modules to build
9 years ago
reger
730fb43ab1
add translation DE,FR submenuRanking.template
...
upd translation DE RankingSolr_p
9 years ago
reger
84c970eaec
move test classes to test/java (subdirectory as in Maven standard subdir layout)
...
because ViewImage*Test.java breaks test run
9 years ago
reger
9f91e6124f
add DE translation for submenuCrawler.template
...
+ upd submenuIndexControl.template
9 years ago
reger
ed3e16e092
apply remote result count config value to Bookmark Autosearch
...
+ prepare to make the widely unused Bookmark feature optional
9 years ago
Michael Peter Christen
5d635879f8
Merge pull request #40 from Scarfmonster/autocrawl
...
Automatic crawling
9 years ago
Ryszard Goń
7d6e0d8470
Add missing settings to autocrawl settings page
9 years ago
Ryszard Goń
7a7a1277bd
Add autocrawl settings page
9 years ago
Ryszard Goń
a98c395023
Add the Autocrawl thread
9 years ago
reger
4765e374e6
altered clac. of search result items per page to display
...
taking the existing limits into account but make it consistent with search option screen for admin and public user
changes:
- configured default number of items per page (ConfigPortal_p.html) is used as is (no hardcoded limit)
- otherwise requests are limited to 100 results per page ( = search option, index.html)
(this basically is the major change, inc. limit from 20 to 100 for public user)
P.S. - the older grant of more (1000), if no online snippet calculation, is kept (for the time being)
see http://mantis.tokeek.de/view.php?id=627
9 years ago
luc
231be83eb6
Corrected access to Load_MediawikiWiki.html and Load_PHPBB3.html
...
A NullPointerException occured when trying to access theses pages in
Robinson (Search portal) mode
9 years ago
Ryszard Goń
1728cd30c6
Create autocrawl profiles
9 years ago
luc
85a9363012
Merge branch 'master' of https://github.com/yacy/yacy_search_server
9 years ago
reger
abd8ecb503
remove contendom depending override of search result items per page
...
initially introduced e4570bffaf (diff-ae6c130fc11088c830b00ed9256ab56b)
(as one part of unexpected difference in actual vs requested results, partial bugfix for http://mantis.tokeek.de/view.php?id=627 )
9 years ago