b3ebd38079
removed the HTDOCS repository concept because the concept to host files
...
on the YaCy http server is obsolete; YaCy can index file:// and smb://
paths
10 years ago
2de159719b
added an option to set 'obey nofollow' for links with rel="nofollow"
...
attribute in the <a> tag for each crawl. This introduces a lot of
changes because it extends the usage of the AnchorURL Object type which
now also has a different toString method that the underlying
DigestURL.toString. It is therefore not advised to use .toString at all
for urls, just just toNormalform(false) instead.
10 years ago
d9472d043a
cleanup older unused classes
11 years ago
665e12f88e
move startup time from old serverCore to switchboard (most used here)
...
to make servercore eventually obsolete.
11 years ago
ba6ffddefc
refactoring
11 years ago
0587077d06
cleanup obsolete and not used serverswitch Authentify code
...
as auth is mostly delegated to Jetty container.
11 years ago
79e7947442
- remove empty http0_9 status text array
...
and unused default_charset = ISO-8859-1
11 years ago
2dabe2009d
- remove unused manual http KeepAlive config
...
(reducing references to obsolete httpdemon)
- add port info to settings_http
11 years ago
710054bb37
implement gzip input handling directly in defaultservlet
...
(making reference to legacy httpdemon obsolete)
11 years ago
36a66b0704
fix for parsing of numeric value in case that boolean values are given
11 years ago
41730c8048
better logging in template engine: shows filename of servlets where
...
errors in templates occur
11 years ago
f06775850f
fix receiving DHT / parse pultipart
...
+ another close to fix possible resource leak warning
11 years ago
b12200cafe
alternative UrlProxyServlet (for /proxy.html) using different url rewrite rules
...
- use JSoup parser for selective rewrite of html body <a href= links only,
instead of regex which rewrites also header href/src links
- this improves display of pages which use header <base> tag
- tags with src attribute are taken from original location (like css) improving display and are not routed trough the indexer
Disadvantage: scripting links will drop out of proxy
Setting of the servlet through web.xml exclusivly (in case one would like to quickly switch back to the YaCyProxyServlet,
leaving the existing code of YaCyProxyServlet untouched available)
11 years ago
b488f33975
added close to fix possible resource leak warning
11 years ago
b9056ef2db
remove unused private header entries (HeaderFramework)
...
X_YACY_ORIGINAL_REQUEST_LINE
X_YACY_KEEP_ALIVE_REQUEST_COUNT
CONNECTION_PROP_REQUESTLINE
11 years ago
c297de5145
remove check for unused virtual path /currentyacypeer/
...
- del jqueryheader.template (not used)
11 years ago
453bfd0f17
removed unused variables and warnings
11 years ago
a373fb717d
remove more unused from legacy server.http
...
- triggerOnlineAction not used
- useTemplateCache not used
11 years ago
749d020aeb
remove redundant url string manipulation in HTTPDProxyHandler
...
(still used by ProxyServlet)
11 years ago
b08375da33
fix for bad/missing values of size_i
11 years ago
dd5bf0b71b
cleanup old reference to HTTPDemon.setAlternativeResolver
...
optimize .yacyh check in AbstractRemoteHandler
11 years ago
3b89176b9f
use config value htroot in Jetty init (was hardcoded)
...
- move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler
- use SwitchboardConstant.htroot where appropriate
11 years ago
ad4b213145
remove unused static var from HTTPDProxyHandler
11 years ago
d2b8f2b477
enhancements for staticIP and ipv6 handling
11 years ago
6ada0daae9
making latency_factor and maximum number of same hosts in loader queue
...
settings available in Crawler_p.html servlet for steering.
11 years ago
40a4030b55
configurable max-load values for YaCy-Threads:
...
try lower values on smal systems like a Pi
11 years ago
022c6d3ce1
do YaCy p2p connections using a timeout-request which covers the http
...
request into a separate thread and ignores the furthure result of a
request if that does not answer within the requested time-out. This is a
try to solve a problem with the peer-ping, which hangs whenever a peer
appears to be dead or blocked.
11 years ago
ea7cef5d05
fix NPE in TemplateEngine
...
StackTrace For input string: ""
java.lang.NumberFormatException: For input string: ""
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:504)
at java.lang.Integer.parseInt(Integer.java:527)
at net.yacy.server.http.TemplateEngine.writeTemplate(TemplateEngine.java:241)
at net.yacy.server.http.TemplateEngine.writeTemplate(TemplateEngine.java:199)
at net.yacy.http.servlets.YaCyDefaultServlet.handleTemplate(YaCyDefaultServlet.java:896)
11 years ago
6932aa4d7a
use configured admin-username for api calls
...
- the admin user name can be configured, in apiExec calls the default "admin" username is used.
TODO: the bin/apicall.sh script should likely take that into account.
11 years ago
3cb6c7861f
fixed shutdown authenticaton problem
11 years ago
7005ecdabd
cleanup
11 years ago
9bd71fdbb4
made the access tracker class static because it shall be used by the
...
jetty auth module
11 years ago
4c38bceafc
handle http connect for proxy
...
refactor header cleanup (reuse existing code)
11 years ago
0583f44306
reimplement proxy access log (to Jetty ProxyHandler)
...
- using existing HTTPDProxyHandler logger
- allow local loopback ip to access proxy
11 years ago
8eaabb9600
remove dependency from old serverCore.java
...
- remaining getPortNr not needed
(as current release allows only to set plain integer as port,
see ConfigBasic)
11 years ago
667a6adddb
- use default files from yacy.init property "defaultFiles" if no
...
jetty-configuration is given for default files.
- fix a problem with default paths if no path is given (i.e.
http://localhost:8090 instead of http://localhost:8090/ ). Without this
patch the path was resolved automatically to http://localhost:8090//
11 years ago
e17624b6dd
added html retrieval from alternative DATA/HTDOCS path
11 years ago
07cee6b99c
removed more unused code
11 years ago
84167adb49
removed unused anomichttpd code after migration to jetty
11 years ago
7603e879dc
Merge branch 'master' into HEAD
...
Conflicts:
.classpath
source/net/yacy/cora/federate/solr/SolrServlet.java
11 years ago
25250405f1
solr servlet preparation for join with jetty branch
11 years ago
f111f30ace
Merge origin/master into jetty
11 years ago
ff86cb683f
fixed some XSS bugs reported by Marius from http://ctf365.com/
11 years ago
087df05e24
added option to Config_Network_p.html to enable remote search while
...
DHT-Receive is switched off.
11 years ago
b29d262e70
implement Jetty8HttpServerImpl.generateSocketAddress
...
(code 1:1 copied from serverCore)
11 years ago
f017066197
Merge origin/master into jetty
11 years ago
69599566f9
catch one more malformed url in proxy url rewrite
11 years ago
605530fec5
catch proxy url rewrite exception
...
malformed url (" http:\/\/" ) may cause error response
testcase http://localhost:8090/proxy.html?url=http://dictionary.reference.com/browse/test
11 years ago
1adb4b8741
merge rc1/master
11 years ago
0d4efabaa8
fix YaCy version string in proxy headers
...
(config parameter vString not longer used)
11 years ago
orbiter