1a09771be8
fixed sitemap crawl start
11 years ago
b743e6d79f
- prevent that crawl filter have empty (never-match) content
...
- rewrite the description of the options "Restrict to start domain(s)"
and "Restrict to sub-path(s)" to an explanation, that the restriction
applies to all links in the link list of the option "From Link-List of
URL" if this option is selected
- allow "Restrict to sub-path(s)" if the "From Link-List of URL" is
selected. This is supported in the crawl start.
11 years ago
20bbde8665
fix for mustmatch regex computation: result had correct semantic, but
...
may have contained multiple same expressions within the disjunction of
domain-restrictions. This fix removes the redundant restrictions and
makes the regex shorter.
11 years ago
cb2dbcb843
add graceful Jetty shutdown option
...
- as Jetty stop is not synced, yet
- include jetty jars and servlet-3.0 api jar in Eclipse .classpath
11 years ago
f597fdb602
make it easier to filter properties (case insensitive)
11 years ago
f46c723398
allow to choose used http server, YaCy-Anomic or Jetty
...
- defaults to Jetty (in this branch)
- add server version info & config option -> Admin Console -> Advanced Settings -> Http Networking
11 years ago
da4ff5aefa
add YaCy HttpCommand "authenticate" check to DefaultServlet
11 years ago
c833d02cf5
fixed webgraph postprocessing (did nothing and repeated to do this...)
11 years ago
74d0256e93
enhanced postprocessing: fixed bugs, enable proper postprocessing also
...
without the harvestingkey, remove crawl profiles after postprocessing,
speed-up for clickdepth computation.
11 years ago
299f51cb7f
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
1adb4b8741
merge rc1/master
11 years ago
e7a596afda
Merge branch 'master' of git://gitorious.org/yacy/rc1.git
11 years ago
37d24f3318
make use of declared static string ACTION_LOCATION
11 years ago
77a73c7475
add YaCy HttpCommand "location" check to DefaultServlet
11 years ago
7b69c438f7
more methods for the table class
11 years ago
820b896146
Replaced the inframe loading from yacy.net for donations with the
...
loading of this iframe from the local host. To make this more flexible,
this iframe is loaded once after startup from yacy.net.
11 years ago
cc223b14a4
remove wrong content mod in SSI parser for virtual path /currentyacypeer/
...
(is handled on start of request handling)
11 years ago
dfb73c9519
bump to httpclient-4.3.1 - a bugfix release
11 years ago
5606291574
fix last commit (not needed test of GZipInputStream)
11 years ago
f9eed8cb44
add support for gzip encoded multipart forms (needed for transferRWI.html)
...
- quick and dirty reuse of existing HTTPDemon implementation
11 years ago
cf32a92629
- add size check to multipart form data handling of YaCyDefaultServlet (same as in HTTPDemon.parseMultipart)
...
- reduce Jetty logging
- give build.run a bit more memory (set to YaCy.default 600m from 512m)
11 years ago
705f147820
- add localpeername.yacy to list of local address detection for AbstractRemoteHandler
...
- use proxy via header info as in legacy proxy handler
11 years ago
0d4efabaa8
fix YaCy version string in proxy headers
...
(config parameter vString not longer used)
11 years ago
2226189743
disable domainhandler due to error
...
- domainhandler causes closed response output stream in following handlers
on addresses resolved to local peer (like in hello protocoll preventing peer to switch to senior peer)
11 years ago
eea504c117
update Info.plist
...
small DefaultServlet refactoring
11 years ago
a44eede8b8
merge rc1/master
11 years ago
d9a02ed277
NPE fix for my last commit
11 years ago
54a0272338
searchpage javascript (latestinfo) causes reset of search statistic after moving to next page
...
- disabled call via setTimeout in yacysearch.html
11 years ago
61f627eb85
fix for ssl-connections from proxy-usage staying in close-wait-state
...
+ some extra 'close' in HttpClient
11 years ago
91fa99e9bb
added new icon/image for latest commit
11 years ago
9fac9249bc
- replaced 'edit' link with a clone symbol in Table_API_p since that is
...
what it does: it clones the crawl, it does not change the crawl.
- moved the appearance of this clone link to the type column since this
makes it visible also if the URL column is not visible.
11 years ago
0f6db6ad5b
Merge remote-tracking branch 'jensbees/crawlexpert-post'
11 years ago
3fcf7a94c5
rolling back wrong merge
11 years ago
3252c1ec39
Merge upstream/master into crawlexpert-post
11 years ago
d328cc4a83
fix for didyoumean, added also more asian alphabets
11 years ago
90c8577840
enhanced ranking; patches to replace old ranking
11 years ago
9f6b98d374
Merge master into crawlexpert-post
11 years ago
6e33be4ce6
reverting local changes to project.xml
11 years ago
a3824dfbaa
check URL on inital load, if set
11 years ago
52f49d475b
add a hidden field for "crawlingstart" since jQuery omits the submit button value
11 years ago
b0c0ec2dec
link recorded crawl starts back to "CrawlStartExpert_p" in "Process Scheduler"
11 years ago
d64d45361c
use integer types for boolean values
11 years ago
eda123d6fd
remove debugging code intercepting post requests
11 years ago
5057f27bbd
fix typo in parsing "cachePolicy" parameter
11 years ago
98f5c9018d
Fixed template vars for "deleteold". Fixed parsing "deleteold" parameter. Stop "setState" overwriting "deletold" state on load.
11 years ago
a6a62986d4
correct state handling for country code restriction
11 years ago
4066b85155
correctly set initial state for load filters
11 years ago
8c91c3e7cd
set form boolean values to 0 & 1 instead of false & true
11 years ago
c27fabc88e
fixed wrong parameter check
11 years ago
2214bf5396
Remove some post parameters, if they are set to default values, as their values are already set by YaCy. Added some documentation.
11 years ago
Michael Peter Christen