fceac8cffd
more monitoring for postprocessing
12 years ago
9d5895f643
enhanced and fixed postprocessing
12 years ago
087df05e24
added option to Config_Network_p.html to enable remote search while
...
DHT-Receive is switched off.
12 years ago
1a4a69c226
set more logger to 'final static'
12 years ago
69b8d61c47
fix for search requests in GSA interface which contain 'funny'
...
characters (like ':' etc.)
12 years ago
4234b0ed6c
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
74c86a72a0
better default value for crawler user agent
12 years ago
87a956e881
calculating and showing the number of files and the average size of a
...
file in the HTCACHE in ConfigHTCache_p.html
12 years ago
acc1f8a749
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
81bb50118e
found and fixed a huge memory leak in solr caching (inside Solr). The
...
not-flushed Solr cache is now handled in this way:
- it is smaller by default
- an Solr-internal process is started to flush the cache periodically
(this does NOT clean the cache, just removes old objects)
- a Solr-external process (the standard YaCy cleanup-process) now has
direct access to the solr internal cache and flushes them completely.
The time frame for such a flush is defined by the cleanup-process
frequency, by default 10 minutes.
12 years ago
987f410011
URL-export:add query and fix for cast-class-exception
12 years ago
ffe8276063
replaced referrer link masking to 'pure' links to the referring page
...
(that was more useful during testing)
12 years ago
434e13b46d
in host browser also show the properties of failed documents including
...
referrer urls (this is a VERY USEFUL SEO and Web Admin feature!!)
12 years ago
1ac504ae51
use html encoding for urls in metadata
12 years ago
25951cee14
- fixed opensearchdescription, this delivered an url with missing
...
'global' option
- added display=2 to compare_yacy to remove the superfluous border
12 years ago
f1bfe64361
integrated startpage to compare_yacy
12 years ago
2f57327f20
added boolean load property to CacheResource_p servlet which causes that
...
the servlet loads the page from the web.
12 years ago
9bb7eab389
hacks to prevent storage of data longer than necessary during search and
...
some speed enhancements. This should reduce the memory usage during
heavy-load search a bit.
12 years ago
5afa6e3aee
Automatically flush the log cache if a short memory status is reached.
...
For the default of 200 lines this can flush about 10MB.
12 years ago
030d0776ff
Enhanced crawl start for very, very large crawl lists (i.e. > 5000)
...
which had a problem because of badly used concurrency.
This fix also caused a redesign of the whole host deletion process.
This should fix bug http://bugs.yacy.net/view.php?id=250
12 years ago
4948c39e48
added concurrency for mass crawl check
12 years ago
1b4fa2947d
- fixed a problem which ocurred when a document was not recognized with
...
the right content domain (i.e. identifying that it is an image, text
etc.) because it used the file extension and not an existing mime type
assignment.
- fixed the new setting that images shall be loaded for a better image
search.
- both fixes together makes it now possible to crawl
commons.wikimedia.org which makes use of 'funny' document names (i.e.
ending with .jpg while the document is html)
12 years ago
16e3b357b3
replaced old tag cloud and adopted design a bit
12 years ago
dc38d35986
added matching in url field in Table_API_p search
12 years ago
691d7e70fa
added hint to development/commit rss feed
12 years ago
b81859c751
Show a RSS icon in the right top corner of search results. This replaces
...
the 'API' icon which was the link for the opensearch result which is an
extension of RSS. Since it is more appropriate to visualize a RSS link
with an RSS icon, this API icon was changed here.
12 years ago
1a09771be8
fixed sitemap crawl start
12 years ago
b743e6d79f
- prevent that crawl filter have empty (never-match) content
...
- rewrite the description of the options "Restrict to start domain(s)"
and "Restrict to sub-path(s)" to an explanation, that the restriction
applies to all links in the link list of the option "From Link-List of
URL" if this option is selected
- allow "Restrict to sub-path(s)" if the "From Link-List of URL" is
selected. This is supported in the crawl start.
12 years ago
f597fdb602
make it easier to filter properties (case insensitive)
12 years ago
37d24f3318
make use of declared static string ACTION_LOCATION
12 years ago
91fa99e9bb
added new icon/image for latest commit
12 years ago
9fac9249bc
- replaced 'edit' link with a clone symbol in Table_API_p since that is
...
what it does: it clones the crawl, it does not change the crawl.
- moved the appearance of this clone link to the type column since this
makes it visible also if the URL column is not visible.
12 years ago
0f6db6ad5b
Merge remote-tracking branch 'jensbees/crawlexpert-post'
12 years ago
3252c1ec39
Merge upstream/master into crawlexpert-post
12 years ago
90c8577840
enhanced ranking; patches to replace old ranking
12 years ago
a3824dfbaa
check URL on inital load, if set
12 years ago
52f49d475b
add a hidden field for "crawlingstart" since jQuery omits the submit button value
12 years ago
b0c0ec2dec
link recorded crawl starts back to "CrawlStartExpert_p" in "Process Scheduler"
12 years ago
d64d45361c
use integer types for boolean values
12 years ago
eda123d6fd
remove debugging code intercepting post requests
12 years ago
5057f27bbd
fix typo in parsing "cachePolicy" parameter
12 years ago
98f5c9018d
Fixed template vars for "deleteold". Fixed parsing "deleteold" parameter. Stop "setState" overwriting "deletold" state on load.
12 years ago
a6a62986d4
correct state handling for country code restriction
12 years ago
4066b85155
correctly set initial state for load filters
12 years ago
8c91c3e7cd
set form boolean values to 0 & 1 instead of false & true
12 years ago
c27fabc88e
fixed wrong parameter check
12 years ago
2214bf5396
Remove some post parameters, if they are set to default values, as their values are already set by YaCy. Added some documentation.
12 years ago
705b3338ee
list more fields available for search and for ranking boosts
12 years ago
405878182f
Use list template for all other option lists. Fixed some template expressions.
12 years ago
8e74098cd4
Use list template for "reloadIfOlderNumber".
12 years ago
Michael Peter Christen