444a9ae674
remove unused options and attributes from DefaultServlet
...
cleanup obsolete class files
12 years ago
b1dc9a6f52
- disable Jetty servlet defaultUseCache (prevent double caching)
...
- include short memory status check for class cache in DefaultServlet
- remove obsolete Resource interface for Jetty8YaCyDefaultServlet
12 years ago
f111f30ace
Merge origin/master into jetty
12 years ago
94293176a3
use writeOptionHeaders with ServletResponse parameter only
12 years ago
ff86cb683f
fixed some XSS bugs reported by Marius from http://ctf365.com/
12 years ago
da33ee0d77
extended also timeout fr webgraph postprocessing
12 years ago
74f9e40747
extended timeout during postprocessing of 30 minutes.
12 years ago
19a051bec8
more monitoring for postprocessing and enhanced layout in Crawler
...
monitor page
12 years ago
9cf9727685
fix for wrong counter
12 years ago
fceac8cffd
more monitoring for postprocessing
12 years ago
6842783761
fixed and enhanced postprocessing
12 years ago
219d5934a4
fixed termination bug in Solr Connector
12 years ago
bf1bdd52a6
prevent requesting of 0-facets (which actually exist)
12 years ago
9d5895f643
enhanced and fixed postprocessing
12 years ago
f86fe90eda
enhanced mass storage speed to remote solr servers
12 years ago
6ed9821209
fixed several problems in solr connectors
12 years ago
191fd3d7e7
added an optimization option to HandleSet mass data storage structure
12 years ago
94b565ea0d
fixed keepalive min value
12 years ago
b26787dc2d
- DefaultServlet: remove static gzip option
...
YaCy doesn't use pre-gzip'ed static html pages
- ProxyServlet: remove not neede procedure
- Server init: skip one overlaping servlet context
12 years ago
24a052ecb9
removed debug code for existsByIds
12 years ago
087df05e24
added option to Config_Network_p.html to enable remote search while
...
DHT-Receive is switched off.
12 years ago
1a4a69c226
set more logger to 'final static'
12 years ago
c60947360d
logger should be static
12 years ago
69b8d61c47
fix for search requests in GSA interface which contain 'funny'
...
characters (like ':' etc.)
12 years ago
b085cb522b
replaced old existsByIds for embedded Solr with obviously much faster
...
new selection method (including stil existing debug code to test that
this is in fact better)
12 years ago
b29d262e70
implement Jetty8HttpServerImpl.generateSocketAddress
...
(code 1:1 copied from serverCore)
12 years ago
4234b0ed6c
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
909bbb49d8
added (partly commented) test code for url rewrite methods .. to be
...
completed
12 years ago
066a1ecf0a
add highlight queryparams to solrservlet if missing
...
- modify query params in Solr parameter map (instead of querystring)
12 years ago
899e7e92b0
added debug code
12 years ago
4684330505
Merge origin/master into jetty
...
Conflicts:
source/net/yacy/cora/federate/solr/responsewriter/HTMLResponseWriter.java
12 years ago
1437c45383
merge rc1/master
12 years ago
87a956e881
calculating and showing the number of files and the average size of a
...
file in the HTCACHE in ConfigHTCache_p.html
12 years ago
acc1f8a749
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
81d9e23532
fixed another memory leak in the PDF parser:
...
the class org.apache.pdfbox.pdmodel.font.PDFont occupies 8MB of space
which cannot be cleaned if PDFont.clearResources is called.
The attempt to clean the class cache therefore causes that the class is
loaded and this cache is initialized with some rubbish. I tried to
prevent to instantiate this class by usage of a hacked findLoadedClass
call to the SystemClassLoader (which is protected ...).
Now, without using the PDF parser at all, 8MB of RAM space is not
occupied, however, when the first PDF arrives this space will be taked
and never given back to GC.
WAKE UP YOU LAZY PDFBOX HACKER AND FIX THIS SHIT!
12 years ago
c152d996e6
reduced footprint of BookmarksDB which can take quite a lot of memory if
...
the number of bookmarks is high (i.e. > 2000 URLs)
12 years ago
81bb50118e
found and fixed a huge memory leak in solr caching (inside Solr). The
...
not-flushed Solr cache is now handled in this way:
- it is smaller by default
- an Solr-internal process is started to flush the cache periodically
(this does NOT clean the cache, just removes old objects)
- a Solr-external process (the standard YaCy cleanup-process) now has
direct access to the solr internal cache and flushes them completely.
The time frame for such a flush is defined by the cleanup-process
frequency, by default 10 minutes.
12 years ago
7b17cdf6dd
add content_type:image/* to image search
...
- see numerous idx entries with content_type image without url_file_ext_s (for various reason) which should be included in result
- try it yourself with following sample query
/solr/select?q=content_type:image/* AND -url_file_ext_s:[* TO *]&defType=edismax&fl=sku,url_file_ext_s,content_type
adresses also possible url without or deviating extension.
12 years ago
082c9a98c1
move writeHeaders from Jetty8 servlet to YaCyDefaultServlet
...
- after removing Jetty server dependency (of Response using HttpServletResponse only)
12 years ago
987f410011
URL-export:add query and fix for cast-class-exception
12 years ago
a8253ca49c
added missing unicode transformation in href link contents during
...
parsing
12 years ago
0cf9e9580b
added clickdepth and CR computation debug code to verify that the
...
process is complete
12 years ago
b85f702f22
add AccessTracker logging to SolrServlet
12 years ago
de1f02420b
implement HtmlResponseWriter to solrServlet (and rss / opensearch responswriter) as in yacy select servlet.
...
- set contenttype of HTLM/GrepHTML-Reponsewriter to "text/html"
- set a contenttype to GSAsearchServlet
12 years ago
234a974955
load image only if their parser flag is activated
12 years ago
b2c329929f
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
60187a4ec2
fix in html parser
12 years ago
e1c1e57877
less overhead calling exist() with only one hash
12 years ago
3d5d366f1c
fix html header in Solr HTMLResponseWriter
...
- move 1st body content after </head> tag
- add closing <span> tag
12 years ago
bfdb404867
implement a Jetty reconnect to work with Configbasic_p.html port change
...
- instead of shutting down the server it should be sufficient to manipulate the Jetty http connector
12 years ago
reger