d052bbdfe1
prevent exception on Site Crawl if no start url is given
11 years ago
85a427ec54
support for multiple sitemaps in robots.txt
11 years ago
a373fb717d
remove more unused from legacy server.http
...
- triggerOnlineAction not used
- useTemplateCache not used
11 years ago
749d020aeb
remove redundant url string manipulation in HTTPDProxyHandler
...
(still used by ProxyServlet)
11 years ago
612294cf84
use servletPath in ProxyServlet instead of fixed name
...
to allow servlet-mapping via web.xml
11 years ago
1d01672bd3
fix DCEntry.getIdentifier
...
on successful url parameter
11 years ago
b08375da33
fix for bad/missing values of size_i
11 years ago
6306d28a6a
OAI import get multivalued keywords (dc:subject)
11 years ago
0a8c8102de
allow YaCy to start w/o ssl if JKS init fails
11 years ago
0b2101c59c
Speed up the ProxyHandler:
...
simplified cache-storing and make it concurrent in order to free the
clientconnection asap
let other prozesses wait on proxy-access like it was bevore
11 years ago
8cf4d04ae0
fix for facets in search rss result: some facets had been missing, all
...
had missing url properties
11 years ago
516f8c2489
fix: to allow unix scripts (bin/*.sh) to allways submit http admin apicalls
...
using auth via config hash (legacy requirement)
11 years ago
ea3aa30593
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
dd5bf0b71b
cleanup old reference to HTTPDemon.setAlternativeResolver
...
optimize .yacyh check in AbstractRemoteHandler
11 years ago
51800007c4
- added concurrency to postprocessing of webgraph document
...
- bundeled separate webgraph postprocesing steps into one
11 years ago
5f4a6892c1
enhanced RowSet re-sort limit for small sets
11 years ago
3c92c439ac
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
11 years ago
5b3585da47
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
b1db14b21f
Update russian translation
11 years ago
c97c9ac692
Update russian translation
11 years ago
351c2be68d
fix: make sure adminAccount changes made via ConfigAccounts_p are effective immediately
...
force to remove current credentials from knownuser cache
11 years ago
7c2dc3915f
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
b964f36d90
Update russian translation
11 years ago
f77afa9d1d
add index on _val fields, this affects especially title length
...
an index on fields make search facets on that field possible
11 years ago
c0c177e2bc
Update russian translation
11 years ago
5c9dcc269d
improve OAI-PMH import identifier recognition
...
- find best fittng identifier (url) by checking all given dc:identifier in record (many entries proviede several identifiers)
as identifier is currently a multivalued field use "getParams" in preference of splitting the 1st string by ";"
- add resolve DOI:... identifier via http://dx.doi.org/
11 years ago
0e7d249a69
fixed another shutdown problem (only occurs if webgraph core is enabled)
11 years ago
e485fbd0ce
- let crawl loader jobs die after 10 seconds without new jobs
...
- corrected shutdown order t prevent a deadlock during shutdown
11 years ago
0792a4369c
Added Index Deletion and Reindex Monitor to German translation
11 years ago
bcd9dd9e1d
enhanced concurrent loading by using a fixed set of concurrent loader
...
processes in favor of throwaway-processes. The control mechanism does
less often report a 'queue full' message to the busy loop which then
does not perform a long busy waiting; instead all requests are queued
and new loader processes are started if necessary up to a given limit
(as set before)
11 years ago
d8f7f47eff
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
aec3ab1315
Update russian translation
11 years ago
c7ea0f123b
Added German translation for Config Search and Ranking RWI and Solr
11 years ago
051328271c
bugfix-bugfix
11 years ago
eedcbcd906
bugfix to proxy handler: recognize the own yacyh-host
11 years ago
d68e5ad0c4
NPE fix for Thread name (just commited yesterday, sorry)
11 years ago
a2e1f104f6
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
6878c90f99
fix: IPv6 INTRANET_PATTERNS for local ip (see http://bugs.yacy.net/view.php?id=378 )
...
requiring following ":" for fc and fd prefix and made pattern match case insesitive
- add some more ipv6 test cases to MultiProtocolURLTest.java
11 years ago
61e51d47a5
fix: unused / incorrect default username parameter
...
(removed setting)
11 years ago
fed354c0e2
Update russian translation
11 years ago
9dc0aa2b01
German translation for Augmented Browser, Parser, Content Control and Vocabulary
11 years ago
a87aef83b4
Improved Image Collage and WatchWebStructure page display with CSS changes
11 years ago
0813f5f82e
Added German translation for AccessGrid_p.html, CrawlCheck_p.html, RegexTest.html and env/templates/submenuTargetAnalysis.template
11 years ago
a2e5ea2026
status panel link to set max mem
...
+url proxy same error text as in transparent
11 years ago
e9877028c6
update russian translation
11 years ago
6ed9c0164e
attaching names to all Threads to get a better view in profiling tools
...
like VisualVM
11 years ago
fdaeac374a
- enhanced postprocessing speed and memory footprint (by using HashMaps
...
instead of TreeMaps)
- enhanced memory footprint of database indexes (by introduction of
optimize calls)
- optimize calls shrink the amount of used memory for index sets if they
are not changed afterwards any more
11 years ago
1245cfeb43
small change to crawler monitor to fit in larger translations
11 years ago
ba49ff81ed
little more verbose proxy 403 error message
11 years ago
d325cb8912
fixes and enhancements for postprocessing
11 years ago
reger