5c9dcc269d
improve OAI-PMH import identifier recognition
...
- find best fittng identifier (url) by checking all given dc:identifier in record (many entries proviede several identifiers)
as identifier is currently a multivalued field use "getParams" in preference of splitting the 1st string by ";"
- add resolve DOI:... identifier via http://dx.doi.org/
11 years ago
0e7d249a69
fixed another shutdown problem (only occurs if webgraph core is enabled)
11 years ago
e485fbd0ce
- let crawl loader jobs die after 10 seconds without new jobs
...
- corrected shutdown order t prevent a deadlock during shutdown
11 years ago
0792a4369c
Added Index Deletion and Reindex Monitor to German translation
11 years ago
bcd9dd9e1d
enhanced concurrent loading by using a fixed set of concurrent loader
...
processes in favor of throwaway-processes. The control mechanism does
less often report a 'queue full' message to the busy loop which then
does not perform a long busy waiting; instead all requests are queued
and new loader processes are started if necessary up to a given limit
(as set before)
11 years ago
d8f7f47eff
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
aec3ab1315
Update russian translation
11 years ago
c7ea0f123b
Added German translation for Config Search and Ranking RWI and Solr
11 years ago
051328271c
bugfix-bugfix
11 years ago
eedcbcd906
bugfix to proxy handler: recognize the own yacyh-host
11 years ago
d68e5ad0c4
NPE fix for Thread name (just commited yesterday, sorry)
11 years ago
a2e1f104f6
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
6878c90f99
fix: IPv6 INTRANET_PATTERNS for local ip (see http://bugs.yacy.net/view.php?id=378 )
...
requiring following ":" for fc and fd prefix and made pattern match case insesitive
- add some more ipv6 test cases to MultiProtocolURLTest.java
11 years ago
61e51d47a5
fix: unused / incorrect default username parameter
...
(removed setting)
11 years ago
fed354c0e2
Update russian translation
11 years ago
9dc0aa2b01
German translation for Augmented Browser, Parser, Content Control and Vocabulary
11 years ago
a87aef83b4
Improved Image Collage and WatchWebStructure page display with CSS changes
11 years ago
0813f5f82e
Added German translation for AccessGrid_p.html, CrawlCheck_p.html, RegexTest.html and env/templates/submenuTargetAnalysis.template
11 years ago
a2e5ea2026
status panel link to set max mem
...
+url proxy same error text as in transparent
11 years ago
e9877028c6
update russian translation
11 years ago
6ed9c0164e
attaching names to all Threads to get a better view in profiling tools
...
like VisualVM
11 years ago
fdaeac374a
- enhanced postprocessing speed and memory footprint (by using HashMaps
...
instead of TreeMaps)
- enhanced memory footprint of database indexes (by introduction of
optimize calls)
- optimize calls shrink the amount of used memory for index sets if they
are not changed afterwards any more
11 years ago
1245cfeb43
small change to crawler monitor to fit in larger translations
11 years ago
ba49ff81ed
little more verbose proxy 403 error message
11 years ago
d325cb8912
fixes and enhancements for postprocessing
11 years ago
7c1b968378
another fix for the shutdown exceptions
11 years ago
133d41386c
(again) full redesign of ConcurrentUpdateSolrConnector to remove
...
out-of-order transactions regarding add and delete operations. Now all
operations (add and delete) are executed concurrently in-order.
11 years ago
1960aafd6c
better height for statistic windows
11 years ago
b0e3e2100d
better width for Progress table
11 years ago
d2f7ce27a7
fix for switch back to localhost (why did this not work? it worked all
...
the time)
11 years ago
c8d437b69a
clean up test sources
...
rename to current package names and move to default location
11 years ago
d346520ed6
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
9afd7db043
bump to httpclient-4.3.3
11 years ago
65170474a1
Updated German translation with translated submenu include env/templates/submenuComputation.template
11 years ago
003e9a4041
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
11 years ago
a632b0d2a4
added a forced commit to index deletion to enable synchronized index
...
updates
11 years ago
1d069c5861
make sure that postprocessed documents are overwritten
11 years ago
9c41527e9c
Merge branch 'master' of gitorious.org:yacy/icewindxs-rc1
11 years ago
29a7598991
update russian lang-file and small improve web-interface
11 years ago
ee732bdc03
fix: de translation of menu link
11 years ago
0d2342575e
Merge branch 'master' of ssh://gitorious.org/yacy/rc1
11 years ago
3cc5c0ffdd
a concurrency enhancement which was not used because tests showed worse
...
indexing speed. I leave the code there since it may be useful in
SolrCloud environments.
11 years ago
e644981697
added one more postprocessing low memory check
11 years ago
1bbc0fe6d2
added a properties file format for the status_p api to support reading
...
of that information with the java Properties class (very easy for small
clients)
11 years ago
e40511f307
extended the status_p api with disk space information
11 years ago
5e645f4449
Merge origin/master
11 years ago
3b89176b9f
use config value htroot in Jetty init (was hardcoded)
...
- move htroot exist check from old httpdfilehandler to startup, remove from filehandler and legacy proxyhandler
- use SwitchboardConstant.htroot where appropriate
11 years ago
e1bf65c892
added short memory protection during postprocessing
11 years ago
90b47e83e6
fixed shutdown error when closing solr connectors
11 years ago
7640834b37
removed double concurrency to put Solr documents into the index. The
...
writings to the solr index are also buffered in
ConcurrentUpdateSolrConnector
11 years ago
reger