Michael Peter Christen
efeb592661
don't do solr optimization, this create high IO load. We should leave
...
this task to solr to do that on it's own instead of forcing it.
8 years ago
Michael Peter Christen
103a8348b3
fix for NPE and small performance enhancement
8 years ago
reger
2910fe35c1
add missing scheduler calc of next exec_date (call of calculateAPIScheduler)
...
- after last_exec_date is altered, next_exec_date should be recalculated
- makes the recalculation of next_exec in advance (without api call surely made) in Switchbard.schedulerJob() obsolete
Slightly modify next_exec calc. on missed event to now+schedule_time (from fix 10min)
8 years ago
reger
70d47ae38a
keep scheduler selection by repeat entry from 07311020d4
...
to allow exec schedule on actual exec event.
Iterate on exec date (of advantage after interruption/shutdown) to schedule
older or missed events first.
8 years ago
reger
7c3f932e5d
revert due to conflict with double count recording by schedulter / servlet by the commit under normal operation (no shutdown)
8 years ago
reger
07311020d4
postpone apicall exec date init until actual call
...
fix for http://mantis.tokeek.de/view.php?id=677
The difference is on scheduling a large number of rss feeds and loading
is not finished before shutdown of YaCy. The change makes sure not already
loaded RSS will be loaded by the scheduler on next startup.
8 years ago
reger
5e335b32da
fix Blacklist.contains() matching path pattern to string
...
similar to 5e9e871192
+ add proof testcase
8 years ago
reger
5e9e871192
fix Blacklist.remove by using pattern.toString to find pattern to remove,
...
parameter String path did never equal Pattern.
+ delete unused removeAll, as it does not persist changes after restart
8 years ago
reger
1843ea7e69
on Blacklist.add pattern to source file also update internal entry maps
...
as in Blacklist.add(blacklistType) to make entry effective w/o restart
fix for http://mantis.tokeek.de/view.php?id=676
8 years ago
reger
bf6ce33da3
Correct use of _htDocsPath config in YaCyDefaultServlet to use servlet config variable
...
+ add some javadoc and remove a not useful static declaration
8 years ago
reger
fcad2d0744
add uses of config constant INDEX_RECEIVE_ALLOW
8 years ago
reger
07fbb737df
upd to commons-compress-1.12
8 years ago
reger
226f81cfcf
declare poison pill url MultiProtocolURL() as protected to make sure not
...
used from outside.
After double checking use of poison url revert path init from commit
f8632ad292
8 years ago
reger
f8632ad292
prevent string index out of bounds MultiProtocolURL.getPaths
...
as path maybe a empty string
+ init path to "" also in init for poison url (to guarantee success for
all existing uses of path w/o check for null)
8 years ago
reger
35a7d57260
update lucenematchversion to current (5.2.0 -> 5.5.0)
...
there should be no need for reindex by the update
8 years ago
Marc Nause
1f7013a1e3
removed unused properties in default config (CGI capabilities of YaCy's
...
HTTPd have been removed many moons ago)
8 years ago
reger
9b07bbf955
deprecate newurl(), not used and already replaced
...
instead of making it handle all supported the protocols
8 years ago
reger
774b3906a9
fix GenericFormatter.parse ("time","timeoffset")
...
change: UTC offset internally expected in minutes
8 years ago
reger
27163af0e1
improve detection of referenced links by taking http and https link protocol
...
into account
+ correct query start detection of commit f89d4eb51d
8 years ago
reger
aed44e31ca
fix fr.lng typo in submenuRanking.template
8 years ago
reger
f89d4eb51d
fix MultiProtocolURL init (assign of host) for urls with '/' in query part
...
+ add to test case
8 years ago
reger
163d0cc3cf
correct renamed ConfigAdvanced_p.html -> ConfigProperties_p.html in fr and sk.lng
8 years ago
Burkhard
929147b16f
Merge pull request #62 from luccioman/french_translation
...
Updated french translation for some pages
8 years ago
reger
87fcfc6d78
Adjusted hash computation and toNormalform for file:// protocol to deliver
...
same hash same file on Windows filesystem path with forward- and backslash in path.
Background see http://mantis.tokeek.de/view.php?id=671
+Test case
8 years ago
luccioman
31941f1a5e
Updated french translation for some pages
...
Used Translator_p.html editor and updated french translation for the 8
first files displayed in the combobox.
8 years ago
reger
f0f38a4a94
put Autocrawl_p.html to master.lng.xlf
8 years ago
reger
41d845285d
add missing text for ConfigBasic.html to master.lng.xlf
8 years ago
reger
a952787712
adjust opensearchdescription to return url with protocol it was call on
...
fix http://mantis.tokeek.de/view.php?id=669
8 years ago
reger
360b38d9b6
fix CookieTest_p parameter from ResponseHeader to RequestHeader
8 years ago
reger
3811184abd
fix GSA servlet clientIP retrival
8 years ago
reger
7ab41d4ff1
use directories original lastmodified date in file- & smbloader in response
8 years ago
reger
708bcbb042
one more replacement to use cached hosthash vs. calculated
8 years ago
reger
7b226afc33
fix HostQueueTest - changed open parameter
8 years ago
reger
22db449f2a
to prevent crawler to concurrently access and alter same crawl queue
...
after restart, put hosthash in queue's filename (which is used as primary
key for crawl queue. Hint: initial hosthash from url and recalculated hosthash
from just hostname:port are not the same.
fixes http://mantis.tokeek.de/view.php?id=668 (partially)
8 years ago
reger
2cc4e56010
upd to Solr 5.5.2
8 years ago
Orbiter
50c5ddf1a1
Merge pull request #56 from luccioman/LibreJS
...
LibreJS compliance : YaCy JavaScript license information
8 years ago
Orbiter
c9ec0d0311
Merge pull request #55 from luccioman/docker
...
Improve Docker image security, size and reliability
8 years ago
Orbiter
82f40aefb5
Merge pull request #47 from reelsense/patch-2
...
Distilled sentence - ConfigNetwork_p
8 years ago
Michael Peter Christen
9175e92cd4
new development cycle
8 years ago
Michael Peter Christen
bb8d03bdac
release 1.90
8 years ago
Michael Peter Christen
634e48309b
another peer list update
8 years ago
Michael Peter Christen
7466d390b2
small refactoring + do not accept too old peers during bootstrap
8 years ago
reger
fcc29c36f0
test case for HostBalancer issue in intranet mode
...
with file:// protocol, 2 hostqueues accessing same cache file concurrently
http://mantis.tokeek.de/view.php?id=668
Reason seems to be diff. hosthash key of hostqueues on reopen.
Internal queue key and external representation (directoryname currently hostname.port) must be adjusted to fix it (not done yet).
8 years ago
Michael Peter Christen
16420e5507
added another principal peer
8 years ago
luccioman
fc958230c4
Added instructions for log control and upgrade
8 years ago
luccioman
adc657004d
Merge remote-tracking branch 'origin/master' into docker
8 years ago
reger
8d58a48029
remove wrong log line in CrawlSwitchboard
...
+ don't allow CrawlSwitchboard to exit application
making network param unused
8 years ago
reger
7bac756720
prevent dealing with -UNRESOLVED_PATTERN- eventID parameter in html includes
...
on first landing on search page
8 years ago
reger
900ec17d1a
add de hint translation for CrawlStartScanner_p
...
rem missing translation line in other lng
9 years ago
reger
5aaa057c65
ignore empty input lines in FileUtils.getListArray() to poka joke blacklist read.
...
equalizes behavior with getListString()
improves: case were blacklist file contained a undesired empty line, not
fixed by blacklist-cleaner.
9 years ago