ebde21079a
refactor xlsParser to include Excel file attribute (like author) in parser result doc.
...
Similar to ppt and doc parser, completing a TODO in xlsParser.
9 years ago
dd9ee1d34c
Merge pull request #66 from luccioman/opensearch
...
Opensearch : fix for default ports and naming consistency
9 years ago
c9868209e4
Fixed opensearch ShortName consistency with link in index.html
...
Fix for mantis 679 (http://mantis.tokeek.de/view.php?id=679 )
9 years ago
744c9a2615
Opensearch desc : handle https protocol url with default port (443)
...
This completes modifications made for mantis 669
(http://mantis.tokeek.de/view.php?id=669 )
9 years ago
103a8348b3
fix for NPE and small performance enhancement
9 years ago
2910fe35c1
add missing scheduler calc of next exec_date (call of calculateAPIScheduler)
...
- after last_exec_date is altered, next_exec_date should be recalculated
- makes the recalculation of next_exec in advance (without api call surely made) in Switchbard.schedulerJob() obsolete
Slightly modify next_exec calc. on missed event to now+schedule_time (from fix 10min)
9 years ago
70d47ae38a
keep scheduler selection by repeat entry from 07311020d4
...
to allow exec schedule on actual exec event.
Iterate on exec date (of advantage after interruption/shutdown) to schedule
older or missed events first.
9 years ago
7c3f932e5d
revert due to conflict with double count recording by schedulter / servlet by the commit under normal operation (no shutdown)
9 years ago
07311020d4
postpone apicall exec date init until actual call
...
fix for http://mantis.tokeek.de/view.php?id=677
The difference is on scheduling a large number of rss feeds and loading
is not finished before shutdown of YaCy. The change makes sure not already
loaded RSS will be loaded by the scheduler on next startup.
9 years ago
5e335b32da
fix Blacklist.contains() matching path pattern to string
...
similar to 5e9e871192
9 years ago
5e9e871192
fix Blacklist.remove by using pattern.toString to find pattern to remove,
...
parameter String path did never equal Pattern.
+ delete unused removeAll, as it does not persist changes after restart
9 years ago
1843ea7e69
on Blacklist.add pattern to source file also update internal entry maps
...
as in Blacklist.add(blacklistType) to make entry effective w/o restart
fix for http://mantis.tokeek.de/view.php?id=676
9 years ago
bf6ce33da3
Correct use of _htDocsPath config in YaCyDefaultServlet to use servlet config variable
...
+ add some javadoc and remove a not useful static declaration
9 years ago
fcad2d0744
add uses of config constant INDEX_RECEIVE_ALLOW
9 years ago
07fbb737df
upd to commons-compress-1.12
9 years ago
226f81cfcf
declare poison pill url MultiProtocolURL() as protected to make sure not
...
used from outside.
After double checking use of poison url revert path init from commit
f8632ad292
9 years ago
f8632ad292
prevent string index out of bounds MultiProtocolURL.getPaths
...
as path maybe a empty string
+ init path to "" also in init for poison url (to guarantee success for
all existing uses of path w/o check for null)
9 years ago
35a7d57260
update lucenematchversion to current (5.2.0 -> 5.5.0)
...
there should be no need for reindex by the update
9 years ago
1f7013a1e3
removed unused properties in default config (CGI capabilities of YaCy's
...
HTTPd have been removed many moons ago)
9 years ago
9b07bbf955
deprecate newurl(), not used and already replaced
...
instead of making it handle all supported the protocols
9 years ago
774b3906a9
fix GenericFormatter.parse ("time","timeoffset")
...
change: UTC offset internally expected in minutes
9 years ago
27163af0e1
improve detection of referenced links by taking http and https link protocol
...
into account
+ correct query start detection of commit f89d4eb51d
9 years ago
aed44e31ca
fix fr.lng typo in submenuRanking.template
9 years ago
f89d4eb51d
fix MultiProtocolURL init (assign of host) for urls with '/' in query part
...
+ add to test case
9 years ago
163d0cc3cf
correct renamed ConfigAdvanced_p.html -> ConfigProperties_p.html in fr and sk.lng
9 years ago
929147b16f
Merge pull request #62 from luccioman/french_translation
...
Updated french translation for some pages
9 years ago
87fcfc6d78
Adjusted hash computation and toNormalform for file:// protocol to deliver
...
same hash same file on Windows filesystem path with forward- and backslash in path.
Background see http://mantis.tokeek.de/view.php?id=671
+Test case
9 years ago
31941f1a5e
Updated french translation for some pages
...
Used Translator_p.html editor and updated french translation for the 8
first files displayed in the combobox.
9 years ago
f0f38a4a94
put Autocrawl_p.html to master.lng.xlf
9 years ago
41d845285d
add missing text for ConfigBasic.html to master.lng.xlf
9 years ago
a952787712
adjust opensearchdescription to return url with protocol it was call on
...
fix http://mantis.tokeek.de/view.php?id=669
9 years ago
360b38d9b6
fix CookieTest_p parameter from ResponseHeader to RequestHeader
9 years ago
3811184abd
fix GSA servlet clientIP retrival
9 years ago
7ab41d4ff1
use directories original lastmodified date in file- & smbloader in response
9 years ago
708bcbb042
one more replacement to use cached hosthash vs. calculated
9 years ago
7b226afc33
fix HostQueueTest - changed open parameter
9 years ago
22db449f2a
to prevent crawler to concurrently access and alter same crawl queue
...
after restart, put hosthash in queue's filename (which is used as primary
key for crawl queue. Hint: initial hosthash from url and recalculated hosthash
from just hostname:port are not the same.
fixes http://mantis.tokeek.de/view.php?id=668 (partially)
9 years ago
2cc4e56010
upd to Solr 5.5.2
9 years ago
50c5ddf1a1
Merge pull request #56 from luccioman/LibreJS
...
LibreJS compliance : YaCy JavaScript license information
9 years ago
c9ec0d0311
Merge pull request #55 from luccioman/docker
...
Improve Docker image security, size and reliability
9 years ago
82f40aefb5
Merge pull request #47 from reelsense/patch-2
...
Distilled sentence - ConfigNetwork_p
9 years ago
9175e92cd4
new development cycle
9 years ago
bb8d03bdac
release 1.90
9 years ago
634e48309b
another peer list update
9 years ago
7466d390b2
small refactoring + do not accept too old peers during bootstrap
9 years ago
fcc29c36f0
test case for HostBalancer issue in intranet mode
...
with file:// protocol, 2 hostqueues accessing same cache file concurrently
http://mantis.tokeek.de/view.php?id=668
Reason seems to be diff. hosthash key of hostqueues on reopen.
Internal queue key and external representation (directoryname currently hostname.port) must be adjusted to fix it (not done yet).
9 years ago
16420e5507
added another principal peer
9 years ago
fc958230c4
Added instructions for log control and upgrade
9 years ago
adc657004d
Merge remote-tracking branch 'origin/master' into docker
9 years ago
8d58a48029
remove wrong log line in CrawlSwitchboard
...
+ don't allow CrawlSwitchboard to exit application
making network param unused
9 years ago
reger