Commit Graph

2294 Commits (9d13aeca13bb808f93abf15665ad131b2d47d12c)
 

Author SHA1 Message Date
theli 9d13aeca13 *) removing class. does not work so far
19 years ago
theli 95a84ae469 *) adding missing classes
19 years ago
theli eee44be602 *) adding an interface for customized blacklist classes
19 years ago
orbiter 6d2f15971a there is a very strange error that causes that the kelondroRecords structure
19 years ago
theli 79f27c298e *) next bugfix for blacklist
19 years ago
theli 4abc04dac0 *) make Blacklist_p.html more failsafe if no blacklist file is available of the user has entered empty strings
19 years ago
theli 28c84e5b57 *) Bugfix for NullPointerException in Blacklist_p if blacklist directory is empty
19 years ago
theli 66f1eb07d9 *) Bugfix for IllegalArgumentException in transferURL
19 years ago
(no author) 1cab72c93c small changes reflecting the de.lng version
19 years ago
theli d2e8e76218 *) now it's possible to configure the yacy blacklist separately for dht, search, proxy, crawler
19 years ago
orbiter 9ae9062bd3 * disabled new kelondroFlex table for NURLs
19 years ago
orbiter 689bbcf9cd replaced kelondroTree db for NURLs by new kelondroFlexTable
19 years ago
orbiter 7fbba41962 synchronization fixes
19 years ago
orbiter 328f9859a5 more synchronization in plasmaWordIndex
19 years ago
orbiter f43c90fa98 fixed handling of null referer in crawlOrder
19 years ago
rramthun 23a99b8283 Small changes to the language
19 years ago
orbiter 130e6d4719 generalized index object for eurl, nurl and lurl to prepare move
19 years ago
orbiter acdf24877f more synchronization against outOfMemoryError in wordIndex
19 years ago
orbiter 95160d7f2c fixed size computation of index elements from the collection index
19 years ago
orbiter 26116cabde added missing rowdef assignment
19 years ago
orbiter cfbacbbf08 reverted change in robotsParser
19 years ago
orbiter abf22f6e60 removed url normalform computation from htmlFilterContentScraper.
19 years ago
orbiter 740d49751d * strict type and size check in kelondroRow handling
19 years ago
orbiter 314021453f * more logging
19 years ago
allo a52f36787f better templatedebugging
19 years ago
allo cbfba2026d removing the prefix option.
19 years ago
allo 3480d36417 added some debug code
19 years ago
orbiter 61b151b083 * added another auto-fix for collection index inconsitency check
19 years ago
orbiter 0bbbd129ef small fix for exception message
19 years ago
orbiter 718fbc2dae enhancements in kelondroCollectionIndex:
19 years ago
orbiter ec5149ff3b fix for busyCacheFlush detection
19 years ago
orbiter f58283def2 better control of index flush
19 years ago
orbiter 4be21a3cab ups
19 years ago
orbiter 80b6c90d54 enhancements to prevent blocking during dht transfer receive
19 years ago
auron_x 4fb8fddd99 *)made the domainlist of the blacklist sorted
19 years ago
theli 9f298083cd *) adding more urls to the error url
19 years ago
hermens d56f06401e - Cache known URLs during indexReceive to avoid getting blocked during loadedURL.exists() whenever possible
19 years ago
theli c09f734d06 *) offer router configuration on ConfigBasic.html
19 years ago
hermens dcbb4d0a6b Display the size of HashBlacklistedCache on PerformanceMemory page.
19 years ago
theli c7b6389ca1 *) renaming indexDistribution.dhtReceiptLimitEnabled property to indexDistribution.transferRWIReceiptLimitEnabled
19 years ago
theli 0baadcadca *) enable indexDistribution.dhtReceiptLimitEnabled limit per default
19 years ago
orbiter d799622da1 better flush limit for index collections
19 years ago
orbiter d468d665c9 some changes that may help to prevent deadlocks that cause an OutOfMemoryError
19 years ago
theli 988341cf81 *) some comments added
19 years ago
theli d54767f634 *) last step of removing embedded html from dir class
19 years ago
rramthun 96b774e427 Adding link to newsletters as agreed in forum.
19 years ago
theli 8283df2d77 *) first step of removing embedded html from dir class
19 years ago
orbiter 279b1d969d Integrated new indexing data structure 'collections' into the main class
19 years ago
orbiter 4ff742e42d implemented indexCollectionRI
19 years ago
allo 132cd7da45 no need to copy dir.*
19 years ago