Commit Graph

138 Commits (740d49751d1db9c375eb8d01171ce9cb5fd58b7f)

Author SHA1 Message Date
orbiter ec5149ff3b fix for busyCacheFlush detection
19 years ago
orbiter f58283def2 better control of index flush
19 years ago
orbiter 80b6c90d54 enhancements to prevent blocking during dht transfer receive
19 years ago
hermens d56f06401e - Cache known URLs during indexReceive to avoid getting blocked during loadedURL.exists() whenever possible
19 years ago
theli c7b6389ca1 *) renaming indexDistribution.dhtReceiptLimitEnabled property to indexDistribution.transferRWIReceiptLimitEnabled
19 years ago
orbiter 9183d21f25 renamed new index class to old name
19 years ago
orbiter c4e922885a replaced indexURLEntry by new class that uses a kelondroRow.Entry object
19 years ago
orbiter 5f72be2a95 some redesign of EURL storage
19 years ago
orbiter 58df8b7bbf a large collection of different changes
19 years ago
hydrox 8ba8e2b7d9 *) added cache for blacklists urlhashs recieved by DHT. DHT does not request URLs listed in this cache.
19 years ago
hermens 53cbcc6d6e Implement emergency break in index receive when the limit of the ramCache is exceeded by more than cacheLimit
19 years ago
theli b20496e42b *) make DHT DoS check configurable (requested by KoH)
19 years ago
hermens 38a1410361 Don't test a remote peer's seed during hello.respond as its IP might not be proper, especially while still virgin
19 years ago
orbiter 5041d330ce refactoring
19 years ago
orbiter 90d569d70f refactoring of index management:
19 years ago
orbiter a930be4ba3 refactoring of index management:
19 years ago
orbiter 7dd57a3828 added a busy-time estimation at DHT/RWI-Receive
19 years ago
theli fcec40fcc6 *) don't accept messages without subject or payload
19 years ago
orbiter 82b2bc6932 patch for index-transfer DoS problem
19 years ago
orbiter a474669338 start with refactoring of index management
19 years ago
allo 799c04091d Bugfix for Spam-Bug (Header manipulation)
19 years ago
orbiter dbe96e6541 added hand-over of search filter and prefer ranking to yacy protocol
19 years ago
orbiter 00a5d435e2 - fixed some bugs with domain filter
19 years ago
orbiter bd283b8443 fixed bugs:
19 years ago
orbiter 0a4c2e89ed remote crawl orders are now only accepted if sum over all
19 years ago
orbiter 1f4412a146 adopted isListed to discussed new behavior as discussed (url, getFile)
19 years ago
orbiter 3286b1f498 re-organisation of lurl-creation and -stacking
19 years ago
hermens 289da326e5 *) Bugfix: remove blacklisted URL from loadedURL, when received via DHT transfer
19 years ago
rramthun 9f979d4fa5 Domain-lists gzip-compressable and sendable via cr-send/receive
19 years ago
orbiter f188611fc6 apply blacklist on rwis during dht receive
19 years ago
theli 5ee0125046 *) adding possibility to configure the server port for seed uploading via scp.
19 years ago
allo 7afa5c1b8e staticIP fix
19 years ago
theli f108048a2c *) Bugfix for NullpointerException in hello.java
19 years ago
orbiter bae3783d38 added a snippet marking
19 years ago
allo f73d51f94b reverted last change
19 years ago
allo 8997b83806 store the staticIP(dyndns) in seed, not the real IP
19 years ago
allo 7c5f8f997a some more staticIP fixes
19 years ago
orbiter d31a4e0b4f some small enhancements with cache flushing parameters and data structures
19 years ago
hermens 3208fe14ed *) log exceptions in crawlOrder.java to the logfile instead of stdout
19 years ago
orbiter 7eb10675b3 re-organization of index management
19 years ago
theli d0f76fc9bc *) setting logging level for thread pools to info
19 years ago
orbiter fb7411d7bb re-structuring of ranking application:
19 years ago
orbiter d98418390b - introduced rankingProfile Class
19 years ago
allo 1f3eaf9f8e use DATA/HTDOCS for notifier.gif. Works even if htroot is readonly
19 years ago
orbiter fa90c3ca7a - removed some usage of indexEntity
19 years ago
orbiter 03c65742ba changes towards the new index storage scheme:
19 years ago
rramthun 5942f6334c Some language fixes.
19 years ago
orbiter f4ffa9aee5 - implemented more attributes to index entries
19 years ago
borg-0300 c5b6154136 added CRDistOn = true/false
19 years ago
borg-0300 8d8a40c2d9 added properties
19 years ago