Commit Graph

2908 Commits (94d3d3a86fb170a4cc4088b326d03cae5b58efb2)

Author SHA1 Message Date
danielr 94d3d3a86f fixed Proxy (for GET, POST still does not work!)
17 years ago
danielr 081ed1d3ec HTTPLoader: reduced stackTraces
17 years ago
danielr 8b2efb6f8c fixed garbage in HTCACHE
17 years ago
orbiter 225f9fd429 various fixes
17 years ago
orbiter 6e36c156e8 added more logging to EcoFS
17 years ago
danielr fb541f9162 HTTPC: default timeout half-hour
17 years ago
danielr a94f6cdca4 HTTPC: allowed self-signed certs
17 years ago
danielr ab330cfdca Network.html: removed ; from location
17 years ago
orbiter 319144f4b2 fix for outofbounds-excception in EcoFS chunk iterator
17 years ago
orbiter a9cf6cf2f4 generalization of index container-heap class.
17 years ago
orbiter f099061944 protection against bad dht-flush word selection
17 years ago
orbiter 5e4fddc1e6 more logging for new EcoFS.ChunkIterator to find bug for
17 years ago
orbiter 117ae78001 speed enhancement for reading of eco-table indexes
17 years ago
danielr 7c149a4ee8 - undo less 'binary data found'
17 years ago
danielr 96cce8bed9 reduced 'Binary data found' errors
17 years ago
danielr 2aef1414f5 removed test (in yacy.init)
17 years ago
danielr 5c3c1fdf41 replaced httpc with Apache Jakarta Commons HttpClient (includes some refactoring ;)
17 years ago
orbiter daa04f5db9 added additional check in file handler to prevent that url attacks are hidden in url path encodings
17 years ago
orbiter 783a4c9edb strong speed enhancements for the index cache dump and restore:
17 years ago
orbiter 442204a1c8 fix for concurrentModificationException
17 years ago
orbiter d2f4926951 - more logging for balancer to get a hint where the problem is
17 years ago
orbiter 20dadba426 - added a deadlock prevention function in cache flushing
17 years ago
orbiter 764a40e37d speed enhancements for crawler and url retrieval (affects also search speed)
17 years ago
orbiter 3ce3a4a3a1 added stub for new index container heap data structure (purpose: index folding)
17 years ago
orbiter 2c34038912 addition/correction to last commit: usage of concurrent-classes
17 years ago
orbiter b2150057d2 removed unnecessary cleanup method
17 years ago
lulabad c4c0d54b22 * added regex extended blacklistengine
17 years ago
orbiter 368593e449 enhanced the concurrency handling of indexing process (better queue size control, better data concept, better shutdown behavior)
17 years ago
orbiter be58135b3e possible fix for deadlock in search execution
17 years ago
orbiter 0241d070bc added concurrency to indexing process:
17 years ago
lulabad 9fb5d661f2 added my Blacklistengines
17 years ago
orbiter bca87f1e38 - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads
17 years ago
orbiter 968c775025 - preparation of parsing/indexing queue for concurrent execution
17 years ago
orbiter 9b0e20fb06 next refactoring step in document indexing to prepare concurrency environment for document parsing
17 years ago
orbiter 7f9f639d20 - refactoring and abstraction of index reference (urls) handling: blacklisting is part of reference filtering
17 years ago
orbiter d6050b9ffb - separated the LURL data storage and Crawl result stack for process supervision.
17 years ago
orbiter 8d6a13bc07 refactoring of parsing-condensing-indexing process:
17 years ago
orbiter d3b06913ec protection against seed-db failure during enumeration
17 years ago
orbiter 5aa96dbc36 fix for shutdown configuration
17 years ago
orbiter 93633abed8 - removed some debugging code from search process - should speed up now
17 years ago
orbiter fba46c51d7 fixed non-termination bug in qsort
17 years ago
orbiter 541b817502 refactoring of switchboard queueing
17 years ago
orbiter fc94fbe224 another improvement to the collection sorting
17 years ago
orbiter 11270d450e better quicksort-pivot computation: 30% faster (measured with test program)
17 years ago
orbiter 3e44293f07 - fixed a problem with thread pools in row collection
17 years ago
danielr e43051b125 - fixed Threaddump output (html-escaped ie. <init>)
17 years ago
orbiter 433ff855f7 - fixed another concurrency problem in collection sorting
17 years ago
orbiter 19286fa2d1 tried to fix seed2.old.db-problem
17 years ago
orbiter f3996e63b8 tried to fix more deadlocks:
17 years ago
danielr 7008a218b3 avoid ConcurrentModificationException in plasmaCrawlerQueues
17 years ago