Commit Graph

214 Commits (f57b60cd60493a3545d3703c7f3deb704cb5da68)

Author SHA1 Message Date
theli f57b60cd60 *) Correcting Problems with htmlFilterContentScraper.java
20 years ago
orbiter b79070b471 fixed proxy/scraper
20 years ago
orbiter 419f8fb398 fixed bugs/missing code regarding new crawl stack
20 years ago
orbiter 112c5d3332 the new file-based indexing queue
20 years ago
orbiter 858cd94299 replaced indexing ram-queue by file-based stack-queue
20 years ago
allo a31029c5de == as separator
20 years ago
allo 9f0f45bcae Warning: this is untested.
20 years ago
theli 57c30f1d78 *) bugfix for usage of httpc without gzip content encoding
20 years ago
theli 0e2c33ee55 *) Network.html/Network.java:
20 years ago
orbiter 5159a090b0 fixed parser bug with lowercase force (appeared in: http://spellbound.sourceforge.net/)
20 years ago
orbiter 7f7cbc5019 fixed bug with snippets
20 years ago
orbiter 3607159a9a fixed connection of out-dated peers
20 years ago
orbiter fbef7fed81 adopted latestVersion to float handling
20 years ago
orbiter eb74fa0c82 fixed a bug with snippet-length
20 years ago
orbiter ec8a5ad060 fixed base implementation (verified with www.burningboard.net/archive/index.html)
20 years ago
orbiter 1d3cfb380a experimental implementation of base parsing in html parser
20 years ago
orbiter 86f2aa8478 fixed seed-load date bug (evaluating server date for age computation)
20 years ago
orbiter 664bceced5 removed debug-lines
20 years ago
orbiter 75ebdbc852 enhanced snippet-generation (case where snippet is too long)
20 years ago
allo bef3aaec38 better Translationsystem.
20 years ago
orbiter 8a4f297324 fixed/enhanced snippet error-handling; suppression of results where no snippet exists
20 years ago
orbiter 712fe9ef18 bugfixed utf-8 decoding and parser
20 years ago
allo 82d78fdab7 new Implementation and basic bbCode(Ok, opnly one Command ...)
20 years ago
allo a60f5efcd6 rename
20 years ago
theli 6e97f70549 *) httpd.java: improved errorhandling
20 years ago
theli 9d8c66fb5e *) adding possibility to forward received yacy-messages (htroot/yacy/message.java)
20 years ago
theli 08e4334c1d *) Status.java: showing amount of time since last upload of seed-file
20 years ago
theli eee6322aaf *) Adding redirection support to plasmaCrawlWorker.java
20 years ago
theli cd279907c0 *) Adding redirection support to plasmaCrawlWorker.java
20 years ago
theli 6697d5e52e *) correcting fkt. mediaExtContains
20 years ago
low012 a333715ffd This changes eliminate a way to cripple Message pages on other peers by sending special messages with HTML tags. (See forum for details.)
20 years ago
orbiter abba8fe61b fixed utf-8 decoding in htmlFilterAbstractScraper and removed httpd timing
20 years ago
orbiter 3addf58046 enhanced snippet-loading with threads
20 years ago
orbiter 4afcf10158 added kelondroHashtable (not finished yet)
20 years ago
orbiter 56d28a16f0 bugfixes
20 years ago
orbiter d6c85228a6 enhanced snippet computation
20 years ago
theli d53b2393e5 *) autoconfig.java: ip address was not reported correctly when port-forwardin is on
20 years ago
theli fafda068f9 *) allowing crawler to process resources with statuscode 203
20 years ago
theli aae9a433a6 *) correcting usage of supportedFileExt-List
20 years ago
orbiter 1e7f062350 many bugfixes, memory leak fixes, performance enhancements; new kelondroHashtable; activated snippets
20 years ago
orbiter 68dc2b0c6b added kelondroArray, the basis for upcoming kelondroHash and some bug fixes
20 years ago
orbiter 5728cdf8b5 bugfix
20 years ago
orbiter a19541e563 code-enhancements after analysis with AppPerfect
20 years ago
theli 0e48177ad8 *) Bugfix of NullPointerException when sending Error Respond
20 years ago
theli bf78e0a6a4 *) Bugfix of Socket closed Exception
20 years ago
orbiter 85075269a6 extended fail-safe memory-managament. prevents too much allocation, too often GC and should help for the 100%CPU-bug
20 years ago
orbiter e3c92818db avoiding OutOfMemoryError routines
20 years ago
orbiter 3e8ee5a46d enhanced caching in kelondroRecords and added better synchronization/finalizer
20 years ago
orbiter 3be98f194d tried to find the socket bug
20 years ago
theli dff937a9a3 *) Adding some logging statements to detect problems with seed upload functionality
20 years ago