Commit Graph

594 Commits (93c1cb9226b117ca67dbb93229c4a2bda130a903)

Author SHA1 Message Date
orbiter dc474aa22f various bug-fixes
20 years ago
orbiter 9e2fc7e5fe load balancing of crawl target domains
20 years ago
orbiter 3fcc95a82c integrated crawl-profiles db in memory-performance monitor
20 years ago
orbiter 72ce36baba cleanup in kelondroRecords
20 years ago
theli fe6a6abc0b *) Adding robots.txt db to Performance Settings for Memory menue
20 years ago
orbiter 3274ae725e increased cache size of robots database; however, this should be integrated into new memory control
20 years ago
orbiter c6d2f50375 changed order of robots and double-check
20 years ago
orbiter 68d5ff2ef1 added stringbuffer in condenser
20 years ago
theli 90f02ea455 *) removing metainfo from serverargs
20 years ago
theli 70a5681a4f *) Bugfix for inactive scp seed uploader
20 years ago
orbiter e380d4e55e cleanup (no functional change)
20 years ago
orbiter de0a58d79c no more sync
20 years ago
orbiter 495bc8bec6 removed cache-control from low and medium priority caches which reduces memory use and computation overhead
20 years ago
theli 1dc94e7753 *) Adding support for gzip content-encoding of http post requests
20 years ago
borg-0300 a1f5027a88 finals;
20 years ago
orbiter 979a3ee3c0 exceptions for better testing of bug http://www.yacy-forum.de/viewtopic.php?p=9852#9852
20 years ago
orbiter 18d9e1a256 fix for http://www.yacy-forum.de/viewtopic.php?p=10026#10026
20 years ago
borg-0300 1dd7047af5 finals;
20 years ago
orbiter ef85fce661 change of memory-consumption constants (had been much too low)
20 years ago
orbiter 07f30931ec various configuration options in memory performance
20 years ago
orbiter 2f732e32a2 enhancements to memory menue
20 years ago
orbiter e17df64b54 removed IS_ADMIN - feature. This was covered by plasmaSwitchborad.adminAuthenticated
20 years ago
orbiter 96a5b6e8fb removed yacy peer types from serverSwitch
20 years ago
theli b990dc1ad1 *) Replacing jsch 0.1.19 lib with newer version 0.1.21
20 years ago
borg-0300 6d1de8abfd finals; cleaned;
20 years ago
orbiter af9021e956 fixed bug with news caching
20 years ago
orbiter 14bc880fa4 fixed bug with crashed profile database
20 years ago
orbiter 71a31f0902 integrated and extended new memory performance menu; found and fixed bug in DHT caching
20 years ago
orbiter fb52a82008 added new performance page for memory settings
20 years ago
rramthun 9dfbd93c7b Updated german language file
20 years ago
orbiter e6b30911c3 small changes to caching
20 years ago
borg-0300 42cd2cea65 added final constants, so that other class can reach it;
20 years ago
orbiter 900ab97422 change of memory-allocation blocking value for GC prevention
20 years ago
orbiter 0ffca99886 added priority-organization to kelondroRecord cache. This should virtually double the cache capacity.
20 years ago
orbiter 2d22626386 automatic switch-off of cache control in kelondroRecords in case that cache is big enough (so that no cache-aging needs to be controled)
20 years ago
orbiter 50a9500035 fixed 100% CPU bug with news queue deletion
20 years ago
orbiter cddd9aaa33 fixed SERIOUS bug with kelondroStack; affected all stack processing since 729
20 years ago
orbiter 416c126815 fix for a profile = null problem and new monitor in crawl queue
20 years ago
orbiter 19547f1821 changed node manipulation methods in kelondro core to reduce object allocation
20 years ago
orbiter debb207a74 removed file sync
20 years ago
orbiter 2148c0cf49 replaced kelondro storage core; much less objects in kelondro cache now; less IO from DB
20 years ago
theli dff96601fe *) Bugfix for transferURL:
20 years ago
theli beefddf0e8 *) Adding option which allows to do a Index-Transfer without deletion of index
20 years ago
rramthun 4036ee812a Updated german language file
20 years ago
theli 40925f4fb7 *) Improving complete index transfer performance by automatically increasing size of transfered word chunk
20 years ago
theli 91ab4d044b *) Adding automatic retry functionality to complete index transfer function
20 years ago
theli a62677f761 *) Adding additional logging output for complete index transfer
20 years ago
rramthun 10e7d6f02b Bugfix for http://www.yacy-forum.de/viewtopic.php?t=1053
20 years ago
theli b991d2e7dd *) Additional logging message for complete index transfer
20 years ago
theli 3c00c5f6c7 *) Complete Index Transfer
20 years ago
theli f783061414 *) Changing redirection code from 307 to 302
20 years ago
theli a6a8af0f04 *) httpdFileHandler templateCache can now be disabled
20 years ago
theli 2cb084d426 *) Complete Index Transfer
20 years ago
theli d1de71e9f6 *) Suppress stacktrace on proxy error for "No route to host Exception"
20 years ago
theli 56160cbd01 *) Bugfix for "YaCy verzählt sich ..." Bug.
20 years ago
orbiter 43b42854a0 fix for null-entries and http://www.yacy-forum.de/viewtopic.php?p=8649
20 years ago
borg-0300 801e902795 small change
20 years ago
theli 019cc716db *) Undoing last changes on yacySeed. Seems not to work properly.
20 years ago
theli 177e8af5b7 *) Bugfix for ConcurrentModification in kelondroAbstractRA.writeMap caused by yacySeed.getMap()
20 years ago
theli d3c923e6b9 *) Bugfix for "ConcurrentModificationException in hello.class"
20 years ago
rramthun 02c242ae22 minor changes
20 years ago
theli 44b36d087e *) Implementing a Cache for the servelet template files (.html)
20 years ago
theli 394b4440d2 *) adding isLoggable function to serverLog class
20 years ago
theli 73ded2f0b6 *) Trying to fix bug for Seed-Upload-Failed
20 years ago
theli 3587407039 *) Fixing problems of list operation if index and queue size are both 0.
20 years ago
theli 51b48a10e8 *) Suppress stacktrace on proxy error for "ValidatorException: No trusted certificate found"
20 years ago
theli 7809b382bf *) Bugfix for Blacklist support for https (only initial connect)
20 years ago
theli 7fe8784231 *) URLs pointing to a server having a private ip addess will not be indexed anymore
20 years ago
rramthun 7c86c36210 undoing one part of the last commit. do not know, why it didn't work...
20 years ago
rramthun a79913c6ea updated german language file
20 years ago
borg-0300 718950c5da small change
20 years ago
theli 0aafb83edc *) Bugfix for robots.txt isDisallowed Check.
20 years ago
theli 2cd695f376 *) Bugfix path-entries of robots.txt were not decoded correctly
20 years ago
borg-0300 8260128ee9 changed getFreeSize();
20 years ago
theli f8ad65eae1 *) First trial implementation of robots.txt support
20 years ago
theli 9444852896 *) Correcting problems if the port number was set to -1, e.g. because of the usage of function
20 years ago
borg-0300 0a57fbcde5 Added new HashSet filesInUse;
20 years ago
borg-0300 8cd6a52dd0 Convention
20 years ago
borg-0300 c0e3d18bbf *) remove import java.lang
20 years ago
borg-0300 b1cd1fa917 cleaned
20 years ago
borg-0300 da9c6857fb *) changed a misunderstand, no BUG ;)
20 years ago
borg-0300 fbac053c03 small change
20 years ago
theli 578f36ae18 *) Speedup of indexer. Proxy files will not be enqueued by the cachemanager
20 years ago
theli 1219ef99f0 *) Bugfix for NullpointerException in yacyDebugMode Init
20 years ago
allo 9300689dde bugfix *gr*
20 years ago
theli e09f1fe8e4 *) IfsL: Suppressing stacktraces on further proxy errors
20 years ago
theli 6c722706b7 *) Moving yacyDebugMode intialization to switchboard
20 years ago
allo ebc39a7b9a minor fixes
20 years ago
low012 e19ededd66 *) prevents problems due to HTML code in profiles (my posting from 05.Sep.2005 http://www.yacy-forum.de/viewtopic.php?t=964)
20 years ago
theli 4e07828807 *) httpdProxyHandler.java
20 years ago
allo f90f699ab1 missing package line.
20 years ago
low012 89d7c6e45e *) Bugfix: offset of 1 prevented correct replacement of HTML
20 years ago
theli a7256e8f4e *) Adding X-Forwarded-For Header
20 years ago
allo 06a451768f a simple robotsParser.
20 years ago
borg-0300 81cb8feb15 back to 649 :/
20 years ago
borg-0300 5194511e8e *) attempt to find bug
20 years ago
theli 8f3d19b331 *) Suppress stacktrace on proxy error for "Connection reset"
20 years ago
theli 6991b9e2b9 *) Suppress stacktrace on crawler error for "Connection reset"
20 years ago
theli a20814291f *) Bugfix for "Race condition zwischen httpc und switchboard"
20 years ago
theli 286853fd39 *) Bugfix for "YACY hängt sich beim Beenden auf" Bug
20 years ago
theli a47f9238fe *) Blacklist is now also used by the crawler
20 years ago
theli dc0a2d4c11 *) Bugfix for Loader Queue:
20 years ago
theli 732a107160 *) Bugfix for "-UNRESOLVED_PATTERN-" Bug on IndexCreateWWWLocalQueue_p.html and "urlEntry.url() == null" Bug
20 years ago
theli 33aaffbfc6 *) Displaying content size of each entry in indexing queue
20 years ago
allo 022c1ab179 performance fix for yacyDebugMode and useYacyReferer.
20 years ago
allo 286442fbc5 do not Use YaCy-Sites as Referer, if useYacyReferer = false
20 years ago
theli f9eb550fbc *) Bugfix for NullpointerException in serverAbstractSwitch.setConfig
20 years ago
borg-0300 7626823519 BUGFIX for last 'commit'
20 years ago
borg-0300 971756e8dd the delete size is smaller
20 years ago
theli 0471019606 *) IndexCreateIndexingQueue_p.html now also shows indexing jobs that are currently in process
20 years ago
theli 3dc6845bef *) Logging error message to logging output if no errormessage can be send to the user by the proxy
20 years ago
theli 3df5c7a6cf *) Displaying an proxy error page instead of a white page if the server has closed
20 years ago
borg-0300 cc493ef8c1 Added change from Hermes
20 years ago
theli 4edb5b6f1e *) Bugfix for "ProxyAccess logging" Bug
20 years ago
theli 7a7254713d *) Moving Logging directory per default to DATA/LOG
20 years ago
theli bead8a32aa *) IndexCreate_p.java:
20 years ago
theli 48aaf703cc *) Adding additional logging output to detect crawling problems
20 years ago
theli 59b8a98c7e *) Bugfix for suppressing of stacktrace in log on crawler error "MalformedURLException"
20 years ago
low012 2ee4f9f4e5 *) added escape characters [= and =] to yacyWiki
20 years ago
borg-0300 c1d7527929 better cache cleanup
20 years ago
theli 2e6df95786 *) adding toString method
20 years ago
theli ebbd063c92 *) Making mimeTable static final
20 years ago
theli 60e77dcc60 *) Adding additional loglevel finer + finest according to Thread http://www.yacy-forum.de/viewtopic.php?p=8750#8750
20 years ago
borg-0300 fa54b5f38d cleanup spaces
20 years ago
theli 4fd5b95b1f *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
20 years ago
theli 6adf8a4bde *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
20 years ago
theli f19c09b227 *) Suppress stacktrace on crawler error for "MalformedURLException"
20 years ago
theli cc1df08069 *) Adding missing synchronized blocks
20 years ago
theli 0dfa8b62e2 *) Changing Proxy-Useragent string according to thread http://www.yacy-forum.de/viewtopic.php?p=8183#8183
20 years ago
borg-0300 bf14e6def5 *) proxyCache, proxyCacheSize can be changed under 'Proxy Indexing'
20 years ago
theli 3dfda1c9da *) More verbose output on ftp-seed-upload failure
20 years ago
theli e3aa3a2d75 *) Bugfix for ProxyAccess Logger
20 years ago
theli 9b818b1ce3 *) Pausing Crawlers if there is not enough space on disk
20 years ago
theli b33094e925 *) Trying to solve "Too many open files bug"
20 years ago
theli b67f008eb8 *) Trying to solve "Too many open files bug"
20 years ago
theli 34790acf02 *) Bugfix for suppressing of stacktrace in log on crawler error "unknown host"
20 years ago
theli a812fb86cc *) Port Forwarding Feature does not detect broken connection properly.
20 years ago
theli af7b8f75bd *) Making proxyAccessLogging configureable via yacy.logging file
20 years ago
theli 8132a44305 *) Better error handling if yacy SOAP extension is not installed
20 years ago
allo 66ebce1109 use staticIP more often
20 years ago
theli 2a081c9ee5 *) Adding additional logging message for "NURL.entry() == null" Bug
20 years ago
theli cb1f11c96b *) Suppress stacktrace on crawler error for "Unknown Host"
20 years ago
theli e338a13de3 *) Suppress stacktrace on crawler error for "Read timed out"
20 years ago
theli 2e43e744de *) Suppress stacktrace on crawler error for "connect timed out"
20 years ago
theli 36cbe04e3e *) Bugfix for Crawler Redirection Bug
20 years ago
theli b70de495a0 *) Remembering Crawler-isPaused setting
20 years ago
theli e569a84dc0 *) Using the same configuration settings for all indexing threads on server Startup
20 years ago
theli 17be77a468 *) Bugfix for "Crawler data will not be removed from htcache if content parsing failed"
20 years ago
theli 858cb983d7 *) Printout date and system name on proxy error page
20 years ago
theli 4a2f06053f *) Bugfix for "Gehäuselautsprecher" Bug
20 years ago