Commit Graph

673 Commits (8194fde3409a0841bc29df63b40a6388923285eb)

Author SHA1 Message Date
theli dff96601fe *) Bugfix for transferURL:
19 years ago
theli beefddf0e8 *) Adding option which allows to do a Index-Transfer without deletion of index
19 years ago
rramthun 4036ee812a Updated german language file
19 years ago
theli 40925f4fb7 *) Improving complete index transfer performance by automatically increasing size of transfered word chunk
19 years ago
theli 91ab4d044b *) Adding automatic retry functionality to complete index transfer function
19 years ago
theli a62677f761 *) Adding additional logging output for complete index transfer
19 years ago
rramthun 10e7d6f02b Bugfix for http://www.yacy-forum.de/viewtopic.php?t=1053
19 years ago
theli b991d2e7dd *) Additional logging message for complete index transfer
19 years ago
theli 3c00c5f6c7 *) Complete Index Transfer
19 years ago
theli f783061414 *) Changing redirection code from 307 to 302
19 years ago
theli a6a8af0f04 *) httpdFileHandler templateCache can now be disabled
19 years ago
theli 2cb084d426 *) Complete Index Transfer
19 years ago
theli d1de71e9f6 *) Suppress stacktrace on proxy error for "No route to host Exception"
19 years ago
theli 56160cbd01 *) Bugfix for "YaCy verzählt sich ..." Bug.
19 years ago
orbiter 43b42854a0 fix for null-entries and http://www.yacy-forum.de/viewtopic.php?p=8649
19 years ago
borg-0300 801e902795 small change
19 years ago
theli 019cc716db *) Undoing last changes on yacySeed. Seems not to work properly.
19 years ago
theli 177e8af5b7 *) Bugfix for ConcurrentModification in kelondroAbstractRA.writeMap caused by yacySeed.getMap()
19 years ago
theli d3c923e6b9 *) Bugfix for "ConcurrentModificationException in hello.class"
19 years ago
rramthun 02c242ae22 minor changes
19 years ago
theli 44b36d087e *) Implementing a Cache for the servelet template files (.html)
19 years ago
theli 394b4440d2 *) adding isLoggable function to serverLog class
19 years ago
theli 73ded2f0b6 *) Trying to fix bug for Seed-Upload-Failed
19 years ago
theli 3587407039 *) Fixing problems of list operation if index and queue size are both 0.
19 years ago
theli 51b48a10e8 *) Suppress stacktrace on proxy error for "ValidatorException: No trusted certificate found"
19 years ago
theli 7809b382bf *) Bugfix for Blacklist support for https (only initial connect)
19 years ago
theli 7fe8784231 *) URLs pointing to a server having a private ip addess will not be indexed anymore
19 years ago
rramthun 7c86c36210 undoing one part of the last commit. do not know, why it didn't work...
19 years ago
rramthun a79913c6ea updated german language file
19 years ago
borg-0300 718950c5da small change
19 years ago
theli 0aafb83edc *) Bugfix for robots.txt isDisallowed Check.
19 years ago
theli 2cd695f376 *) Bugfix path-entries of robots.txt were not decoded correctly
19 years ago
borg-0300 8260128ee9 changed getFreeSize();
19 years ago
theli f8ad65eae1 *) First trial implementation of robots.txt support
19 years ago
theli 9444852896 *) Correcting problems if the port number was set to -1, e.g. because of the usage of function
19 years ago
borg-0300 0a57fbcde5 Added new HashSet filesInUse;
19 years ago
borg-0300 8cd6a52dd0 Convention
19 years ago
borg-0300 c0e3d18bbf *) remove import java.lang
19 years ago
borg-0300 b1cd1fa917 cleaned
19 years ago
borg-0300 da9c6857fb *) changed a misunderstand, no BUG ;)
19 years ago
borg-0300 fbac053c03 small change
19 years ago
theli 578f36ae18 *) Speedup of indexer. Proxy files will not be enqueued by the cachemanager
19 years ago
theli 1219ef99f0 *) Bugfix for NullpointerException in yacyDebugMode Init
19 years ago
allo 9300689dde bugfix *gr*
19 years ago
theli e09f1fe8e4 *) IfsL: Suppressing stacktraces on further proxy errors
19 years ago
theli 6c722706b7 *) Moving yacyDebugMode intialization to switchboard
19 years ago
allo ebc39a7b9a minor fixes
19 years ago
low012 e19ededd66 *) prevents problems due to HTML code in profiles (my posting from 05.Sep.2005 http://www.yacy-forum.de/viewtopic.php?t=964)
19 years ago
theli 4e07828807 *) httpdProxyHandler.java
19 years ago
allo f90f699ab1 missing package line.
19 years ago
low012 89d7c6e45e *) Bugfix: offset of 1 prevented correct replacement of HTML
19 years ago
theli a7256e8f4e *) Adding X-Forwarded-For Header
19 years ago
allo 06a451768f a simple robotsParser.
19 years ago
borg-0300 81cb8feb15 back to 649 :/
19 years ago
borg-0300 5194511e8e *) attempt to find bug
19 years ago
theli 8f3d19b331 *) Suppress stacktrace on proxy error for "Connection reset"
19 years ago
theli 6991b9e2b9 *) Suppress stacktrace on crawler error for "Connection reset"
19 years ago
theli a20814291f *) Bugfix for "Race condition zwischen httpc und switchboard"
19 years ago
theli 286853fd39 *) Bugfix for "YACY hängt sich beim Beenden auf" Bug
19 years ago
theli a47f9238fe *) Blacklist is now also used by the crawler
19 years ago
theli dc0a2d4c11 *) Bugfix for Loader Queue:
19 years ago
theli 732a107160 *) Bugfix for "-UNRESOLVED_PATTERN-" Bug on IndexCreateWWWLocalQueue_p.html and "urlEntry.url() == null" Bug
19 years ago
theli 33aaffbfc6 *) Displaying content size of each entry in indexing queue
19 years ago
allo 022c1ab179 performance fix for yacyDebugMode and useYacyReferer.
19 years ago
allo 286442fbc5 do not Use YaCy-Sites as Referer, if useYacyReferer = false
19 years ago
theli f9eb550fbc *) Bugfix for NullpointerException in serverAbstractSwitch.setConfig
19 years ago
borg-0300 7626823519 BUGFIX for last 'commit'
19 years ago
borg-0300 971756e8dd the delete size is smaller
19 years ago
theli 0471019606 *) IndexCreateIndexingQueue_p.html now also shows indexing jobs that are currently in process
19 years ago
theli 3dc6845bef *) Logging error message to logging output if no errormessage can be send to the user by the proxy
19 years ago
borg-0300 6d43a4970c small changes
19 years ago
theli 3df5c7a6cf *) Displaying an proxy error page instead of a white page if the server has closed
19 years ago
borg-0300 cc493ef8c1 Added change from Hermes
19 years ago
theli 4edb5b6f1e *) Bugfix for "ProxyAccess logging" Bug
19 years ago
theli 7a7254713d *) Moving Logging directory per default to DATA/LOG
19 years ago
theli bead8a32aa *) IndexCreate_p.java:
19 years ago
theli 48aaf703cc *) Adding additional logging output to detect crawling problems
19 years ago
theli 59b8a98c7e *) Bugfix for suppressing of stacktrace in log on crawler error "MalformedURLException"
19 years ago
low012 2ee4f9f4e5 *) added escape characters [= and =] to yacyWiki
19 years ago
borg-0300 c1d7527929 better cache cleanup
19 years ago
theli 2e6df95786 *) adding toString method
19 years ago
theli ebbd063c92 *) Making mimeTable static final
19 years ago
theli 60e77dcc60 *) Adding additional loglevel finer + finest according to Thread http://www.yacy-forum.de/viewtopic.php?p=8750#8750
19 years ago
borg-0300 fa54b5f38d cleanup spaces
19 years ago
theli 4fd5b95b1f *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
19 years ago
theli 6adf8a4bde *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
19 years ago
theli f19c09b227 *) Suppress stacktrace on crawler error for "MalformedURLException"
19 years ago
theli cc1df08069 *) Adding missing synchronized blocks
19 years ago
theli 0dfa8b62e2 *) Changing Proxy-Useragent string according to thread http://www.yacy-forum.de/viewtopic.php?p=8183#8183
19 years ago
borg-0300 bf14e6def5 *) proxyCache, proxyCacheSize can be changed under 'Proxy Indexing'
19 years ago
theli 3dfda1c9da *) More verbose output on ftp-seed-upload failure
19 years ago
theli e3aa3a2d75 *) Bugfix for ProxyAccess Logger
19 years ago
theli 9b818b1ce3 *) Pausing Crawlers if there is not enough space on disk
19 years ago
theli b33094e925 *) Trying to solve "Too many open files bug"
19 years ago
theli b67f008eb8 *) Trying to solve "Too many open files bug"
19 years ago
theli 34790acf02 *) Bugfix for suppressing of stacktrace in log on crawler error "unknown host"
19 years ago
theli a812fb86cc *) Port Forwarding Feature does not detect broken connection properly.
19 years ago
theli af7b8f75bd *) Making proxyAccessLogging configureable via yacy.logging file
19 years ago
theli 8132a44305 *) Better error handling if yacy SOAP extension is not installed
19 years ago
allo 66ebce1109 use staticIP more often
19 years ago
theli 2a081c9ee5 *) Adding additional logging message for "NURL.entry() == null" Bug
19 years ago
theli cb1f11c96b *) Suppress stacktrace on crawler error for "Unknown Host"
19 years ago
theli e338a13de3 *) Suppress stacktrace on crawler error for "Read timed out"
20 years ago
theli 2e43e744de *) Suppress stacktrace on crawler error for "connect timed out"
20 years ago
theli 36cbe04e3e *) Bugfix for Crawler Redirection Bug
20 years ago
theli b70de495a0 *) Remembering Crawler-isPaused setting
20 years ago
theli e569a84dc0 *) Using the same configuration settings for all indexing threads on server Startup
20 years ago
theli 17be77a468 *) Bugfix for "Crawler data will not be removed from htcache if content parsing failed"
20 years ago
theli 858cb983d7 *) Printout date and system name on proxy error page
20 years ago
theli 4a2f06053f *) Bugfix for "Gehäuselautsprecher" Bug
20 years ago
theli dc7c5237fb *) Bugfix for "Gehäuselautsprecher" Bug
20 years ago
theli 5f55dff297 *) Bugfix for "Binäre Nullen auf der page: Index Creation: Indexing Queue"
20 years ago
theli cb97d2972e *) Bugfix for "peer not accessible via .yacy name if Transparent Proxy Support is enabled" bug
20 years ago
allo 60074b4301 more DebugMode(60 Secs Timeout)
20 years ago
allo eb6365c069 local Bootstrapping bug.
20 years ago
theli 330eae7cf3 *) Normalizing CrawlerStartURL now before crawling is started
20 years ago
theli ab894d26bc *) Bugfix for "plasmaSwitchboard.deQueue: null" Bug (hopefully)
20 years ago
theli eaf9f26cc3 *) Bugfix for NULL PROFILE HANDLE 'null' Bug:
20 years ago
rramthun 0864ea367d Added preformated changelog.txt
20 years ago
allo 41aa3ae72e provide a virtuell Headerfield IS_ADMIN.
20 years ago
rramthun 4cb382decb Adding changes by borg-0300 from http://www.yacy-forum.de/viewtopic.php?t=997
20 years ago
low012 ecfdc4928a *) better implementation of definition lists
20 years ago
rramthun 26289e955c Updates of the language file
20 years ago
theli 0d0bc02f38 *) Printing stacktrace into log on seed-upload error
20 years ago
theli 115c4edfcc *) Adding additional logging statements to help debugging seed-upload problems
20 years ago
theli 751a778b54 *) Bugfix for heise newsletter Problem
20 years ago
theli 7d8af6b41a *) Bugfix for heise newsletter Problem
20 years ago
theli 4335bfe822 *) Using timeout also to establish a connection
20 years ago
low012 36dfb9f686 implemented citings (blockquote) and an early version of definitions (not much of a list yet)
20 years ago
theli ec4c70d722 *) If there are at most 10 entries left while doing an index transfer, these entries will also be appended
20 years ago
theli d4a045d7b1 *) Trying to solve "de.anomic.plasma.plasmaSwitchboard.deQueue': null" Bug
20 years ago
theli ea9a992f05 *) Before the crawler retries to download a URL it checks if the server is already doing a shutdown
20 years ago
theli ea26b84eed *) Bugfix for http://www.yacy-forum.de/viewtopic.php?t=954
20 years ago
theli 0c8a48e2cb *) converting php Session ID to lower case in funktion isCGI
20 years ago
orbiter e616395c3b latest changes and cut for 0.40
20 years ago
orbiter c47bb1182d bugfix for assortment initialization error
20 years ago
theli 4654eae4e2 *) adding php Session ID to argument in funktion isCGI
20 years ago
theli 8c62fb49ba *) Bugfix for httpdSoapHandler Initialisation.
20 years ago
orbiter 25f632dbd9 more DHT bugfixes and better logging of DHT effects
20 years ago
orbiter 5cb00889d9 enhancements to dht selection, search and search presentation
20 years ago
orbiter ba0a486328 moved printStackTrace() to logging
20 years ago
orbiter 3094045d34 fix for http://www.yacy-forum.de/viewtopic.php?p=7454#7454
20 years ago
orbiter 8d6c288f04 display of peer name in headline; see http://www.yacy-forum.de/viewtopic.php?p=7466#7466
20 years ago
orbiter cd10370992 several bugfixes and dht selection / logging improvement
20 years ago
orbiter 3610fe6b3a see http://www.yacy-forum.de/viewtopic.php?p=7410#7410
20 years ago
orbiter c8a7a85ce2 fix for http://www.yacy-forum.de/viewtopic.php?p=7384#7384
20 years ago
orbiter 98b028038c bugfix, see http://www.yacy-forum.de/viewtopic.php?p=7370#7370
20 years ago
orbiter 6594541ef5 fix for http://www.yacy-forum.de/viewtopic.php?p=7361#7361
20 years ago
orbiter 7db543a9fa fixes for several dht misbehaviours
20 years ago
rramthun 20002b6386 Added Regex tutorial to Help.html, because many people don't understand Regex.
20 years ago
orbiter 5716f8521d bug fixes for word ordering and dht index selection
20 years ago
orbiter f5259f29e8 word cache behaviour fix and other fixes
20 years ago
allo a223faace1 not recursive, but it should work on Windows.
20 years ago
orbiter c796a38424 doc update
20 years ago
jerri fa154e6ce5 Added some more javadoc into httpc.java. Moved the inner class response to the
20 years ago
allo 5d511d651e fix for Windows
20 years ago
orbiter 2c234e1b82 better log output for search result
20 years ago
theli 89c9faa89e *) More graceful logging output in crawler
20 years ago
orbiter 248c24b60a intermission-feature usage in case of local and remote search
20 years ago
orbiter 6be19d76c9 preparation for intermission feature (pausing all threads, i.e. for search requests)
20 years ago
allo ee0a9a2d9b recursive Translations.
20 years ago
theli b32e7c516c git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@507 6c8d7289-2bf4-0310-a012-ef5d649a1542
20 years ago
orbiter 60eaf3dcde fix for notifer.gif appearance
20 years ago
orbiter ec07928807 faster listing and news aging enhancement
20 years ago
allo 53dcbadfbf using Wikicode instream of bbCode
20 years ago
jerri 09193023fe Began with some documentation for the httpc-class. The code of the httpc-class
20 years ago
jerri 7792e5ae9b Added an build-target to the ant-configuration to create the
20 years ago
rramthun 1eadbc6b91 Modified build.xml to include Win9x scripts
20 years ago
allo 8659a689f4 seperate Class for the wikiParser
20 years ago
allo 7665712faa fix for altenativeTemplates by Index
20 years ago
allo 3762acde6e alternatives By Name
20 years ago
theli 86305f051d *) Trying to solve "java.net.BindException: Address already in use: JVM_Bind" Problem
20 years ago
theli 865b9490a2 *) Making DHT Transfer while Crawling configurable
20 years ago
theli 1d83d7e4d7 *) httpdFileHandler.java:
20 years ago
theli e6aced0162 *) Setting higher priority for session threads
20 years ago
orbiter 2dd2533e6d cut for 0.394
20 years ago
orbiter 2d8557cb10 minor changes
20 years ago
orbiter 91163db52e fix for more time-related problems in proxy
20 years ago
orbiter fb6f238d70 fix for expires-problem
20 years ago
jerri 3334546340 Started the quest for in-source documentation with javadoc.
20 years ago
rramthun eacff63eda Typos...
20 years ago
orbiter 40da910f41 bugfixes and automatic news-cleanup
20 years ago
theli 228b04b499 *) Bugfix for "wrong seed-upload timestamp" problem
20 years ago
theli 470839a16a *) Crawler/Session pool settings will now be stored properly into configfile
20 years ago
orbiter 4377e119f3 bugfix for http://www.yacy-forum.de/viewtopic.php?p=6620#6620
20 years ago
orbiter e84a177c49 many bigfixes
20 years ago
orbiter 9ee8a5ba6c fixed big in yacynews
20 years ago
orbiter 083c8ddc69 new alert symbols
20 years ago
orbiter 7e3e9ba0de fix for http://www.yacy-forum.de/viewtopic.php?p=6563#6563
20 years ago
orbiter bcc292ad12 added self-news; added news in case of wiki update; added crawl announcement on Network page
20 years ago
orbiter cc38c5e77b bugfix for wiki key-length
20 years ago
orbiter d34eb23e4e fixed news; added news appearance on Network and IndexCreate page; added intention string to global crawl
20 years ago
orbiter 5672709ef3 several bugfixes for YaCyNews
20 years ago
allo 2013d031e5 better Logging
20 years ago
orbiter e24dbde217 better logging for WRONG seed
20 years ago
orbiter 1022fbeb65 many YaCyNews fixes
20 years ago
orbiter 13abd8b6e7 added news-creation at crawl start
20 years ago
rramthun f555b9d5f2 Translation, spelling...
20 years ago
orbiter 849b194149 fixed news receipt and added processing buttons on News page
20 years ago
orbiter 84b74d40f3 yacyNews bugfix
20 years ago
orbiter 60117a2073 integrated YaCyNews basis
20 years ago
orbiter b8e294f149 corrected wrong default peer-names
20 years ago
orbiter cdbbfd50fb fixed bad remote crawl behavior
20 years ago
orbiter f32d8bdfa8 fixed DHT cache memory assignment
20 years ago
orbiter f663f26cfd catch of another IOException
20 years ago
orbiter 36707586c7 filtering of jsessionid
20 years ago
rramthun 6f2f54a312 Translation, spelling...
20 years ago
allo 0a68aa6999 translate the last file, too
20 years ago
orbiter 81e564edb8 faster crawl profile list cleanup
20 years ago
orbiter 85877413a0 tried to fix principal bug .. not succeeded
20 years ago
orbiter ad90f0ad13 activated RWI distribution to DHT for senior peers (default redundancy 3), necessary now for network growth
20 years ago
orbiter b9d18d40cb configuration of proxy idle time in performance menue
20 years ago
orbiter 3470a72d48 fixed div by zero, set default delays, fixed release number format and display
20 years ago
rramthun bf7d5d1310 Usage of logging-class
20 years ago
orbiter af67c633d5 doc-changes and more strict brute-force handling
20 years ago
rramthun fe62a38896 minor fixes to the translation
20 years ago
orbiter be1f324fca performance setting for remote indexing configuration and latest changes for 0.39
20 years ago
rramthun 69afae514d Updated translations...
20 years ago
orbiter c64970fa47 re-implemented proxy-busy-check and fixed some other things
20 years ago
allo 98d22a73ef "File: foo.html"
20 years ago
orbiter 86d778f7bc default-button in profile menue
20 years ago
orbiter b73557ed2d better assortment monitoring and enhanced profile menue
20 years ago
orbiter 1f36bf4dae enhanced assortment capacity; added extended WORDS migration
20 years ago
allo e6c381a2e2 Translationfile Division for different files
20 years ago
rramthun 0f11399d16 Some corrections...
20 years ago
orbiter 9f505af7aa preparations for bulk remote crawls
20 years ago
orbiter 0f663bcebf added global ppm computation
20 years ago
orbiter 9c72b4cdec replaced index dump stack by an dump array and limited url number in assortment ram (prevents too much RAM occupation)
20 years ago
orbiter 51962d55bf added 'PPM', page-per-minute statistics
20 years ago
orbiter 159f795f65 bugfix (null pointer exception in assortments)
20 years ago
orbiter 1d2155675b changed assortment memory cache flush
20 years ago
orbiter 19dbed7cc8 code clean-up
20 years ago
orbiter 00f63ea00d fail-save patch for pattern matching
20 years ago
orbiter 0a6be961ea added pattern organization
20 years ago
orbiter 40036ba69c fixed dht transmission; added url-blacklist blocking also for remote search
20 years ago
orbiter 311e627363 blocking of blacklisted urls in indexReceive and small changes
20 years ago
orbiter 2f0d7ea8d3 removed htcache stati (superfluous now)
20 years ago
orbiter 277048501e bugfix
20 years ago
orbiter 8b89c46afe fixed problem with cache write
20 years ago
orbiter 455ae9f55f fixed htcache-store problem and due-time for remote crawls
20 years ago
theli 55d10b864c *) further improvements in shutdown behaviour
20 years ago
theli 96386d6fc6 *) further improvements in shutdown behaviour
20 years ago
theli 0b95c9c434 *) Bugfix for Thread.getID() usagage + PeerPing-Shutdown Deadlock
20 years ago
theli 13eeaa08f3 *) httpc.java:
20 years ago
theli f57b60cd60 *) Correcting Problems with htmlFilterContentScraper.java
20 years ago
orbiter b79070b471 fixed proxy/scraper
20 years ago
orbiter 419f8fb398 fixed bugs/missing code regarding new crawl stack
20 years ago
orbiter 112c5d3332 the new file-based indexing queue
20 years ago
orbiter 858cd94299 replaced indexing ram-queue by file-based stack-queue
20 years ago
allo a31029c5de == as separator
20 years ago