Commit Graph

470 Commits (6d1de8abfd793dd55771db2d4fc013663938a7fb)

Author SHA1 Message Date
theli f8ad65eae1 *) First trial implementation of robots.txt support
19 years ago
theli 9444852896 *) Correcting problems if the port number was set to -1, e.g. because of the usage of function
19 years ago
borg-0300 0a57fbcde5 Added new HashSet filesInUse;
19 years ago
borg-0300 8cd6a52dd0 Convention
19 years ago
borg-0300 c0e3d18bbf *) remove import java.lang
19 years ago
borg-0300 b1cd1fa917 cleaned
19 years ago
borg-0300 da9c6857fb *) changed a misunderstand, no BUG ;)
19 years ago
borg-0300 fbac053c03 small change
19 years ago
theli 578f36ae18 *) Speedup of indexer. Proxy files will not be enqueued by the cachemanager
19 years ago
theli 1219ef99f0 *) Bugfix for NullpointerException in yacyDebugMode Init
19 years ago
allo 9300689dde bugfix *gr*
19 years ago
theli e09f1fe8e4 *) IfsL: Suppressing stacktraces on further proxy errors
19 years ago
theli 6c722706b7 *) Moving yacyDebugMode intialization to switchboard
19 years ago
allo ebc39a7b9a minor fixes
19 years ago
low012 e19ededd66 *) prevents problems due to HTML code in profiles (my posting from 05.Sep.2005 http://www.yacy-forum.de/viewtopic.php?t=964)
19 years ago
theli 4e07828807 *) httpdProxyHandler.java
19 years ago
allo f90f699ab1 missing package line.
19 years ago
low012 89d7c6e45e *) Bugfix: offset of 1 prevented correct replacement of HTML
19 years ago
theli a7256e8f4e *) Adding X-Forwarded-For Header
19 years ago
allo 06a451768f a simple robotsParser.
19 years ago
borg-0300 81cb8feb15 back to 649 :/
19 years ago
borg-0300 5194511e8e *) attempt to find bug
19 years ago
theli 8f3d19b331 *) Suppress stacktrace on proxy error for "Connection reset"
19 years ago
theli 6991b9e2b9 *) Suppress stacktrace on crawler error for "Connection reset"
19 years ago
theli a20814291f *) Bugfix for "Race condition zwischen httpc und switchboard"
19 years ago
theli 286853fd39 *) Bugfix for "YACY hängt sich beim Beenden auf" Bug
19 years ago
theli a47f9238fe *) Blacklist is now also used by the crawler
19 years ago
theli dc0a2d4c11 *) Bugfix for Loader Queue:
19 years ago
theli 732a107160 *) Bugfix for "-UNRESOLVED_PATTERN-" Bug on IndexCreateWWWLocalQueue_p.html and "urlEntry.url() == null" Bug
19 years ago
theli 33aaffbfc6 *) Displaying content size of each entry in indexing queue
19 years ago
allo 022c1ab179 performance fix for yacyDebugMode and useYacyReferer.
19 years ago
allo 286442fbc5 do not Use YaCy-Sites as Referer, if useYacyReferer = false
19 years ago
theli f9eb550fbc *) Bugfix for NullpointerException in serverAbstractSwitch.setConfig
19 years ago
borg-0300 7626823519 BUGFIX for last 'commit'
19 years ago
borg-0300 971756e8dd the delete size is smaller
19 years ago
theli 0471019606 *) IndexCreateIndexingQueue_p.html now also shows indexing jobs that are currently in process
19 years ago
theli 3dc6845bef *) Logging error message to logging output if no errormessage can be send to the user by the proxy
19 years ago
theli 3df5c7a6cf *) Displaying an proxy error page instead of a white page if the server has closed
19 years ago
borg-0300 cc493ef8c1 Added change from Hermes
19 years ago
theli 4edb5b6f1e *) Bugfix for "ProxyAccess logging" Bug
19 years ago
theli 7a7254713d *) Moving Logging directory per default to DATA/LOG
19 years ago
theli bead8a32aa *) IndexCreate_p.java:
19 years ago
theli 48aaf703cc *) Adding additional logging output to detect crawling problems
19 years ago
theli 59b8a98c7e *) Bugfix for suppressing of stacktrace in log on crawler error "MalformedURLException"
19 years ago
low012 2ee4f9f4e5 *) added escape characters [= and =] to yacyWiki
19 years ago
borg-0300 c1d7527929 better cache cleanup
19 years ago
theli 2e6df95786 *) adding toString method
19 years ago
theli ebbd063c92 *) Making mimeTable static final
19 years ago
theli 60e77dcc60 *) Adding additional loglevel finer + finest according to Thread http://www.yacy-forum.de/viewtopic.php?p=8750#8750
19 years ago
borg-0300 fa54b5f38d cleanup spaces
19 years ago
theli 4fd5b95b1f *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
19 years ago
theli 6adf8a4bde *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
19 years ago
theli f19c09b227 *) Suppress stacktrace on crawler error for "MalformedURLException"
19 years ago
theli cc1df08069 *) Adding missing synchronized blocks
19 years ago
theli 0dfa8b62e2 *) Changing Proxy-Useragent string according to thread http://www.yacy-forum.de/viewtopic.php?p=8183#8183
19 years ago
borg-0300 bf14e6def5 *) proxyCache, proxyCacheSize can be changed under 'Proxy Indexing'
19 years ago
theli 3dfda1c9da *) More verbose output on ftp-seed-upload failure
19 years ago
theli e3aa3a2d75 *) Bugfix for ProxyAccess Logger
19 years ago
theli 9b818b1ce3 *) Pausing Crawlers if there is not enough space on disk
19 years ago
theli b33094e925 *) Trying to solve "Too many open files bug"
19 years ago
theli b67f008eb8 *) Trying to solve "Too many open files bug"
19 years ago
theli 34790acf02 *) Bugfix for suppressing of stacktrace in log on crawler error "unknown host"
19 years ago
theli a812fb86cc *) Port Forwarding Feature does not detect broken connection properly.
19 years ago
theli af7b8f75bd *) Making proxyAccessLogging configureable via yacy.logging file
19 years ago
theli 8132a44305 *) Better error handling if yacy SOAP extension is not installed
19 years ago
allo 66ebce1109 use staticIP more often
19 years ago
theli 2a081c9ee5 *) Adding additional logging message for "NURL.entry() == null" Bug
20 years ago
theli cb1f11c96b *) Suppress stacktrace on crawler error for "Unknown Host"
20 years ago
theli e338a13de3 *) Suppress stacktrace on crawler error for "Read timed out"
20 years ago
theli 2e43e744de *) Suppress stacktrace on crawler error for "connect timed out"
20 years ago
theli 36cbe04e3e *) Bugfix for Crawler Redirection Bug
20 years ago
theli b70de495a0 *) Remembering Crawler-isPaused setting
20 years ago
theli e569a84dc0 *) Using the same configuration settings for all indexing threads on server Startup
20 years ago
theli 17be77a468 *) Bugfix for "Crawler data will not be removed from htcache if content parsing failed"
20 years ago
theli 858cb983d7 *) Printout date and system name on proxy error page
20 years ago
theli 4a2f06053f *) Bugfix for "Gehäuselautsprecher" Bug
20 years ago
theli dc7c5237fb *) Bugfix for "Gehäuselautsprecher" Bug
20 years ago
theli 5f55dff297 *) Bugfix for "Binäre Nullen auf der page: Index Creation: Indexing Queue"
20 years ago
theli cb97d2972e *) Bugfix for "peer not accessible via .yacy name if Transparent Proxy Support is enabled" bug
20 years ago
allo 60074b4301 more DebugMode(60 Secs Timeout)
20 years ago
allo eb6365c069 local Bootstrapping bug.
20 years ago
theli 330eae7cf3 *) Normalizing CrawlerStartURL now before crawling is started
20 years ago
theli ab894d26bc *) Bugfix for "plasmaSwitchboard.deQueue: null" Bug (hopefully)
20 years ago
theli eaf9f26cc3 *) Bugfix for NULL PROFILE HANDLE 'null' Bug:
20 years ago
rramthun 0864ea367d Added preformated changelog.txt
20 years ago
allo 41aa3ae72e provide a virtuell Headerfield IS_ADMIN.
20 years ago
rramthun 4cb382decb Adding changes by borg-0300 from http://www.yacy-forum.de/viewtopic.php?t=997
20 years ago
low012 ecfdc4928a *) better implementation of definition lists
20 years ago
rramthun 26289e955c Updates of the language file
20 years ago
theli 0d0bc02f38 *) Printing stacktrace into log on seed-upload error
20 years ago
theli 115c4edfcc *) Adding additional logging statements to help debugging seed-upload problems
20 years ago
theli 751a778b54 *) Bugfix for heise newsletter Problem
20 years ago
theli 7d8af6b41a *) Bugfix for heise newsletter Problem
20 years ago
theli 4335bfe822 *) Using timeout also to establish a connection
20 years ago
low012 36dfb9f686 implemented citings (blockquote) and an early version of definitions (not much of a list yet)
20 years ago
theli ec4c70d722 *) If there are at most 10 entries left while doing an index transfer, these entries will also be appended
20 years ago
theli d4a045d7b1 *) Trying to solve "de.anomic.plasma.plasmaSwitchboard.deQueue': null" Bug
20 years ago
theli ea9a992f05 *) Before the crawler retries to download a URL it checks if the server is already doing a shutdown
20 years ago
theli ea26b84eed *) Bugfix for http://www.yacy-forum.de/viewtopic.php?t=954
20 years ago
theli 0c8a48e2cb *) converting php Session ID to lower case in funktion isCGI
20 years ago