Commit Graph

239 Commits (2cd695f3768e48740de7de3b1b0f82a96c0ec8a6)

Author SHA1 Message Date
borg-0300 8260128ee9 changed getFreeSize();
20 years ago
theli f8ad65eae1 *) First trial implementation of robots.txt support
20 years ago
borg-0300 0a57fbcde5 Added new HashSet filesInUse;
20 years ago
borg-0300 8cd6a52dd0 Convention
20 years ago
borg-0300 c0e3d18bbf *) remove import java.lang
20 years ago
borg-0300 b1cd1fa917 cleaned
20 years ago
borg-0300 da9c6857fb *) changed a misunderstand, no BUG ;)
20 years ago
borg-0300 fbac053c03 small change
20 years ago
theli 578f36ae18 *) Speedup of indexer. Proxy files will not be enqueued by the cachemanager
20 years ago
theli 1219ef99f0 *) Bugfix for NullpointerException in yacyDebugMode Init
20 years ago
theli 6c722706b7 *) Moving yacyDebugMode intialization to switchboard
20 years ago
theli 4e07828807 *) httpdProxyHandler.java
20 years ago
borg-0300 81cb8feb15 back to 649 :/
20 years ago
borg-0300 5194511e8e *) attempt to find bug
20 years ago
theli 6991b9e2b9 *) Suppress stacktrace on crawler error for "Connection reset"
20 years ago
theli a47f9238fe *) Blacklist is now also used by the crawler
20 years ago
theli dc0a2d4c11 *) Bugfix for Loader Queue:
20 years ago
theli 732a107160 *) Bugfix for "-UNRESOLVED_PATTERN-" Bug on IndexCreateWWWLocalQueue_p.html and "urlEntry.url() == null" Bug
20 years ago
theli 33aaffbfc6 *) Displaying content size of each entry in indexing queue
20 years ago
borg-0300 7626823519 BUGFIX for last 'commit'
20 years ago
borg-0300 971756e8dd the delete size is smaller
20 years ago
theli 0471019606 *) IndexCreateIndexingQueue_p.html now also shows indexing jobs that are currently in process
20 years ago
borg-0300 cc493ef8c1 Added change from Hermes
20 years ago
theli bead8a32aa *) IndexCreate_p.java:
20 years ago
theli 48aaf703cc *) Adding additional logging output to detect crawling problems
20 years ago
theli 59b8a98c7e *) Bugfix for suppressing of stacktrace in log on crawler error "MalformedURLException"
20 years ago
borg-0300 c1d7527929 better cache cleanup
20 years ago
theli 2e6df95786 *) adding toString method
20 years ago
theli 4fd5b95b1f *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
20 years ago
theli 6adf8a4bde *) Renaming Logger function names to reflect the proper Java Logging API Loglevels
20 years ago
theli f19c09b227 *) Suppress stacktrace on crawler error for "MalformedURLException"
20 years ago
theli cc1df08069 *) Adding missing synchronized blocks
20 years ago
borg-0300 bf14e6def5 *) proxyCache, proxyCacheSize can be changed under 'Proxy Indexing'
20 years ago
theli 9b818b1ce3 *) Pausing Crawlers if there is not enough space on disk
20 years ago
theli b33094e925 *) Trying to solve "Too many open files bug"
20 years ago
theli 34790acf02 *) Bugfix for suppressing of stacktrace in log on crawler error "unknown host"
20 years ago
theli af7b8f75bd *) Making proxyAccessLogging configureable via yacy.logging file
20 years ago
theli 2a081c9ee5 *) Adding additional logging message for "NURL.entry() == null" Bug
20 years ago
theli cb1f11c96b *) Suppress stacktrace on crawler error for "Unknown Host"
20 years ago
theli e338a13de3 *) Suppress stacktrace on crawler error for "Read timed out"
20 years ago
theli 2e43e744de *) Suppress stacktrace on crawler error for "connect timed out"
20 years ago
theli 36cbe04e3e *) Bugfix for Crawler Redirection Bug
20 years ago
theli b70de495a0 *) Remembering Crawler-isPaused setting
20 years ago
theli e569a84dc0 *) Using the same configuration settings for all indexing threads on server Startup
20 years ago
theli 17be77a468 *) Bugfix for "Crawler data will not be removed from htcache if content parsing failed"
20 years ago
theli 5f55dff297 *) Bugfix for "Binäre Nullen auf der page: Index Creation: Indexing Queue"
20 years ago
allo eb6365c069 local Bootstrapping bug.
20 years ago
theli 330eae7cf3 *) Normalizing CrawlerStartURL now before crawling is started
20 years ago
theli ab894d26bc *) Bugfix for "plasmaSwitchboard.deQueue: null" Bug (hopefully)
20 years ago
theli eaf9f26cc3 *) Bugfix for NULL PROFILE HANDLE 'null' Bug:
20 years ago