Commit Graph

76 Commits (b78d171b1e0351e86d893b02d3476eec0756c7f2)

Author SHA1 Message Date
theli 26dfbb7499 *) Bugfix for UTF-8: url names are now stored properly in stackcrawl, crawler, indexing queue and should be displayed correct on the gui
18 years ago
orbiter 9340dbb501 fixed all possible problems with nullpointer exception for LURLs
18 years ago
orbiter 4866868c0e added write cache for LURLs
18 years ago
theli dae763d8e3 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2495 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli e3f0136606 *) next step of restructuring for new crawlers
18 years ago
theli 1c8300fcec *) Bugfix for name resolution in proxy mode
18 years ago
theli 09b106eb04 *) next step of restructuring for new crawlers
18 years ago
theli f3ac4dbbb9 *) better handling of server shutdown
18 years ago
orbiter 985dcbde7f changed some parameters that may cause better memory usage and more indexing speed
18 years ago
orbiter b7f4a1521b added options to switch on or off the kelondroFlexTable for NURL, EURL and PreNURL
18 years ago
orbiter db1eae0227 * simplified initialization of database objects
18 years ago
orbiter 23dd972608 fixed memory calculation in performanceMemory web page
19 years ago
orbiter 1ce3c22761 better memory control:
19 years ago
theli eee44be602 *) adding an interface for customized blacklist classes
19 years ago
theli d2e8e76218 *) now it's possible to configure the yacy blacklist separately for dht, search, proxy, crawler
19 years ago
orbiter 689bbcf9cd replaced kelondroTree db for NURLs by new kelondroFlexTable
19 years ago
orbiter 740d49751d * strict type and size check in kelondroRow handling
19 years ago
theli 9f298083cd *) adding more urls to the error url
19 years ago
orbiter 417ed5102e redesign of database iterators:
19 years ago
orbiter 7fd90ca7c8 * strict handling of NURL entry element generation, storage and stacking
19 years ago
orbiter 5f72be2a95 some redesign of EURL storage
19 years ago
orbiter 3879a0ecd0 replaced java.net.URL usage by use of new class de.anomic.net.URL
19 years ago
orbiter 92f4cb4d73 added option to configure the start-up delay time for kelondro database files.
19 years ago
orbiter c36e9fc8d3 full integration of kelondroRow
19 years ago
orbiter 90d569d70f refactoring of index management:
19 years ago
rramthun f08e33680c Added Blog-news-symbol as requested.
19 years ago
theli ddfe0f0e27 *) don't try to parse referer string if it's null
19 years ago
orbiter 3e31820c3d - corrections to PerformanceMemory display of object cache
19 years ago
orbiter 00a5d435e2 - fixed some bugs with domain filter
19 years ago
orbiter 7a650d0023 several bugfixes
19 years ago
orbiter 59d52fb4a9 fixed some problems with crawl profiles
19 years ago
orbiter 63f39ac7b5 added 3 new crawling steering options:
19 years ago
orbiter 1f4412a146 adopted isListed to discussed new behavior as discussed (url, getFile)
19 years ago
orbiter 488a0ed580 replaced old keyIterator and rowIterator by buffered iterators
19 years ago
orbiter dba02f399f starting of re-design of kelondroTree iterator
19 years ago
orbiter f02b426073 made kelondroTree.nodeIterator private
19 years ago
theli 89286478e7 *) removing thread pool eviction for now. Not needed at the moment
19 years ago
theli fbbbf5f411 *) remote trigger for proxy-crawl
19 years ago
theli 2da18ab359 *) correcting logging output
19 years ago
theli 8ffc6e35ad *) correcting logging output
19 years ago
theli ab7a911bb3 *) Trying to solve pool not open problem
19 years ago
hydrox d665f3c39c *) fixed Threadnames for stackCrawl-Threads
19 years ago
theli 3d5347bc8e *) changing loglevel for some messages
19 years ago
theli b9c9eaeb44 *) next try todo a bugfix :-((
19 years ago
theli 4b4b93c413 *) next try todo a bugfix :-(
19 years ago
theli d9fbad71b9 *) next try todo a bugfix
19 years ago
theli 6da97bd2e4 *) next bugfix for threadpool problem
19 years ago
theli bea2b9edee *) further redesign of threadpools to solve too many thread problem
19 years ago
theli 784fd50437 *) more verbose thread names
19 years ago
theli 56e4dbeb71 *) displaying current active + current idle threads in PerformanceQueues_p.html now
19 years ago