Commit Graph

27 Commits (06b13650667fdf387a53f6556ce075655500a855)

Author SHA1 Message Date
orbiter c543028dd4 fixed double/missing null check for LURLs
18 years ago
orbiter 9340dbb501 fixed all possible problems with nullpointer exception for LURLs
18 years ago
hermens ff4362b02d some more fixes for new plasmaCrawlLURL.load behavior
18 years ago
orbiter 4866868c0e added write cache for LURLs
18 years ago
theli f3ac4dbbb9 *) better handling of server shutdown
18 years ago
orbiter f43c90fa98 fixed handling of null referer in crawlOrder
19 years ago
orbiter abf22f6e60 removed url normalform computation from htmlFilterContentScraper.
19 years ago
orbiter 90d569d70f refactoring of index management:
19 years ago
orbiter 0a4c2e89ed remote crawl orders are now only accepted if sum over all
19 years ago
hermens 3208fe14ed *) log exceptions in crawlOrder.java to the logfile instead of stdout
19 years ago
orbiter f4ffa9aee5 - implemented more attributes to index entries
19 years ago
orbiter bb79fb5d91 - changed handling of error cases retrieving urls from database
19 years ago
orbiter 37f88b4017 code cleanup
19 years ago
orbiter 8f1f2daa5e implemented interactive link deletion of search results.
19 years ago
orbiter a04930f025 code cleanup
19 years ago
orbiter d2731418bf added creation of global ranking files and changed url normal form usage
19 years ago
borg-0300 440e6ed747 see http://www.yacy-forum.de/viewtopic.php?t=1416
19 years ago
theli b8ceb1ffde *) Adding better https support for crawler
19 years ago
theli a2fa75e688 *) Asynchronous queuing of crawl job URLs (stackCrawl)
19 years ago
orbiter bb3e897baf mor minor changes
20 years ago
orbiter a2cf76ea7c bugfixes
20 years ago
orbiter 9f505af7aa preparations for bulk remote crawls
20 years ago
orbiter 40036ba69c fixed dht transmission; added url-blacklist blocking also for remote search
20 years ago
orbiter a1ffc27041 preparations for image/movie/music indexing
20 years ago
rramthun 85c2f3be8a Fixed spelling mistakes
20 years ago
theli e7f7aa0bb9 *) Import statements reorganized
20 years ago
orbiter 248077d3f0 initial load with yacy 0.36
20 years ago