You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
orbiter
474659a71f
- modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order
...
- added option to set minimum crawl delta for domains in balancer
- added default values to crawl deltas in yacy.init
- added configuration for these deltas in performance queues
- enhanced performance setting computation (more time for indexing queue for a faster flush
- remote crawling is now enabled during local crawling if indexer has space and time for more links
- added database stub for new distributed file system
- refactoring of time computation to get an abstraction level that will be used by a TTL rule in new distributed file system
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4966 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
..
AbstractImporter.java
refactoring:
17 years ago
Balancer.java
- modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order
17 years ago
CrawlEntry.java
fix for npe in crawler
17 years ago
CrawlProfile.java
- WatchCrawler shows status without JavaScript
17 years ago
CrawlQueues.java
- modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order
17 years ago
CrawlStacker.java
some code-cleanup and possible speed enhancements in different core methods
17 years ago
ErrorURL.java
refactoring: moved all crawler classes into their own package
17 years ago
FTPLoader.java
- added option to switch between yacy networks, especially between the two default networks (freeworld and intranet),
17 years ago
HTTPLoader.java
fixed unlimited FileSizeLimit
17 years ago
Importer.java
refactoring:
17 years ago
ImporterException.java
refactoring:
17 years ago
ImporterManager.java
- organize imports
17 years ago
IndexingStack.java
- modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order
17 years ago
LoaderMessage.java
refactoring: moved all crawler classes into their own package
17 years ago
NoticeURLImporter.java
- added option to switch between yacy networks, especially between the two default networks (freeworld and intranet),
17 years ago
NoticedURL.java
- modified and enhanced the crawl balancer: better list export, fixing of damaged crawl queue at start-up, re-sorting at start-up to enhance domain order
17 years ago
ProtocolLoader.java
more protection against remote shutdown attacks: prevent loading using the crawler
17 years ago
ResultImages.java
refactoring: moved all crawler classes into their own package
17 years ago
ResultURLs.java
some code-cleanup and possible speed enhancements in different core methods
17 years ago
RobotsTxt.java
refactoring:
17 years ago
SitemapImporter.java
refactoring:
17 years ago
ZURL.java
some code-cleanup and possible speed enhancements in different core methods
17 years ago