Service Dependencies in Cloudera Manager
The following tables list service dependencies that exist between various services in a Cloudera Manager deployment. As you configure services for Cloudera Manager, refer to the tables below for the appropriate version.
Service dependencies for Spark 2 on YARN and Cloudera Data Science Workbench are listed separately.
Version 6.2 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
ADLS Connector | ||
AWS S3 | ||
Data Context Connector | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | YARN |
|
Hue |
|
|
Impala |
|
|
Kafka | ZooKeeper | Sentry |
Key-Value Store Indexer |
|
Sentry |
Oozie | YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Spark on YARN | YARN | HBase |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 6.1 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
ADLS Connector | ||
AWS S3 | ||
Data Context Connector | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | YARN |
|
Hue |
|
|
Impala |
|
|
Kafka | ZooKeeper | Sentry |
Key-Value Store Indexer |
|
Sentry |
Kudu | ||
Oozie | YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 6.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Accumulo C6 |
|
|
ADLS Connector | ||
AWS S3 | ||
Data Context Connector | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | YARN |
|
Hue |
|
|
Impala |
|
|
Kafka | ZooKeeper | Sentry |
Key Trustee | ZooKeeper | |
KMS | ||
Key-Value Store Indexer |
|
Sentry |
Kudu | ||
Luna KMS | ZooKeeper | |
Oozie | YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Spark on YARN | YARN | HBase |
Sqoop Client | ||
Thales KMS | ZooKeeper | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.16 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
ADLS Connector | ||
AWS S3 | ||
Data Context Connector | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
Sentry |
Kudu | ||
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.15 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
ADLS Connector | ||
AWS S3 | ||
Data Context Connector | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
Sentry |
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.14 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
ADLS Connector | ||
AWS S3 | ||
Data Context Connector | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
Sentry |
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.13 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
AWS S3 | ||
Data Context Connector | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.12 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
AWS S3 | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
Thales KMS | ZooKeeper | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.11.2 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
AWS S3 | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.11.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
AWS S3 | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
Kudu | ||
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Spark on YARN | YARN | HBase |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.10.3 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
AWS S3 | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.10 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
AWS S3 | ||
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.9 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.8 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
Sentry |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.7.1 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.7.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.6.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.5.2 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.5.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Spark on YARN | YARN | HBase |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.4.4 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.4.1 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.4.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Spark on YARN | YARN | |
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.3.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.2.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key Trustee | ZooKeeper | |
KMS | ||
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.1.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN |
|
Sentry | HDFS or Isilon | ZooKeeper |
Solr |
|
|
Sqoop | MapReduce or YARN | |
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Version 5.0.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
Accumulo 16 |
|
|
Flume |
|
|
HBase |
|
|
HDFS |
|
|
Hive | MapReduce or YARN |
|
Hue |
|
|
Impala |
|
|
Isilon | ||
Kafka | ZooKeeper | |
Key Trustee Server | ||
Key-Value Store Indexer |
|
|
MapReduce | HDFS or Isilon | ZooKeeper |
Oozie | MapReduce or YARN | ZooKeeper |
Solr |
|
|
Spark | HDFS or Isilon | |
Spark on YARN | YARN | |
Sqoop | MapReduce or YARN | |
Sqoop Client | ||
YARN | HDFS or Isilon | ZooKeeper |
ZooKeeper |
Cloudera Data Science Workbench 1.5.0 Service Dependencies
Service | Dependencies | Optional Dependencies |
---|---|---|
CDSW/CDH6 |
|
|
CDSW/CDH5 |
Spark 2 on YARN Service Dependencies
Spark 2 Version | Dependencies | Optional Dependencies |
---|---|---|
2.3.4 | YARN |
|
2.2.4 | YARN | Hive |
2.1.4 | YARN | Hive |
2.0.2 | YARN | Hive |
Page generated August 29, 2019.
<< Creating a CDH Cluster Using a Cloudera Manager Template | ©2016 Cloudera, Inc. All rights reserved | Installing Cloudera Manager, CDH, and Managed Services >> |
Terms and Conditions Privacy Policy |