如何解决Cloudera导入JSON集群模板失败
我一直在努力思考要使Service Hue与Hive，Impala融合以使其正常工作所需要的依赖性。有时我什至认为要手动操作以避免此问题。 Cloudera应该有适当的文档来简要介绍这些问题和API。
我正在尝试构建计算集群，但是每当我尝试实例化集群构建过程时，都会出现以下错误。我尝试了大多数可能性，但是没有运气。有人可以纠正我我缺少的东西以使其正常工作的地方。
错误：
com.cloudera.cmf.command.CmdExecException： java.lang.IllegalArgumentException：服务色相（hue-fbd5）具有 不满意的依存关系：[HIVE] 在com.cloudera.cmf.command.flow.SeqFlowCmd.run（SeqFlowCmd.java:119） 在com.cloudera.cmf.command.flow.SeqFlowCmd.update（SeqFlowCmd.java:249） 在com.cloudera.cmf.command.CmdWorkCommand.update（CmdWorkCommand.java:151） 在com.cloudera.server.cmf.CommandPusherThread.handleCommandInternal（CommandPusherThread.java:457） 在com.cloudera.server.cmf.CommandPusherThread.handleCommandBatched（CommandPusherThread.java:270） 在com.cloudera.server.cmf.CommandPusherThread.innerLoop（CommandPusherThread.java:189） 在com.cloudera.server.cmf.CommandPusherThread.run（CommandPusherThread.java:157）
代码：
{
"refName":"impala2-STATESTORE-BASE","roleType":"STATESTORE","configs":[
{
"name":"core_dump_dir","variable":"impala2-STATESTORE-BASE-core_dump_dir"
},{
"name":"log_dir","value":"/hadoop01/log/statestore"
},{
"name":"process_swap_memory_thresholds","value":"{\"warning\":\"never\",\"critical\":\"never\"}"
},{
"name":"minidump_path","variable":"impala2-STATESTORE-BASE-minidump_path"
},{
"name":"statestore_cmd_args_safety_valve","value":"statestore_subscriber_timeout_seconds=60\nstatestore_heartbeat_tcp_timeout_seconds=10\nstatestore_update_tcp_timeout_seconds=400"
}
],"base":true
}
]
},{
"refName":"hive_exec","serviceType":"HIVE_EXEC","serviceConfigs":[
{
"name":"process_groupname","value":"rdbdservicehive"
},{
"name":"process_username","value":"service-hive-d"
},{
"name":"kerberos_princ_name",{
"name":"hiveserver2_ldap_uri","value":"ldaps://ldapsf5m01europa.lb1.abc.com.mde"
},{
"name":"hive_aux_jars_path_dir","value":"/opt/cloudera/lib/hive"
},{
"name":"hiveserver2_ldap_domain","value":"M01EUROPA.M0ABCSERVER.MDE"
}
],"roleConfigGroups":[
{
"refName":"hive_exec-HIVESERVER2-BASE","roleType":"HIVESERVER2","configs":[
{
"name":"hive_server2_logging_operation_log_location","value":"/hadoop02/log/hive/operation_logs"
},{
"name":"hive_log_dir","value":"/hadoop02/log/hive"
},{
"name":"oom_heap_dump_dir","value":"/hadoop01/tmp"
}
],{
"refName":"spark_on_yarn","serviceType":"SPARK_ON_YARN","serviceConfigs":[
{
"name":"kerberos_princ_name","value":"service-spark-d"
},{
"name":"spark-conf/spark-env.sh_service_safety_valve","value":"export SPARK_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p3757.1951001/lib/spark\nexport PYTHONPATH=$SPARK_HOME/python/lib/py4j-0.10.7-src.zip:$SPARK_HOME/python:$SPARK_HOME/bin/pyspark:$PYTHONPATH\nexport PYSPARK_PYTHON=/opt/cloudera/python37/bin/python3"
},{
"name":"process_groupname","value":"rdbdservicespark"
},{
"name":"spark_history_log_dir","value":"/user/spark/spark2ApplicationHistory"
},"value":"service-spark-d"
}
],"roleConfigGroups":[
{
"refName":"spark_on_yarn-SPARK_YARN_HISTORY_SERVER-BASE","roleType":"SPARK_YARN_HISTORY_SERVER","configs":[
{
"name":"log_dir","value":"/hadoop01/log/spark2/"
},{
"name":"local_storage_dir","variable":"spark_on_yarn-SPARK_YARN_HISTORY_SERVER-BASE-local_storage_dir"
}
],"base":true
},{
"refName":"spark_on_yarn-GATEWAY-BASE","roleType":"GATEWAY","configs":[
{
"name":"lineage_event_log_dir","value":"/hadoop01/log/spark2/lineage"
}
],{
"refName":"hue2","serviceType":"HUE","serviceConfigs":[
{
"name":"database_password","variable":"hue2-database_password"
},"value":"rdbdservicehue"
},{
"name":"time_zone","value":"Europe/London"
},{
"name":"database_host","variable":"hue2-database_host"
},{
"name":"database_port","variable":"hue2-database_port"
},{
"name":"hue_service_safety_valve","value":"[desktop]\ndefault_user=service-hue-d\ndefault_hdfs_superuser=service-hdfs-d\n[[database]]\nport=0\nengine=oracle\nuser=bdh_hue_owner\npassword=*******\nname=vstdhor01d.server.abc.com.mde:1556/DOGBBDH1_APP\n[[session]]\nexpire_at_browser_close=true\nconcurrent_user_session_limit=2\n[search]\nsecurity_enabled=true\n[dashboard]\n is_enabled=true \n has_sql_enabled=true\n[[engines]]\n [[[sql]]]\n analytics=true\n nesting=true\n[beeswax]\ndownload_row_limit=5000\n"
},{
"name":"database_user","variable":"hue2-database_user"
},{
"name":"base_dn","value":"DC=m01europa,DC=m01abcscom,DC=mde"
},{
"name":"ldap_url","value":"ldaps://ldapsf5m01europa.lb1.abccom.mde"
},{
"name":"auth_backend","value":"desktop.auth.backend.LdapBackend"
},{
"name":"bind_dn","value":"hadoop-admin"
},"value":"service-hue-d"
},{
"name":"audit_event_log_dir","value":"/opt/cloudera/hue/audit"
},{
"name":"database_type","variable":"hue2-database_type"
},{
"name":"database_name","variable":"hue2-database_name"
},{
"name":"nt_domain","value":"M01EUROPA.M01ABCCOM.MDE"
},{
"name":"hue_service_env_safety_valve","value":"ORACLE_HOME=/usr/share/oracle/instantclient\nLD_LIBRARY_PATH=/usr/share/oracle/instantclient/lib"
},{
"name":"bind_password","variable":"hue2-bind_password"
},{
"name":"search_bind_authentication","value":"true"
}
],"roleConfigGroups":[
{
"refName":"hue2-HUE_LOAD_BALANCER-BASE","roleType":"HUE_LOAD_BALANCER","configs":[
{
"name":"hue_load_balancer_safety_valve","value":"ProxyTimeout 1200\n"
},{
"name":"hue_load_balancer_log_dir","value":"/hadoop01/log/hue-httpd"
}
],{
"refName":"hue2-KT_RENEWER-BASE","roleType":"KT_RENEWER","configs":[
{
"name":"kt_renewer_log_dir","value":"/hadoop01/log/hue"
},\"critical\":\"never\"}"
}
],{
"refName":"hue2-HUE_SERVER-BASE","roleType":"HUE_SERVER","configs":[
{
"name":"HUE_SERVER_role_env_safety_valve","value":"KRB5_TRACE=/dev/stdout"
},{
"name":"hue_server_log_dir","value":"/hadoop01/log/hue"
}
],{
"refName":"yarn2","serviceType":"YARN","serviceConfigs":[
{
"name":"service_config_suppression_hadoop_secure_web_ui","value":"true"
},{
"name":"cm_yarn_container_usage_output_dir","value":"/hadoop01/tmp/cmYarnContainerMetricsAggregate"
},{
"name":"yarn_scheduler_fair_allow_undeclared_pools","value":"false"
},"value":"rDBDServiceHadoop"
},{
"name":"yarn_service_lce_always",{
"name":"service_config_suppression_cm_yarn_container_usage_job_user",{
"name":"yarn_admin_acl","value":""
},{
"name":"service_health_suppression_yarn_usage_aggregation_health",{
"name":"cm_yarn_container_usage_job_user","value":"service-bdadmind"
},{
"name":"cm_yarn_container_usage_input_dir","value":"/hadoop01/tmp/cmYarnContainerMetrics"
},"value":"service-yarn-d"
},{
"name":"yarn_service_cgroups",{
"name":"cm_yarn_enable_container_usage_aggregation","roleConfigGroups":[
{
"refName":"yarn2-RESOURCEMANAGER-BASE","roleType":"RESOURCEMANAGER","configs":[
{
"name":"resource_manager_log_dir","value":"/hadoop01/log/hadoop-yarn"
},{
"name":"resourcemanager_fair_scheduler_user_as_default_queue","value":"false"
},{
"name":"resourcemanager_fair_scheduler_preemption","value":"true"
},{
"name":"oom_heap_dump_enabled",{
"name":"resourcemanager_fair_scheduler_assign_multiple","value":"false"
}
],{
"refName":"yarn2-NODEMANAGER-1","roleType":"NODEMANAGER","configs":[
{
"name":"container_executor_group","value":"rdbdserviceyarn"
},{
"name":"node_manager_log_dir",{
"name":"yarn_nodemanager_local_dirs","variable":"yarn2-NODEMANAGER-1-yarn_nodemanager_local_dirs"
},{
"name":"container_executor_allowed_system_users","value":"nobody,impala,hive,llama"
},{
"name":"yarn_nodemanager_recovery_dir","variable":"yarn2-NODEMANAGER-1-yarn_nodemanager_recovery_dir"
},{
"name":"yarn_nodemanager_log_dirs","variable":"yarn2-NODEMANAGER-1-yarn_nodemanager_log_dirs"
},{
"name":"container_executor_banned_users","value":"hdfs,yarn,mapred,bin,service-yarn-d,service-mapred-d,service-hdfs-d"
}
],{
"refName":"yarn2-GATEWAY-BASE","configs":[
{
"name":"hadoop_job_history_dir","variable":"yarn2-GATEWAY-BASE-hadoop_job_history_dir"
},{
"name":"mapreduce_application_classpath","value":"$HADOOP_CLIENT_CONF_DIR,$PWD/mr-framework/*,$MR2_CLAsspATH,$CDH_MR2_HOME/*,$HADOOP_MAPRED_HOME/lib/*,$HADOOP_MAPRED_HOME/*"
}
],{
"refName":"yarn2-JOBHISTORY-BASE","roleType":"JOBHISTORY","configs":[
{
"name":"kerberos_role_princ_name","value":"service-mapred-d"
},{
"name":"history_process_groupname","value":"rDBDServiceHadoop"
},{
"name":"history_process_username",{
"name":"mr2_jobhistory_log_dir","value":"/hadoop01/log/hadoop-mapreduce"
}
],"base":true
}
]
}
],"hostTemplates":[
{
"refName":"ComputeGateway","cardinality":0,"roleConfigGroupsRefNames":[
"hdfs2-DatanODE-1","spark_on_yarn-GATEWAY-BASE","hdfs2-JOURNALNODE-BASE","yarn2-GATEWAY-BASE"
]
},{
"refName":"ComputeHueHive","roleConfigGroupsRefNames":[
"hive_exec-HIVESERVER2-BASE","hue2-HUE_LOAD_BALANCER-BASE","hue2-HUE_SERVER-BASE","hue2-KT_RENEWER-BASE","impala2-CATALOGSERVER-BASE","impala2-IMPALAD-1","impala2-STATESTORE-BASE"
]
},{
"refName":"ComputeHDFS","hdfs2-FAIlovERCONTROLLER-BASE","hdfs2-GATEWAY-BASE","hdfs2-HTTPFS-BASE","hdfs2-NAMENODE-BASE"
]
},{
"refName":"ComputeYarn","roleConfigGroupsRefNames":[
"spark_on_yarn-SPARK_YARN_HISTORY_SERVER-BASE","yarn2-JOBHISTORY-BASE","yarn2-NODEMANAGER-1","yarn2-RESOURCEMANAGER-BASE"
]
},{
"refName":"ComputeHDFSYarn","hdfs2-BALANCER-BASE","yarn2-NODEMANAGER-1"
]
},{
"refName":"ComputeDatanodeSecondaryNN","hdfs2-SECONDARYNAMENODE-BASE",{
"refName":"ComputeYarnstuff","roleConfigGroupsRefNames":[
"yarn2-GATEWAY-BASE","yarn2-NODEMANAGER-1"
]
}
],"clusterSpec":{
"dataContextRefs":[
{
"name":"SIT_cluster_context"
}
]
},"instantiator":{
"clusterName":"Compute-7","hosts":[
{
"hostName":"devecpvm014172.server.abc.com","hostTemplateRefName":"ComputeGateway"
},{
"hostName":"devecpvm014173.server.abc.com","hostTemplateRefName":"ComputeHueHive"
},{
"hostName":"devecpvm014174.server.abc.com","hostTemplateRefName":"ComputeHDFS"
},{
"hostName":"devecpvm014175.server.abc.com","hostTemplateRefName":"ComputeYarn"
},{
"hostName":"devecpvm014176.server.abc.com","hostTemplateRefName":"ComputeHDFSYarn"
},{
"hostName":"devecpvm014177.server.abc.com","hostTemplateRefName":"ComputeDatanodeSecondaryNN"
},{
"hostName":"devecpvm014178.server.abc.com","hostTemplateRefName":"ComputeYarnstuff"
}
],"variables":[
{
"name":"hdfs2-JOURNALNODE-BASE-dfs_journalnode_edits_dir","value":"/hadoop03/dfs/jn"
},{
"name":"hdfs2-NAMENODE-BASE-dfs_name_dir_list","value":"/hadoop01/dfs/nn,/hadoop02/dfs/nn"
},{
"name":"hdfs2-SECONDARYNAMENODE-BASE-fs_checkpoint_dir_list","value":"/hadoop02/dfs/snn"
},{
"name":"hdfs2-hdfs_user_home_dir","value":"/opt/cloudera/lib/hadoop-hdfs"
},{
"name":"hue2-bind_password","value":"********"
},{
"name":"hue2-database_host","value":"*******"
},{
"name":"hue2-database_name",{
"name":"hue2-database_password",{
"name":"hue2-database_port","value":"1556"
},{
"name":"hue2-database_type","value":"oracle"
},{
"name":"hue2-database_user",{
"name":"impala2-CATALOGSERVER-BASE-core_dump_dir","value":"/hadoop01/log/catalogd"
},{
"name":"impala2-CATALOGSERVER-BASE-minidump_path","value":"/hadoop01/log/impala-minidumps"
},{
"name":"impala2-IMPALAD-1-core_dump_dir","value":"/opt/cloudera/log/impalad"
},{
"name":"impala2-IMPALAD-1-minidump_path","value":"/opt/cloudera/log/impala-minidumps"
},{
"name":"impala2-IMPALAD-1-scratch_dirs","value":"/hadoop01/impala/impalad,/hadoop02/impala/impalad,/hadoop03/impala/impalad,/hadoop04/impala/impalad"
},{
"name":"impala2-IMPALAD-2-core_dump_dir","value":"/hadoop01/log/impalad"
},{
"name":"impala2-IMPALAD-2-minidump_path","value":"/hadoop02/log/impala-minidumps"
},{
"name":"impala2-IMPALAD-2-scratch_dirs",{
"name":"impala2-IMPALAD-BASE-core_dump_dir",{
"name":"impala2-IMPALAD-BASE-minidump_path",{
"name":"impala2-IMPALAD-BASE-scratch_dirs",{
"name":"impala2-STATESTORE-BASE-core_dump_dir","value":"/hadoop01/log/statestore"
},{
"name":"impala2-STATESTORE-BASE-minidump_path",{
"name":"spark_on_yarn-SPARK_YARN_HISTORY_SERVER-BASE-local_storage_dir","value":"/hadoop01/log/spark2/history"
},{
"name":"yarn2-GATEWAY-BASE-hadoop_job_history_dir","value":"/hadoop01/log/hadoop-mapreduce/history"
},{
"name":"yarn2-NODEMANAGER-1-yarn_nodemanager_local_dirs","value":"/hadoop01/yarn/nm,/hadoop02/yarn/nm,/hadoop03/yarn/nm,/hadoop04/yarn/nm"
},{
"name":"yarn2-NODEMANAGER-1-yarn_nodemanager_log_dirs","value":"/hadoop01/log/hadoop-yarn/container"
},{
"name":"yarn2-NODEMANAGER-1-yarn_nodemanager_recovery_dir","value":"/hadoop02/lib/hadoop-yarn/yarn-nm-recovery"
},{
"name":"yarn2-NODEMANAGER-BASE-yarn_nodemanager_local_dirs",{
"name":"yarn2-NODEMANAGER-BASE-yarn_nodemanager_log_dirs",{
"name":"yarn2-NODEMANAGER-BASE-yarn_nodemanager_recovery_dir","value":"/hadoop02/lib/hadoop-yarn/yarn-nm-recovery"
}
],"roleConfigGroups":[
{
"rcgRefName":"hdfs2-DatanODE-1","name":""
}
]
}
}
注意：代码中的所有这些*****和ABC.COM，ABCCOM都是隐藏实际的域信息，否则请您检查代码并帮助我识别代码中的依赖项或任何可疑的内容。抱歉，由于字符限制，我无法共享完整的代码。
谢谢。
版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 dio@foxmail.com 举报，一经查实，本站将立刻删除。
