CDH安装问题点记录

HDFS报副本块不足

参考:https://blog.youkuaiyun.com/HFUTLXM/article/details/77605915

https://blog.youkuaiyun.com/HFUTLXM/article/details/77605915#t4

修改 : dfs.replication = 2 , 因节点数较少.副本数不能比节点数大

并执行命令

su  hdfs

hadoop fs -setrep -R 2 /

mr卡在Running job ,不继续执行:

可能是机器配置不够

1. <property>  
2.     <name>yarn.nodemanager.resource.memory-mb</name>  
3.     <value>20480</value>  
4. </property>  
5. <property>  
6.    <name>yarn.scheduler.minimum-allocation-mb</name>  
7.    <value>2048</value>  
8. </property>  
9. <property>  
10.     <name>yarn.nodemanager.vmem-pmem-ratio</name>  
11.     <value>2.1</value>  
12. </property>  

参考:

https://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/  , 原理!

https://blog.youkuaiyun.com/dai451954706/article/details/50464036

https://blog.youkuaiyun.com/aspkhdp/article/details/49996689

https://blog.youkuaiyun.com/aspkhdp/article/details/49996689

hivemetastore 启动报错 , 在页面修改datanucleus.autoCreateSchema=true,自动创建表

cloudera-scm-server 启动失败:

+======================================================================+
| Error: JAVA_HOME is not set and Java could not be found |
+----------------------------------------------------------------------+
| Please download the latest Oracle JDK from the Oracle Java web site |
| > http://www.oracle.com/technetwork/java/javase/index.html < |
| |
| Cloudera Manager requires Java 1.6 or later. |
| NOTE: This script will find Oracle Java whether you install using |

| the binary or the RPM based installer. |

参考:https://community.cloudera.com/t5/Cloudera-Manager-Installation/Error-JAVA-HOME-is-not-set-and-Java-could-not-be-found/td-p/18974/page/2

https://www.cloudera.com/documentation/enterprise/latest/topics/cdh_ig_jdk_installation.html

表存在两个LONG字段问题

参考:https://blog.youkuaiyun.com/skywalker_only/article/details/38263069

hiveserver 高可用:

http://lxw1234.com/archives/2016/05/675.htm