
hadoop
Wbw Belief
一枚产品梦在路上的全栈架构师。
展开
-
Haoop put | ipc.RemoteException(java.io.IOException): File /xxx/test._COPYING_ could only be replica
问题:hadoop搭建两台,测试put数据时,出现问题。[root@master hadoop-2.10.0]# ls bin data etc include lib libexec LICENSE.txt logs NOTICE.txt README.txt sbin share test[root@master hadoop-2.10.0]# ./b...原创 2019-12-18 17:08:01 · 528 阅读 · 0 评论 -
Hadoop HBase | Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
异常:java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.2019-12-16 14:00:50.919 WARN 19316 --- [ntainer#1-0-C-1] org.apache.hadoop.util.NativeCodeLoade...原创 2019-12-16 14:12:00 · 558 阅读 · 0 评论 -
Hadoop HBase Hive | 二、Hadoop 集群搭建
目录1.上一篇Hadoop HBase Hive | 一、Linux集群环境安装采坑介绍2.检查hostname3.上传hadoop4.修改配置文件4.1修改core-site.xml4.2修改hdfs-site.xml4.3修改yarn-site.xml4.4修改mapred-site.xml4.5修改slaves、master4.6检查...原创 2019-12-13 18:48:52 · 723 阅读 · 0 评论 -
Hadoop HBase Hive | 一、Linux集群环境安装采坑介绍
1.描述初次尝试 Hadoop HBase Hive 集群搭建,特地记录下来。2.环境4台服务器(最少三台) 10.0.1.73 hadoop-master 10.0.1.72 hadoop-slave 10.0.1.74 hadoop-slave02 10.0.1.75 hadoop-slave03 jdk均为1.8 64位操作系统CentOS 6起步...原创 2019-12-13 18:22:37 · 296 阅读 · 0 评论 -
Hadoop HBase | ERROR [master/hadoop-master:16000:becomeActiveMaster] master.HMaster: Failed to becom
问题上传完hbase,配置好hbase-site.xml ,启动hbase,查看日志出现问题。2019-12-06 18:03:31,894 ERROR [master/hadoop-master:16000:becomeActiveMaster] master.HMaster: Failed to become active master at org.apach...原创 2019-12-13 16:48:25 · 4609 阅读 · 1 评论 -
Hadoop Browse Directory | DownLoad 下载不了,ip地址错误
问题hadoopBrowse Directory 点击Download下载无反应。解决把你 hadoop hosts 文件 主机地址映射,放你本地一份。再次点击下载。问题解决。...原创 2019-12-13 15:28:30 · 946 阅读 · 0 评论 -
Hadoop 集群 | common.Storage: Failed to add storage directory [DISK]file:/usr/local/hadoop-2.10.0/data
问题 多次进行hdfs namenode -format 导致hadoop/dfs/data/current/VERSION 不一致。启动hadoop 集群,发现只有主节点及SecondaryNameNode启动,datanode均为启动。2019-12-13 14:33:31,532 INFO org.apache.hadoop.ipc.CallQueueManager:...原创 2019-12-13 14:45:31 · 3090 阅读 · 1 评论 -
Hadoop 分布式 | 初始化文件系统错误 hdfs namenode -format
问题 初始化hadoop文件系统出现错误。./bin/hdfs namenode -format hba-hadoopSTARTUP_MSG: java = 1.8.0_74************************************************************/19/12/06 14:58:10 INFO namenode.NameN...原创 2019-12-13 13:33:28 · 2576 阅读 · 0 评论