
大数据
Hadoop,Hbase,Spark,zookeeper,etc
空空dream
这个作者很懒,什么都没留下…
展开
-
ZooKeeper 客户端 zkCli.sh 节点的增删改查
1、连接到节点:./zkCli.sh -r -timeout 2000 -server master:21810,注意默认端口是2181,我自己改了[root@slave2 bin]# ./zkCli.sh -r -timeout 2000 -server master:21810Connecting to master:218102018-06-18 17:22:24,373 [myid...原创 2018-06-18 17:32:43 · 935 阅读 · 0 评论 -
分布式zookeeper安装
1、下载zookeeper到/usr/hadoop目录下,解压 官网:http://zookeeper.apache.org/releases.html#downloadtar -zxvf zookeeper*2、修改conf/zoo_sample.cfg为zoo.cfg,内容为以下,只改了最后4行,添加的4个节点。# The number of milliseconds of ea...原创 2018-06-18 16:47:11 · 317 阅读 · 0 评论 -
QuorumCnxManager@584] - Cannot open channel to 2 at election
1、安装zookeeper时一直提示以下错误,无奈把防火墙关掉之后还是提示,最终发现,防火墙没关闭成功WARN [QuorumPeer[myid=1]/0:0:0:0:0:0:0:0:21810:Learner@237] - Unexpected exception, tries=1, connecting to slave2/172.2.4.161:28880java.net.Conne...原创 2018-06-18 16:21:56 · 3330 阅读 · 1 评论 -
Call From master.lan/x.x.x.x to master:9000 failed on connection exception:
重启hadoop即可恢复,暂未找到原因hdfs dfs -mkdir /usermkdir: Call From master.lan/172.2.1.224 to master:9000 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see: http://wiki.ap...原创 2018-06-18 13:31:23 · 5379 阅读 · 0 评论 -
IOException: Failed to set permissions of path: \tmp
windows下运行Wordcount,报一下错误,查到的信息都是说修改org.apache.hadoop.fs.FileUtil后重新编译,六月 03, 2018 8:20:38 下午 org.apache.hadoop.util.NativeCodeLoader <clinit>警告: Unable to load native-hadoop library for your...转载 2018-06-03 20:24:08 · 724 阅读 · 0 评论 -
Attempting to operate on hdfs namenode as root
写在最前注意: 1、master,slave都需要修改start-dfs.sh,stop-dfs.sh,start-yarn.sh,stop-yarn.sh四个文件 2、如果你的Hadoop是另外启用其它用户来启动,记得将root改为对应用户HDFS格式化后启动dfs出现以下错误:[root@master sbin]# ./start-dfs.shStarting nameno...原创 2018-06-03 04:31:53 · 49440 阅读 · 22 评论 -
The node /hbase-unsecure is not in ZooKeeper.
重点内容首先先确认您的Hadoop版本与Hbase是否兼容,否则一切都是扯淡 各hbase版本对hadoop各版本的支持情况之前以为单机式Hadoop不需要配置hbase.cluster.distributed,遂在hbase-site.xml中将其删除导致以下错误:2016-08-15 23:20:36,028 ERROR [main] client.ConnectionManager$HCon原创 2016-08-16 12:26:21 · 3984 阅读 · 0 评论 -
Could not resolve hostname hadoop.master: Name or service not known
[root@localhost ~]# start-dfs.sh16/08/15 00:19:20 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable16/08/15 00:19:20 WA原创 2016-08-15 12:25:42 · 7497 阅读 · 0 评论 -
Unable to load native-hadoop library for your platform
[root@localhost ~]# start-dfs.sh16/08/14 23:26:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable16/08/14 23:26:05 WA原创 2016-08-15 11:32:26 · 1348 阅读 · 0 评论 -
The authenticity of host '0.0.0.0 (0.0.0.0)' can't be established.
ubuntu安装Hadoop是出现 The authenticity of host ‘0.0.0.0 (0.0.0.0)’ can’t be established.(错误), 代码如下:root@master:/usr/local/hadoop/hadoop-2.6.0# sbin/start-dfs.shStarting namenodes on [localhost]loca原创 2015-07-13 21:12:47 · 13837 阅读 · 2 评论