
Hadoop
点滴笔记
点滴笔记、努力生活、加油!
展开
-
Hadoop |HDFS Federation(HDFS 联邦机制)
https://www.cnblogs.com/xinfang520/p/10397360.htmlhttp://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/Federation.htmlhttps://www.jianshu.com/p/2daf70e3b5b0https://baijiahao.baidu.com/s?id=1598948017346102399&wfr=spider&for...原创 2021-06-09 16:11:45 · 320 阅读 · 0 评论 -
HDFS Command 记录
1. 将HDFS目录下多个文件写入指定目标目录下的新文件(小文件合并)hdfs dfs -cat /user/hive/warehouse/db.db/t_ods_mid_xxx_hi/cp=2020120922/* | hdfs dfs -copyFromLocal - /user/hive/warehouse/db.db/t_ods_mid_xxx_hi/cp=2020120923/000000_0...原创 2020-12-11 15:32:28 · 286 阅读 · 0 评论 -
基于Ansible搭建Hadoop HA
目录基础步骤hadoop-conf主要配置文件core-site.xmlmapred-site.xmlhdfs-site.xmlyarn-site.xmlhadoop-env.shfair-scheduler.xmlslaves启动Hadoop HA查看Hadoop HA 状态小问题Hadoop HAHadoop HA模式参照官网文档应该可以说是各组件的HA,比如HDFS HA, YARN HA 。其中HDFS HA 又有QJM与NFS方式:Q..原创 2020-07-13 21:57:06 · 1400 阅读 · 2 评论