chichuduxing的博客

Hadoop集群启动顺序zookeepeer->hadoop->hbaseHadoop集群关闭顺序hbase->hadoop->zookeepeerHadoop 主备节点状态查看与手动切换$HADOOP_HOME/bin/hdfs  haadmin -getServiceState  nn1注意：此处的nn1为在hdfs-site.xml中配置的name

读取HDFS上文件Demopackage com.utils;import java.io.IOException;import java.util.List;import org.apache.hadoop.fs.FSDataInputStream;import org.apache.hadoop.fs.FileSystem;import org.apache.hadoop.f

#!/bin/bash###################@author: chichuduxing#@date: 20161011####################加载Hadoop环境变量##略过function showhelp(){ echo "###################################!!! you must input at le

map过程中获得正在读取的文件名称import org.apache.hadoop.mapreduce.lib.input.FileSplit;//获取 input split 所在的文件名String curFileName = ((FileSplit)context.getInputSplit()).getPath().getName();//获得文件路径String curFil