HDFS客户端操作

1、HDFS客户端环境准备

下载地址：https://download.youkuaiyun.com/download/h2498864708/12251820

2．配置HADOOP_HOME环境变量

还要修改JAVA_HOME变量

否则可能会出现Failed to locate the winutils binary in the hadoop binary path的错误

https://blog.youkuaiyun.com/abc50319/article/details/80284741

3. 配置Path环境变量

4．创建一个Maven工程，导入相关依赖

<dependencies>
		<dependency>
			<groupId>junit</groupId>
			<artifactId>junit</artifactId>
			<version>RELEASE</version>
		</dependency>
		<dependency>
			<groupId>org.apache.logging.log4j</groupId>
			<artifactId>log4j-core</artifactId>
			<version>2.8.2</version>
		</dependency>
		<dependency>
			<groupId>org.apache.hadoop</groupId>
			<artifactId>hadoop-common</artifactId>
			<version>2.7.2</version>
		</dependency>
		<dependency>
			<groupId>org.apache.hadoop</groupId>
			<artifactId>hadoop-client</artifactId>
			<version>2.7.2</version>
		</dependency>
		<dependency>
			<groupId>org.apache.hadoop</groupId>
			<artifactId>hadoop-hdfs</artifactId>
			<version>2.7.2</version>
		</dependency>
		<dependency>
			<groupId>jdk.tools</groupId>
			<artifactId>jdk.tools</artifactId>
			<version>1.8</version>
			<scope>system</scope>
			<systemPath>${JAVA_HOME}/lib/tools.jar</systemPath>
		</dependency>
</dependencies>

5.创建HdfsClient类

package com.yoyo.hdfs;

import java.io.IOException;
import java.net.URI;
import java.net.URISyntaxException;

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;
import org.junit.Test;

public class HdfsClient {
	@Test
	//连接hdfs
	public void testConnect() throws IOException, InterruptedException, URISyntaxException{
		Configuration conf=new Configuration();
		//创建一个文件系统的客户端对象
		FileSystem fs=FileSystem.get(new URI("hdfs://hadoop101:9000"),conf,"yoyo");
		fs.mkdirs(new Path("/elipse1"));
		fs.close();
	}
}

6.查看结果

http://192.168.226.130:50070/explorer.html#/