pig-0.10.0版本是支持hadoop 23的。
但是需要重新编译pig;
编译命令如下:
编译好之后,把原来的pig的jar包删了就行。
当然了,hadoop的几个环境变量还是要配置的:
HADOOP_HOME
参考资料:http://hortonworks.com/blog/new-features-in-apache-pig-0-10/
但是需要重新编译pig;
编译命令如下:
- ant -Dhadoopversion=23
编译好之后,把原来的pig的jar包删了就行。
当然了,hadoop的几个环境变量还是要配置的:
HADOOP_HOME
参考资料:http://hortonworks.com/blog/new-features-in-apache-pig-0-10/
引用
Pig 0.10.0 supports Hadoop 0.23.X. All unit and end-to-end tests passed with hadoop-0.23. To run Pig with hadoop-0.23, you need to recompile Pig with hadoopversion flag set to 23:
ant -Dhadoopversion=23
You also need to set up all of the environment variables necessary to run the hadoop -23 client, plus, point HADOOP_HOME to HADOOP_COMMON_HOME, and make sure $HADOOP_HOME/bin/hadoop exists.
ant -Dhadoopversion=23
You also need to set up all of the environment variables necessary to run the hadoop -23 client, plus, point HADOOP_HOME to HADOOP_COMMON_HOME, and make sure $HADOOP_HOME/bin/hadoop exists.
本文详细介绍了如何在Pig 0.10.0版本中支持Hadoop23,并通过使用特定的编译命令进行编译。同时,文章还强调了配置Hadoop环境变量的重要性,确保成功运行Hadoop客户端。

1175

被折叠的 条评论
为什么被折叠?



