1.准备
Hibench-7.0 https://github.com/Intel-bigdata/HiBench/archive/HiBench-7.0.tar.gz
Hadoop-2.7.5 https://github.com/apache/hadoop/archive/rel/release-2.7.5.tar.gz
spark-2.3.0-bin-hadoop2.7 https://archive.apache.org/dist/spark/spark-2.3.0/spark-2.3.0-bin-hadoop2.7.tgz
2.搭建
(1) Hibench编译
mvn -Phadoopbench -Psparkbench -Dspark=2.1 -Dscala=2.11 clean package
(2)修改Hibench/conf下的hadoop.conf
cat hadoop.conf.template > hadoop.conf //重定向文件
vim hadoop.conf
修改hibench.hadoop.home
为hadoop-2.7.5
路径
修改hibench.hdfs.master
为hdfs端口
例如:hdfs://localhost:8020
(3)修改Hibench/conf下的spark.conf
cat spark.conf.template > spark.conf
vim spark.conf
修改hibenc