Hibench简易教程

1.准备

Hibench-7.0 https://github.com/Intel-bigdata/HiBench/archive/HiBench-7.0.tar.gz

Hadoop-2.7.5 https://github.com/apache/hadoop/archive/rel/release-2.7.5.tar.gz

spark-2.3.0-bin-hadoop2.7 https://archive.apache.org/dist/spark/spark-2.3.0/spark-2.3.0-bin-hadoop2.7.tgz

2.搭建

(1) Hibench编译

mvn -Phadoopbench -Psparkbench -Dspark=2.1 -Dscala=2.11 clean package

(2)修改Hibench/conf下的hadoop.conf

cat hadoop.conf.template > hadoop.conf  //重定向文件
vim hadoop.conf

修改hibench.hadoop.home为hadoop-2.7.5路径
修改hibench.hdfs.master为hdfs端口例如：hdfs://localhost:8020

(3)修改Hibench/conf下的spark.conf

cat spark.conf.template > spark.conf
vim spark.conf

修改hibenc