四、错误记录
1、配置文件中存在异常字符
二、guava版本不一致
一、安装环境
======
JDK 1.8
二、安装Hadoop
==========
1、下载hadoop
http://mirror.bit.edu.cn/apache/hadoop/ 选择合适的版本
下载hadoop
wget http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-3.3.0/hadoop-3.3.0.tar.gz
执行 进行解压,为了方便使用吗,mv进行修改名称
tar -xzvf hadoop-3.3.0.tar.gz
mv hadoop-3.3.0.tar.gz hadoop
2、修改环境变量
将hadoop环境信息写入环境变量中
vim /etc/profile
export HADOOP_HOME=/opt/hadoop
export PATH= H A D O O P H O M E / b i n : HADOOP_HOME/bin: HADOOPHOME/bin:PATH
执行source etc/profile使其生效
3、修改配置文件
修改hadoop-env.sh文件,vim etc/hadoop/hadoop-env.sh修改JAVA_HOME信息
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.262.b10-0.el7_8.x86_64
执行hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.0.jar grep input output ‘dfs[a-z]’,hadoop自带的例子,验证hadoop是否安装成功
三、安装hive
========
1、下载hive
wget http://mirror.bit.edu.cn/apache/hive/hive-3.1.2/apache-hive-3.1.2-bin.tar.gz
解压tar -zxvf apache-hive-3.1.2-bin.tar.gz
修改名称 mv apache-hive-3.1.2-bin hive
2、修改环境变量
vim /etc/profile
export HIVE_HOME=/opt/hive
export PATH= M A V E N H O M E / b i n : MAVEN_HOME/bin: MAVENHOME/bin:HIVE_HOME/bin: H A D O O P H O M E / b i n : HADOOP_HOME/bin: HADOOPHOME/bin:PATH
source etc/profile
3、修改hivesite 配置
javax.jdo.option.ConnectionUserName用户名
root
javax.jdo.option.ConnectionPassword密码
123456
javax.jdo.option.ConnectionURLmysql
jdbc:mysql: //127.0.0.1:3306/hive
javax.jdo.option.ConnectionDriverNamemysql驱动程序
com.mysql.jdbc.Driver
hive.exec.script.wrapper
复制mysql的驱动程序到hive/lib下面,然后进入/hive/bin 目录执行
schematool -dbType mysql -initSchema
4、验证是否安装成功
hive --version查看当前版本
hive 看是否进入hive命令操作行,进去的话说明成功
四、错误记录
======
1、配置文件中存在异常字符
根据指定的
Logging initialized using configuration in jar:file:/opt/hive/lib/hive-common- 3.1 . 2 .jar!/hive-log4j2.properties Async: true
Exception in thread “main” java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: KaTeX parse error: Expected '}', got 'EOF' at end of input: …a.io.tmpdir%7D/%7Bsystem:user.name%7D
at org.apache.hadoop.fs.Path.initialize(Path.java: 263 )
at org.apache.hadoop.fs.Path.(Path.java: 221 )
at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java: 710 )
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java: 627 )
at org.apache.hadoop.hive.ql.session.SessionState.beginStart(SessionState.java: 591 )
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java: 747 )
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java: 683 )
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java: 62 )
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java: 43 )
at
《一线大厂Java面试题解析+后端开发学习笔记+最新架构讲解视频+实战项目源码讲义》
【docs.qq.com/doc/DSmxTbFJ1cmN1R2dB】 完整内容开源分享
java.lang.reflect.Method.invoke(Method.java: 498 )
at org.apache.hadoop.util.RunJar.run(RunJar.java: 323 )
at org.apache.hadoop.util.RunJar.main(RunJar.java: 236 )
Caused by: java.net.URISyntaxException: Relative path in absolute URI: KaTeX parse error: Expected '}', got 'EOF' at end of input: …a.io.tmpdir%7D/%7Bsystem:user.name%7D