- 博客(13)
- 资源 (1)
- 收藏
- 关注
RSS订阅
原创 2020_CDH_hadoop3_大数据环境搭建
文章目录一.标题安装Centos_6.9二.环境检查三.安装jdk_1.8四.安装zookeeper_3.4.9五.安装hadoop_3.1.1一.标题安装Centos_6.9二.环境检查三.安装jdk_1.8四.安装zookeeper_3.4.9五.安装hadoop_3.1.1文章尚未完成
2020-07-04 15:26:05
680
1
原创 There are 2 missing blocks. The following files may be corrupted
项目场景：集群断电重启块丢失,50070页面报错:There are 2 missing blocks. The following files may be corrupted问题描述：There are 2 missing blocks. The following files may be corrupted 解决方案：1.哪一个文件的数据块丢失了:hdfs fsck / -list-corruptfileblocks2.删除数据块信息: hdfs fsck 路径 -delete
2020-12-07 18:36:26
2047
原创 There appears to be a gap in the edit log. We expected txid 867311, but got txid 867402.
项目场景：集群断电之后重启集群,namenode启动失败,去hadoop安装目录差看日志/hadoop/logs 发现There appears to be a gap in the edit log. We expected txid 867311, but got txid 867402.问题描述：down standby NN.java.io.IOException: There appears to be a gap in the edit log. We expected txi
2020-12-07 18:34:10
1122
3
原创 process information unavailable
项目场景：– process information unavailable解决方案：cd /tmprm -rf hsperfdata_*
2020-12-07 18:31:13
252
原创 Journal Storage Directory /tmp/hadoop/dfs/journalnode/ns not formatted
Journal Storage Directory /tmp/hadoop/dfs/journalnode/ns not formatted项目场景：项目背景：大数据集群断电关机,强制关机,非正常关机,没有关闭服务关机造成的问题:Journal Storage Directory /tmp/hadoop/dfs/journalnode/ns not formatted报错：2020-12-07 15:02:47,704 INFO org.apache.hadoop.hdfs.qjournal.cl
2020-12-07 18:30:03
1956
2
原创 Exception in thread “main“ java.lang.NoClassDefFoundError: org/python/core/PyObject
idea Exception in thread "main" java.lang.NoClassDefFoundError: org/python/core/PyObject报错原因：maven xml配置文件修改：修改成这样的就会生成2个jar包，把大的jar包传到linux上运行 就可以解决 java.lang.NoClassDefFoundError: org/python/core/PyObject报错SLF4J: Class path contains multiple SLF4J
2020-12-01 11:05:00
1439
原创 FAILED: HiveException java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.me
文章目录问题背景:版本问题原因:mysql出现问题导致hive报错解决办法:FAILED: HiveException java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient问题背景:版本JDK:1.8.0_141hive:3.1.0mysql:8.0.20问题原因:mysql出现问题导致hive报错解决办法:https
2020-08-10 22:31:48
1730
原创 Can‘t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock‘ (111)
文章目录问题背景:版本问题原因:集群断电,mysql启动不起来解决办法:三步骤Can’t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock’ (111)问题背景:版本mysql:8.0.20JDK:1.8.0_141问题原因:集群断电,mysql启动不起来解决办法:三步骤删掉mysql.sockcd /var/lib/mysqlrm -rf mysql.sock给mysql添加权限ch
2020-08-10 22:26:04
1533
6
原创 ERROR:java.lang.RuntimeException: java.lang.ClassNotFoundException: Class cn.itcast.xx.xx not found
文章目录Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class cn.itcast.mapreduce.WordCountMapper not found问题背景:版本问题原因:找不到类,主程序中缺少配置解决办法:job.setJarByClass(JobMain.class);Error: java.lang.RuntimeException: java.lang.ClassNotFoundException:
2020-07-06 15:11:48
3828
5
原创 idea 打包 报错maven-shade-plugin:2.4.3:shade (default) on project xxx : Error creating shaded jar: null
idea 打包 报错maven-shade-plugin:2.4.3:shade (default) on project xxx : Error creating shaded jar: null背景:idea版本:ideaIU-2020.1.2JDK:1.8.0_141maven版本:3.6.3原因:maven-shade-plugin的版本太低<plugin> <groupId>org.apache.maven.plugins&l
2020-07-06 14:26:59
7380
4
原创 idea 打包package 的时候警告:Discovered module-info.class. Shading will break its strong encapsulation.
idea 打包package 的时候警告:Discovered module-info.class. Shading will break its strong encapsulation.问题背景:idea版本:ideaIU-2020.1.2JDK:1.8.0_141maven版本:3.6.3maven-shade-plugin:3.2.1<?xml version="1.0" encoding="UTF-8"?><project xmlns="http://maven
2020-07-06 14:15:30
6315
原创 四.安装zookeeper_3.4.9
文章目录四.安装zookeeper_3.4.9第一步:[下载](http://archive.apache.org/dist/zookeeper/)zookeeeper的压缩包第二步:解压第三步:修改配置文件第四步:添加myid配置第五步:安装包分发并修改myid的值四.安装zookeeper_3.4.9第一步:下载zookeeeper的压缩包下载版本3.4.9http://archive.apache.org/dist/zookeeper/下载完成上传到linux的/export/softw
2020-07-04 16:00:01
1929
1
原创 2020最详细下载安装注册最新版 Secure CRT 8.7
一.下载SecureCRT 8.7官网下载网址:https://www.vandyke.com/products/securecrt/2.选择系统3.选择64位或者32位4.输入邮箱密码邮箱admin@mail.bccto.me密码wheretogo88885.带红色 * 的都选上点击下载,下载成功 文件名 scrt-x64.8.7.2.2214.exe二.安装SecureCRT 8.7三.破解SecureCRT 8.7转载:https://blog.csdn.n
2020-06-23 17:32:25
199593
76
hive-jdbc-1.2.1-standalone.jar
2020-10-21
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人