<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[Java_Road_Far的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/Java_Road_Far</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; Java_Road_Far]]></copyright><item><title><![CDATA[centos7安装mysql问题]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/106379376</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/106379376</guid><author>Java_Road_Far</author><pubDate>Wed, 27 May 2020 12:56:20 +0800</pubDate><description><![CDATA[异常信息:
warning: user mysql does not exist - using root


解决办法:
yum install -y perl-Module-Install.noarch


]]></description><category></category></item><item><title><![CDATA[CDH安全之Sentry权限管理]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/106256873</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/106256873</guid><author>Java_Road_Far</author><pubDate>Thu, 21 May 2020 16:15:35 +0800</pubDate><description><![CDATA[文章目录一、Sentry概述1.1 Sentry是什么1.2 Sentry中的角色二、Sentry安装部署三、Sentry与Hive/Impala集成3.1 修改配置参数3.2 配置Hive使用Sentry3.3 配置Impala使用Sentry3.4 配置HDFS权限与Sentry同步四、Sentry 授权4.1 基于 Hue4.2 基于 命令行

一、Sentry概述
cdh 版本的 hadoop 在对数据安全上的处理通常采用 Kerberos+Sentry 的结构。
kerberos 主要负责平台用户]]></description><category></category></item><item><title><![CDATA[hue: There are currently no roles defined]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/106250348</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/106250348</guid><author>Java_Road_Far</author><pubDate>Thu, 21 May 2020 14:19:31 +0800</pubDate><description><![CDATA[这个原因是这个用户没有查看的权限，hive，hue就可以，因为sentry中没有配置default组为超级组

在hue中创建hive账号、hive组，使用该账号登陆, 即可添加角色


]]></description><category></category></item><item><title><![CDATA[CDH 查询 Hive执行过的SQL语句]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/106016939</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/106016939</guid><author>Java_Road_Far</author><pubDate>Sat, 09 May 2020 13:14:23 +0800</pubDate><description><![CDATA[一、打开 CDH


二、设置参数


]]></description><category></category></item><item><title><![CDATA[二、Flink基础之 部署模式]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105486151</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105486151</guid><author>Java_Road_Far</author><pubDate>Mon, 13 Apr 2020 13:12:36 +0800</pubDate><description><![CDATA[文章目录一、Standalone模式1.1 下载flink安装包1.2 安装 flink1.3 配置文件二、Yarn模式三、Kubernetes部署

一、Standalone模式
1.1 下载flink安装包
https://flink.apache.org/downloads.html

1.2 安装 flink
解压即可

1.3 配置文件


vim conf/flink-conf.yam...]]></description><category></category></item><item><title><![CDATA[window10 下使用 nc 工具]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105485946</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105485946</guid><author>Java_Road_Far</author><pubDate>Mon, 13 Apr 2020 12:25:13 +0800</pubDate><description><![CDATA[文章目录一、下载地址二、使用

一、下载地址
https://eternallybored.org/misc/netcat/
二、使用
将解压后的单个文件全部拷贝到  C:\Windows\System32 的文件夹下。
注意：不是拷贝整个文件夹，而是文件夹里面的全部文件。
nc -l -p 7777


...]]></description><category></category></item><item><title><![CDATA[一、Flink基础 之 wordcount]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105485731</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105485731</guid><author>Java_Road_Far</author><pubDate>Mon, 13 Apr 2020 12:22:38 +0800</pubDate><description><![CDATA[文章目录一、搭建maven工程1.1 pom 文件1.2 添加scala框架 和 scala文件夹1.3 批处理wordcount1.4 流处理 wordcount

一、搭建maven工程
1.1 pom 文件
&lt;?xml version="1.0" encoding="UTF-8"?&gt;
&lt;project xmlns="http://maven.apache.org/POM/4...]]></description><category></category></item><item><title><![CDATA[CentOS 修改主机名和IP]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105319218</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105319218</guid><author>Java_Road_Far</author><pubDate>Sat, 04 Apr 2020 22:59:58 +0800</pubDate><description><![CDATA[文章目录一、修改主机名二、修改 ip

一、修改主机名
hostnamectl set-hostname 主机名


二、修改 ip
vim /etc/sysconfig/network-scripts/ifcfg-ens33 

TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=static
IPADDR=192.168.161....]]></description><category></category></item><item><title><![CDATA[Centos7.7 CDH6.2.1 安装教程]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105318724</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105318724</guid><author>Java_Road_Far</author><pubDate>Sat, 04 Apr 2020 22:34:45 +0800</pubDate><description><![CDATA[文章目录此教程以 6.2.0 的版本为例一、下载

此教程以 6.2.0 的版本为例

一、下载

CDH下载地址
下载cdh
选择对应linux的下载，例如我下载的是 centos7.7 下使用的cdh6.2.0

下载cm



...]]></description><category></category></item><item><title><![CDATA[定时清空 HBase 表]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105286041</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105286041</guid><author>Java_Road_Far</author><pubDate>Fri, 03 Apr 2020 09:56:42 +0800</pubDate><description><![CDATA[文章目录一、 需求二、实现
一、 需求
业务上需要将当天的数据写入hbase 提供给后台查询前台展示，第二天清空前一天的数据

二、实现


vim truncateGpsToDay.sh
truncate 'TBL_GPS_TODAY'



executorTruncateToDay.sh
hbase shell /root/truncateGpsToDay.sh



配置定时任务
0 0 ...]]></description><category></category></item><item><title><![CDATA[Spark 任务停止后自动重启]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105130204</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/105130204</guid><author>Java_Road_Far</author><pubDate>Thu, 26 Mar 2020 22:36:33 +0800</pubDate><description><![CDATA[#! /bin/bash
status="RUNNING"
programStatus=`yarn application -list |grep YARN-NAME| awk '{print $6}'`
if [ "$status" == "$programStatus" ]
then
        #"程序正在运行..."
else
        echo `date "+%Y-%m-%d...]]></description><category></category></item><item><title><![CDATA[mysql 5.7.20下载、安装和配置方法及简单操作技巧(window绿色版)]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/78743959</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/78743959</guid><author>Java_Road_Far</author><pubDate>Wed, 18 Mar 2020 14:34:59 +0800</pubDate><description><![CDATA[下载： 
https://dev.mysql.com/downloads/mysql/ 
 
 
直接下载，无需注册和登录。
安装： 
将下载的mysql压缩包解压后的整个目录放在指定目录 配置： 
新建一个ini文件，并命名为my.ini，放置到mysql安装目录中。文件内容是：
[mysql] 
# 设置mysql客户端默认字符集 
default-character-set=utf8 
[my]]></description><category></category></item><item><title><![CDATA[Hive on Spark 参数调优]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/104899098</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/104899098</guid><author>Java_Road_Far</author><pubDate>Mon, 16 Mar 2020 14:48:33 +0800</pubDate><description><![CDATA[文章目录前言executor参数spark.executor.coresspark.executor.memory/spark.yarn.executor.memoryOverheadspark.executor.instancesspark.dynamicAllocation.enabledDriver参数spark.driver.coresspark.driver.memory/spark.d...]]></description><category></category></item><item><title><![CDATA[CentOS7 下安装 Docker]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/104732301</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/104732301</guid><author>Java_Road_Far</author><pubDate>Sun, 08 Mar 2020 15:07:12 +0800</pubDate><description><![CDATA[文章目录一、前提条件二、卸载旧版本三、安装
一、前提条件
操作系统要求
要安装Docker Engine-Community，您需要一个CentOS 7的维护版本。不支持或未测试存档版本。
二、卸载旧版本
较旧的Docker版本称为docker或docker-engine。如果已安装这些程序，请卸载它们以及相关的依赖项。
$ sudo yum remove docker docker-client...]]></description><category></category></item><item><title><![CDATA[CDH 平台安装 Apache Phoenix]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/104616402</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/104616402</guid><author>Java_Road_Far</author><pubDate>Mon, 02 Mar 2020 20:25:49 +0800</pubDate><description><![CDATA[文章目录下载 Phoenix解压拷贝指定 jar到 HBase 的lib目录在 CDG - hbase配置中加入相关参数将 hdfs 和 hbase 相关配置文件拷贝到 Phoenix/bin目录下重启 Hbase即可连接Phoenix
下载 Phoenix
http://phoenix.apache.org/download.html

解压
[root@bigdata-5 ~]# tar -z...]]></description><category></category></item><item><title><![CDATA[Hive beeline连接]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/104584191</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/104584191</guid><author>Java_Road_Far</author><pubDate>Sat, 29 Feb 2020 22:49:35 +0800</pubDate><description><![CDATA[启动hiveserver2服务
[kino@bigdata01.sutpc hive]$ bin/hiveserver2


启动beeline
[kino@bigdata01.sutpc hive]$ bin/beeline
Beeline version 1.2.1 by Apache Hive
beeline&gt;


连接hiveserver2
beeline&gt; !connect ...]]></description><category></category></item><item><title><![CDATA[This account is currently not available（用户当前不可用）]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/103955515</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/103955515</guid><author>Java_Road_Far</author><pubDate>Mon, 13 Jan 2020 11:50:32 +0800</pubDate><description><![CDATA[在安装好 CDH 之后，使用安装时自动创建的 hdfs 用户登录不了
[root@bigdata-3 ~]# su hdfs
This account is currently not available.

原因是此用户的shell是/sbin/nologin需修改成/bin/bash

...]]></description><category></category></item><item><title><![CDATA[Hive 导出 csv 文件]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/103671065</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/103671065</guid><author>Java_Road_Far</author><pubDate>Mon, 23 Dec 2019 18:11:54 +0800</pubDate><description><![CDATA[hive -e "set hive.cli.print.header=true; select * from data_table where some_query_conditions " | sed 's/[\t]/,/g'  &gt; outputData.csv

参数说明:
- set hive.cli.print.header=true：输出表头
- sed 's/[\t]/,/g：将...]]></description><category></category></item><item><title><![CDATA[CDH 安装 Hue 连接不上MySQL]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/103442808</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/103442808</guid><author>Java_Road_Far</author><pubDate>Sun, 08 Dec 2019 10:55:24 +0800</pubDate><description><![CDATA[执行：yum install -y python-lxml   即可

]]></description><category></category></item><item><title><![CDATA[windows 下彻底删除免安装版mysql]]></title><link>https://blog.youkuaiyun.com/Java_Road_Far/article/details/78744422</link><guid>https://blog.youkuaiyun.com/Java_Road_Far/article/details/78744422</guid><author>Java_Road_Far</author><pubDate>Wed, 04 Dec 2019 18:29:11 +0800</pubDate><description><![CDATA[1、本方法是基于免安装版的mysql5.6.4 
2、方法： 
1）、删除mysql文件夹 
2）、开始-运行里面输入regedt，打开注册表.注册表里MySQL的项就是这三项： 
HKEY_LOCAL_MACHINE/SYSTEM/ControlSet001/Services/Eventlog/Application/MySQL 
HKEY_LOCAL_MACHINE/SYSTEM/Control]]></description><category></category></item></channel></rss>