<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[keepHungery的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/keepHungery</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; keepHungery]]></copyright><item><title><![CDATA[设计模式之简单工厂模式]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/132613423</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/132613423</guid><author>keepHungery</author><pubDate>Thu, 31 Aug 2023 23:57:28 +0800</pubDate><description><![CDATA[使用单独的一个类做创造实例的过程，对业务计算，界面进行解耦，添加操作只需要添加新的类继承Operation类，并在工厂类中添加新的操作就可以，不用修改其他操作。]]></description><category></category></item><item><title><![CDATA[SparkSQL-Antl4编译器学习]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/130695589</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/130695589</guid><author>keepHungery</author><pubDate>Tue, 16 May 2023 00:53:23 +0800</pubDate><description><![CDATA[官网地址：https://www.antlr.org/ANTLR是开源的语法解析器生成器，距今已有30多年的历史。是一个经历了时间考验的开源项目。一个程序从源代码到机器可执行，基本需要3个阶段：编写、编译、执行。在编译阶段，需要进行词法和语法的分析。ANTLR聚焦的问题就是把源码进行词法和句法分析，产生一个树状的分析器。ANTLR几乎支持对所有主流编程语言的解析。从antlr/grammars-v4可以看到，ANTLR支持Java,C, Python, SQL等数十种编程语言。]]></description><category></category></item><item><title><![CDATA[shell脚本练习目录文件大小复制文件到别处]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/126295763</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/126295763</guid><author>keepHungery</author><pubDate>Fri, 12 Aug 2022 00:23:50 +0800</pubDate><description><![CDATA[shell 脚本  目录 根据文件大小进行移动]]></description><category></category></item><item><title><![CDATA[sql题：每个网站访问top3 的用户]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/126271078</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/126271078</guid><author>keepHungery</author><pubDate>Wed, 10 Aug 2022 17:36:10 +0800</pubDate><description><![CDATA[sql 学习]]></description><category></category></item><item><title><![CDATA[linux系统shell 脚本中$*,$？的含义]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/126239433</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/126239433</guid><author>keepHungery</author><pubDate>Tue, 09 Aug 2022 01:45:36 +0800</pubDate><description><![CDATA[shell 脚本中一些变量的含义]]></description><category></category></item><item><title><![CDATA[Python在linux环境下的安装]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/126203783</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/126203783</guid><author>keepHungery</author><pubDate>Sun, 07 Aug 2022 00:47:22 +0800</pubDate><description><![CDATA[linux 环境下的python 安装]]></description><category></category></item><item><title><![CDATA[Hive执行中Reducers个数确定]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/124297997</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/124297997</guid><author>keepHungery</author><pubDate>Wed, 20 Apr 2022 15:14:27 +0800</pubDate><description><![CDATA[其中  hive.exec.reducers.bytes.per.reducer：默认 256M

]]></description><category></category></item><item><title><![CDATA[Linux之 salt 同步文件总结]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/123430724</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/123430724</guid><author>keepHungery</author><pubDate>Fri, 11 Mar 2022 17:54:51 +0800</pubDate><description><![CDATA[salt命令
官网地址
https://docs.saltproject.io/en/latest/ref/file_server/index.html
文件同步

 salt 'hadoop*' cp.get_file  salt://yarn-site.conf    /usr/local/hadoop/etc/hadoop/yarn-site.conf   

salt://yarn-site.conf  指 为saltStack  服务器： /srv/salt/路径下的文件

...]]></description><category></category></item><item><title><![CDATA[hive 基本命令]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/120652462</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/120652462</guid><author>keepHungery</author><pubDate>Fri, 08 Oct 2021 15:21:02 +0800</pubDate><description><![CDATA[创建数据仓库

create database if not exist   database_name


添加字段
字段column_1,column_2将添加在原表的最后面

alter table table_name add columns (day date ,update_time timestamp) 


删除分区

ALTER TABLE ods_sq_miaoplus_open_heart_rate_record_i_d DROP PARTITION (ds &gt;='2021-0.]]></description><category></category></item><item><title><![CDATA[txt文件导入kafka]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/119110351</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/119110351</guid><author>keepHungery</author><pubDate>Mon, 26 Jul 2021 20:47:36 +0800</pubDate><description><![CDATA[txt文件导入kafkashell脚本导入java代码导入
shell脚本导入
#!/bin/sh
## 参数定义
dt=`date +"%Y%m%d" -d "-1 days"`
outpath=/home/etl/test/test.txt   
brokerlist='kakfa卡集群地址'

echo $dt $outpath $brokerlist
## 判断文件大小，如果大于0，则加载文件，写入kafka
## 注意 结尾的 | &gt; out.txt要加上，否则会出现很多奇怪的大于号
fil]]></description><category></category></item><item><title><![CDATA[Sqoop导入导出总结]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/108089420</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/108089420</guid><author>keepHungery</author><pubDate>Tue, 18 Aug 2020 22:35:00 +0800</pubDate><description><![CDATA[Sqoop命令
全量导入
bin/sqoop import \ (输入命令)
--connect jdbc:mysql://hadoop102:3306/testdb \ (指定连接jdbc端口和数据库名称)
--username root \ (数据库用户名)
--password 000000 \ (密码 若不适用明文指定数据库密码 则可以用-P)
--table user \ (指定数据库中的一张表)
--target-dir /input/import \ (指定数据导入到HDFS上的目录)
--d]]></description><category></category></item><item><title><![CDATA[Git的基本使用]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/107697067</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/107697067</guid><author>keepHungery</author><pubDate>Thu, 30 Jul 2020 18:53:31 +0800</pubDate><description><![CDATA[1、Git简介
1.1、Git结构

本地库：存储历史版本
暂存区：临时存储 ，git  commit  提交  到本地库
工作区：写代码使用  ，git add   提交到 暂存区

1.2、Git和代码托管中心
代码托管中心：维护远程库
局域网：Gitlab服务器
外网: gitHub和码云
1.3、团队内部和跨团队合作


2、Git的常用命令
2.1、本地库初始化
命令：
git init

生产  .git/目录
[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-ync]]></description><category></category></item><item><title><![CDATA[Sql练习题总结持续更新]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/107335834</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/107335834</guid><author>keepHungery</author><pubDate>Tue, 14 Jul 2020 12:54:55 +0800</pubDate><description><![CDATA[Sql练习题总结
1.求公交线
1.数据

1       0       1       四惠
1       0       2       天通苑
1       0       3       立水桥
1       1       1       立水桥
1       1       2       天通苑
1       1       3       四惠
2       0       1       A
2       0       2       B
2       0       ]]></description><category></category></item><item><title><![CDATA[Scala学习笔记持续更新]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/106248179</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/106248179</guid><author>keepHungery</author><pubDate>Thu, 21 May 2020 02:03:41 +0800</pubDate><description><![CDATA[Scala学习笔记
方法和函数的区别


Scala中的方法和Java中的方法相同，方法是组成类的一部分。方法有名字和签名，同时还有注解，以及方法的功能。


Scala中的函数是一个完整的对象，Scala中用22个特质（trait）抽象出了函数的概念。]\
例如：Function2的函数：
trait Function2[@specialized(scala.Int, scala.Long, scala.Double) -T1, @specialized(scala.Int, scala.Long, sc]]></description><category></category></item><item><title><![CDATA[SQL的规范]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/106122405</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/106122405</guid><author>keepHungery</author><pubDate>Thu, 14 May 2020 16:15:59 +0800</pubDate><description><![CDATA[SQL的规范


合理定义表名，数仓中不同层要以不同的层的名字作为开头，一般表名开头为字母


注释，单行注释，多行注释，方便以后阅读
-- 单行注释
-- 从SomeTable中查询col_1 
SELECT col_1
  FROM SomeTable;

/*
多行注释
从 SomeTable 中查询 col_1 
*/
SELECT col_1
  FROM SomeTable;



注意缩进,提高可读性
-- 好的缩进
SELECT col_1, 
    col_2, 
    col_3,
]]></description><category></category></item><item><title><![CDATA[Canal的使用]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/106039787</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/106039787</guid><author>keepHungery</author><pubDate>Sun, 10 May 2020 18:16:42 +0800</pubDate><description><![CDATA[Canal的使用
Canal概述
canal是用java开发的基于数据库增量日志解析，提供增量数据订阅&amp;消费的中间件。目前，canal主要支持了MySQL的binlog解析，解析完成后才利用canal client 用来处理获得的相关数据。（数据库同步需要阿里的otter中间件，基于canal）。
使用场景


原始场景：作为异地数据库之间的数据同步
[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-yV8DrEZV-1589105749424)(C:\Users\txc]]></description><category></category></item><item><title><![CDATA[Redis简介学习]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/105877061</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/105877061</guid><author>keepHungery</author><pubDate>Fri, 01 May 2020 16:50:38 +0800</pubDate><description><![CDATA[Redis学习Redis简介简单介绍redis的安装为什么使用NOSQL单机 MySQL 的美好时代Memcached(缓存)+MySQL+垂直拆分Mysql主从读写分离分库分表+水平拆分+mysql集群四种NoSQL对比3V+3高ACIDCAP为何CAP三者不可兼得Base分布式和集群Redis的数据类型公用命令key的命名建议Stringhashlistsetzset解析配置文件Redis的持...]]></description><category></category></item><item><title><![CDATA[Kafka常用的操作命令]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/105847984</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/105847984</guid><author>keepHungery</author><pubDate>Wed, 29 Apr 2020 20:31:22 +0800</pubDate><description><![CDATA[查看当前服务器中的所有topic

bin/kafka-topics.sh --zookeeper hadoop102:2181 --list


创建topic

bin/kafka-topics.sh --zookeeper hadoop102:2181 --create --replication-factor 3 --partitions 1 --topic first
    --to...]]></description><category></category></item><item><title><![CDATA[解决 scala - Apache Flink Streaming 的 type mismatch in flatMap function]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/105729537</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/105729537</guid><author>keepHungery</author><pubDate>Fri, 24 Apr 2020 14:02:56 +0800</pubDate><description><![CDATA[当我使用Flink 为1.7.2,Scala为2.11时，使用Flatmap函数时会报错

点进去Flatmap查看代码时发现，系统自动导入的时java的代码

解决办法
只需要导入
org.apache.flink.streaming.api.scala.StreamExecutionEnvironment.  即可


...]]></description><category></category></item><item><title><![CDATA[Hive的优化]]></title><link>https://blog.youkuaiyun.com/keepHungery/article/details/105648578</link><guid>https://blog.youkuaiyun.com/keepHungery/article/details/105648578</guid><author>keepHungery</author><pubDate>Tue, 21 Apr 2020 11:11:16 +0800</pubDate><description><![CDATA[Hive调优概述
影响]]></description><category></category></item></channel></rss>