<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[寒夜二十五]]></title><description><![CDATA[我看青山多妩媚，青山视我亦如是]]></description><link>https://blog.youkuaiyun.com/LL9504</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; LL9504]]></copyright><item><title><![CDATA[hive sql 的一些优化点]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/129838199</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/129838199</guid><author>LL9504</author><pubDate>Wed, 29 Mar 2023 15:34:19 +0800</pubDate><description><![CDATA[转载一位博主的文章，内容很详细也很全面，学到了之前没有注意到的细节问题。]]></description><category></category></item><item><title><![CDATA[hivesql怎么排查是哪里出现了数据倾斜]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/129751504</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/129751504</guid><author>LL9504</author><pubDate>Fri, 24 Mar 2023 15:16:43 +0800</pubDate><description><![CDATA[转载下这位博主的文章，写的非常好，步骤非常清晰，学习一下。]]></description><category></category></item><item><title><![CDATA[[Fatal Error] total number of created files now is 100576, which exceeds 100000. Killing the job.]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/126302982</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/126302982</guid><author>LL9504</author><pubDate>Fri, 12 Aug 2022 14:04:13 +0800</pubDate><description><![CDATA[hive在把一张表的数据插入到另一张分区表时，经常会报这个创建文件数超出限制的错误。]]></description><category></category></item><item><title><![CDATA[org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Could not find status of job:job_1649726530586_123811]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/125019580</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/125019580</guid><author>LL9504</author><pubDate>Sat, 28 May 2022 16:19:36 +0800</pubDate><description><![CDATA[hive sql在跑的时候可能会出现下面的问题：


return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Could not find status of job:job_1649726530586_123811 (state=08S01,code=1)



会报一个job名字长度超出限制的问题：

解决方法： set hive.jobname.length=10;



这里引用以为博主的例子，原文可以去这里查看

hiv..]]></description><category></category></item><item><title><![CDATA[hivesql的几种优化的方法]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/123966102</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/123966102</guid><author>LL9504</author><pubDate>Tue, 05 Apr 2022 11:07:09 +0800</pubDate><description><![CDATA[目前项目中由于数据量巨大，导致一个sql要跑一个多小时，所以找了些可以优化的点，记录下来，以后方便使用。

1.map的优化，job在map task的过程时间较长

set mapreduce.map.memory.mb=8240;
set mapreduce.reduce.memory.mb=8240;
set hive.merge.mapfiles=false;
set mapreduce.input.fileinputformat.split.maxsize=50000000;
set hive.e]]></description><category></category></item><item><title><![CDATA[kylin使用过程中遇到的问题]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/122926166</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/122926166</guid><author>LL9504</author><pubDate>Mon, 14 Feb 2022 15:53:27 +0800</pubDate><description><![CDATA[一个小细节，需要注意下
]]></description><category></category></item><item><title><![CDATA[git配置]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/122446339</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/122446339</guid><author>LL9504</author><pubDate>Wed, 12 Jan 2022 09:26:08 +0800</pubDate><description><![CDATA[git config --global user.name "ll"
git config --global user.email "ll@qq.com"
ssh-keygen -t rsa -C "ll@qq.com"
]]></description><category></category></item><item><title><![CDATA[hive的sql优化方法[持续更新]]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/117530154</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/117530154</guid><author>LL9504</author><pubDate>Thu, 03 Jun 2021 17:38:02 +0800</pubDate><description><![CDATA[①列的裁剪，查询时只写我们需要的字段，提高效率

②两张表关联时，可以把数据量小的表写在前面，大表写在后面，这样在加载时会把小表加载到内存中，减少资源占用。

③
]]></description><category></category></item><item><title><![CDATA[Linux查找常用命令]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/117465630</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/117465630</guid><author>LL9504</author><pubDate>Wed, 02 Jun 2021 13:57:46 +0800</pubDate><description><![CDATA[cat -n app.log | grep "error" --color：查询日志中含有某个关键字error的信息，显示行号，带颜色的
]]></description><category></category></item><item><title><![CDATA[unix_timestamp（）和 from_unixtime（）的用法]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/117465264</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/117465264</guid><author>LL9504</author><pubDate>Wed, 02 Jun 2021 13:32:34 +0800</pubDate><description><![CDATA[hive中的unix_timestamp（）和 from_unixtime（）用法：

unix_timestamp() 得到当前时间戳


]]></description><category></category></item><item><title><![CDATA[oracle A用户给B用户赋权限]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/117462005</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/117462005</guid><author>LL9504</author><pubDate>Wed, 02 Jun 2021 10:27:54 +0800</pubDate><description><![CDATA[当oracle用户A创建一张表,想给用户B赋权的命令：

grant select,insert,update,delete on ownerA.tableA to owner
]]></description><category></category></item><item><title><![CDATA[查看oracle的表的字段类型]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/117461457</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/117461457</guid><author>LL9504</author><pubDate>Wed, 02 Jun 2021 10:20:09 +0800</pubDate><description><![CDATA[查看oracle中的表的字段类型的sql:

select COLUMN_NAME,DATE_TYPE,DATA_LENGTH,DATA_PRECISION from all_tab_columns
]]></description><category></category></item><item><title><![CDATA[sqoop抽取或者推送数据常见问题 [持续更新]]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/117460539</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/117460539</guid><author>LL9504</author><pubDate>Wed, 02 Jun 2021 10:04:27 +0800</pubDate><description><![CDATA[当报表找不到的错误时（table is not exist...）
解决方法：


]]></description><category></category></item><item><title><![CDATA[guass白名单的配置命令]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/117460073</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/117460073</guid><author>LL9504</author><pubDate>Wed, 02 Jun 2021 09:41:27 +0800</pubDate><description><![CDATA[source /opt/huawei/Bigdate/mppdb/.mppdbgs_profile;

gs_guc set -Z coordinator -N all -h "host a"
]]></description><category></category></item><item><title><![CDATA[sqoop数据迁移脚本（导入，导出 mysql,oracle等）]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/115701322</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/115701322</guid><author>LL9504</author><pubDate>Wed, 14 Apr 2021 16:19:48 +0800</pubDate><description><![CDATA[1.oracle导入到hive脚本


/home/sqoop/sqoop-1.4.7.bin__hadoop-2.6.0/bin/sqoop import

--username admin

--password '123456'

--connect jdbc:oracle:thin:@192.168.127.1:1521/数据库名

--fields-terminated-by '\001'

--null-non-string '\\N'

--null-string '\\N'

--dele.]]></description><category></category></item><item><title><![CDATA[hive建表语句]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/115700969</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/115700969</guid><author>LL9504</author><pubDate>Wed, 14 Apr 2021 15:56:49 +0800</pubDate><description><![CDATA[hive建表：

内部表：


#创建内部表
create table LL_test (

id int,

name string,

age int

)

row format delimited fields terminated by '\001'

stored as textfile;

外部表：


#创建外部表

create  external table LL_test (

id int,

name string,

age int

)

row format delimite]]></description><category></category></item><item><title><![CDATA[hive清空外部表的三种方式]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/113373098</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/113373098</guid><author>LL9504</author><pubDate>Fri, 29 Jan 2021 13:07:32 +0800</pubDate><description><![CDATA[本文为转载，原文链接：

https://blog.youkuaiyun.com/lixiaoksi/article/details/106919895

https://blog.youkuaiyun.com/elizabethxxy/article/details/108912884

本文总结hive中清空外部表的三种方式

hive版本：2.1.1

环境准备

新建一张外部表：

create external table test_external(name String,age int,sex String) s..]]></description><category></category></item><item><title><![CDATA[Cisco Vpn的安装过程]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/113343133</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/113343133</guid><author>LL9504</author><pubDate>Thu, 28 Jan 2021 15:36:59 +0800</pubDate><description><![CDATA[1.自定义文件夹 2.解压



出现这个错误时，需要修改为开发者模式



























点击后如出现28000错误，再点击









安装完成后，启动客户端


]]></description><category></category></item><item><title><![CDATA[Java反射机制的使用]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/108615026</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/108615026</guid><author>LL9504</author><pubDate>Wed, 16 Sep 2020 09:40:12 +0800</pubDate><description><![CDATA[参考博客:https://www.cnblogs.com/lzfsuifeng/p/9590705.html

博主写的很详细,这里截取部分经常用到的记录下:


什么是Java反射机制？
     JAVA反射机制是在运行状态中，对于任意一个类，都能够知道这个类的所有属性和方法；对于任意一个对象，都能够调用它的任意一个方法；这种动态获取的以及动态调用对象的方法的功能称为Java的反射机制。

反射机制提供了哪些功能？


在运行时判定任意一个对象所属的类

在运行时构造任意一个类的对象；

在运行时判定.]]></description><category></category></item><item><title><![CDATA[Java压缩一个文件夹或者文件的方法]]></title><link>https://blog.youkuaiyun.com/LL9504/article/details/108506946</link><guid>https://blog.youkuaiyun.com/LL9504/article/details/108506946</guid><author>LL9504</author><pubDate>Thu, 10 Sep 2020 09:14:48 +0800</pubDate><description><![CDATA[之前看过一位博主的文章,下面是主要的内容,不过原文地址不记得是什么了,侵删


import java.io.BufferedInputStream;
import java.io.BufferedOutputStream;
import java.io.File;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.util.zip.ZipEntry;
import java.util.zip.ZipO.]]></description><category></category></item></channel></rss>