<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[天天臭乐呵]]></title><description><![CDATA[If I rest, I rust]]></description><link>https://blog.youkuaiyun.com/lilychen1983</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; lilychen1983]]></copyright><item><title><![CDATA[Linux下Drools Workbench安装教程]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/88952208</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/88952208</guid><author>lilychen1983</author><pubDate>Mon, 01 Apr 2019 17:21:59 +0800</pubDate><description><![CDATA[1.安装文件下载

到以下地址下载包kie-drools-wb-7.2.0.Final-tomcat8.war

http://download.jboss.org/drools/release/7.2.0.Final/

依赖jar包可以直接去mvnrepository下载：

kie-tomcat-integration.jar
javax.security.jacc-api.jar
sl...]]></description><category></category></item><item><title><![CDATA[du和df目录大小不一致]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/81776207</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/81776207</guid><author>lilychen1983</author><pubDate>Fri, 17 Aug 2018 13:36:37 +0800</pubDate><description><![CDATA[du -sh发现目录大小只有400多M，但是df -h发现有5G

解决方法：

lsof | grep deleted

 

查找删除的进程，kill -9 进程号删除即可解决问题。]]></description><category></category></item><item><title><![CDATA[hive中修改表、分区、列]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/81568199</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/81568199</guid><author>lilychen1983</author><pubDate>Fri, 10 Aug 2018 18:39:51 +0800</pubDate><description><![CDATA[修改表的语句允许改变现有表的结构，通过该语句可以增加列/分区，修改SerDe，增加表和SerDe的属性或者重命名表。与之类似，修改分区的语句可以改变指定分区的属性。

重命名表

重命名表的语句如下：

 


ALTER TABLE table_name RENAME TO new_table_name

 

修改表属性

修改表属性的语句如下：

 


ALTER TABLE table_...]]></description><category></category></item><item><title><![CDATA[使用impala-shell导入导出数据]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/81316270</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/81316270</guid><author>lilychen1983</author><pubDate>Tue, 31 Jul 2018 16:53:35 +0800</pubDate><description><![CDATA[(tip:将select * from sq_dim_city，替换为需要导出的查询sql即可,分割符号可以自选)
参数说明：
　　• -q query （--query=query） 从命令行执行查询，不进入impala-shell
　　• -d default_db （--database=default_db） 指定数据库
　　• -B（--delimited）去格式化输出
　　• --ou...]]></description><category></category></item><item><title><![CDATA[hue中oozie从mysql导入hive报错Could not load db driver class: com.mysql.jdbc.Driver]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/81171162</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/81171162</guid><author>lilychen1983</author><pubDate>Mon, 23 Jul 2018 17:15:58 +0800</pubDate><description><![CDATA[解决方法：

将mysql-connector-java.jar上传到hdfs：/user/oozie/share/lib/lib_timstamp/sqoop

重启oozie服务。]]></description><category></category></item><item><title><![CDATA[重装hdfs后，oozie报错Could not locate Oozie sharelib]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/81167623</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/81167623</guid><author>lilychen1983</author><pubDate>Mon, 23 Jul 2018 16:51:23 +0800</pubDate><description><![CDATA[下载地址：http://archive.cloudera.com/cdh5/cdh/5/oozie-4.1.0-cdh5.14.2.tar.gz

 

将tar包上传到服务器:



$ mkdir /tmp/ooziesharelib
$ cd /tmp/ooziesharelib
$ tar -zxvf  oozie-4.1.0-cdh5.14.2.tar.gz
$ cd oozie-4.1...]]></description><category></category></item><item><title><![CDATA[oozie中调度sqoop]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/81082930</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/81082930</guid><author>lilychen1983</author><pubDate>Tue, 17 Jul 2018 16:02:42 +0800</pubDate><description><![CDATA[创建目录sqoop，以下所有目录和文件都放在sqoop目录下。

1.创建目录lib，拷贝msql的jar包到该目录

mysql-connector-java.jar

2.job.properties文件

内容如下：


nameNode=hdfs://ip-150:8020
jobTracker=ip-150:8032
queueName=default
oozieappsRoot=use...]]></description><category></category></item><item><title><![CDATA[hue中调度oozie总是显示heart beat]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/81079568</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/81079568</guid><author>lilychen1983</author><pubDate>Tue, 17 Jul 2018 13:26:33 +0800</pubDate><description><![CDATA[错误日志如下：



这是资源不足的问题，调整yarn的如下参数：

yarn.nodemanager.resource.cpu-vcores

#最大容器内存

yarn.scheduler.maximum-allocation-mb

 

调整后重启yarn即可。

 ...]]></description><category></category></item><item><title><![CDATA[oozie在shell端执行报错]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/81001772</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/81001772</guid><author>lilychen1983</author><pubDate>Wed, 11 Jul 2018 15:45:29 +0800</pubDate><description><![CDATA[问题：[root@elcndc2zndd02 ~]# oozie admin -shareliblist
java.lang.IllegalArgumentException: Oozie URL is not available neither in command option or in the environment
        at org.apache.oozie.cli.Oozi...]]></description><category></category></item><item><title><![CDATA[如何避免sqoop执行job时让输入密码]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80969358</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80969358</guid><author>lilychen1983</author><pubDate>Mon, 09 Jul 2018 15:00:38 +0800</pubDate><description><![CDATA[执行如下命令时让输入db的密码：sqoop job --exec jobname在sqoop-site.xml 文件中设置：sqoop.metastore.client.record.password=true sqoop-site.xml的位置：${SQOOP_HOME}/conf下面，例如：/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/l...]]></description><category></category></item><item><title><![CDATA[cdh中安装oozie无法访问web页面]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80940428</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80940428</guid><author>lilychen1983</author><pubDate>Fri, 06 Jul 2018 14:32:28 +0800</pubDate><description><![CDATA[原因是oozie的/var/lib/oozie目录里缺少EXT的包点击Documentation链接里quickstart给出了解决方案其中特别需要注意的一点是Ext包必须是2.2版本的，高了或低了都不行因为tomcat服务器目录下的软链接ext-2.2是指向/var/lib/oozie/ext-2.2的所以版本一定不能错2 解决方法把下载好的ext-2.2.zip拷贝到Oozie主机的/var/...]]></description><category></category></item><item><title><![CDATA[hive执行错误解决方法]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80924213</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80924213</guid><author>lilychen1983</author><pubDate>Thu, 05 Jul 2018 11:23:01 +0800</pubDate><description><![CDATA[报错如下：INFO  : Cleaning up the staging area /data/user/hive/.staging/job_1530585043265_0202
ERROR : Job Submission failed with exception 'org.apache.hadoop.security.AccessControlException(Permission den...]]></description><category></category></item><item><title><![CDATA[sqoop导入数据中含有\t、\n等的解决方法]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80922398</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80922398</guid><author>lilychen1983</author><pubDate>Thu, 05 Jul 2018 10:20:08 +0800</pubDate><description><![CDATA[sqoop从mysql导入到hive的命令如下：sqoop import --connect jdbc:mysql://serveraddress:3306/test  --username root --password pwd123456  --query &quot;select * from user where  \$CONDITIONS&quot; --hive-table hiveuser --hive...]]></description><category></category></item><item><title><![CDATA[hive如何打开日志]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80922309</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80922309</guid><author>lilychen1983</author><pubDate>Thu, 05 Jul 2018 09:54:37 +0800</pubDate><description><![CDATA[在默认的日志级别情况下，是不能将DEBUG信息输出的，这样一来出现的各种详细的错误信息都看不到。我们可以通过以下两种方式修改log4j输出的日志级别，从而利用这些调试日志进行错误定位，具体做法如下：  $ hive --hiveconf hive.root.logger=DEBUG,console （hive启动时用该命令替代）或者在${HIVE_HOME}/conf/hive-log4j.pro...]]></description><category></category></item><item><title><![CDATA[hadoop常用命令]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80913611</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80913611</guid><author>lilychen1983</author><pubDate>Wed, 04 Jul 2018 15:33:39 +0800</pubDate><description><![CDATA[参考：http://hadoop.apache.org/docs/r1.0.4/cn/hdfs_shell.htmlFS Shell调用文件系统(FS)Shell命令应使用 bin/hadoop fs &amp;lt;args&amp;gt;的形式。 所有的的FS shell命令使用URI路径作为参数。URI格式是scheme://authority/path。对HDFS文件系统，scheme是hdfs，对本地文...]]></description><category></category></item><item><title><![CDATA[如何查找hive表在hdfs中的存储位置]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80912876</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80912876</guid><author>lilychen1983</author><pubDate>Wed, 04 Jul 2018 14:57:40 +0800</pubDate><description><![CDATA[在hive环境下输入以下命令：hive&amp;gt; show create table ecej_md_company;
OK
CREATE TABLE `md_company`(
  `company_id` int,
  `update_user` int,
  `merchant_id` string,
  `company_attribute` tinyint)
COMMENT 'Import...]]></description><category></category></item><item><title><![CDATA[HUE loadbalancer启动失败解决方法]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80901301</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80901301</guid><author>lilychen1983</author><pubDate>Tue, 03 Jul 2018 17:09:20 +0800</pubDate><description><![CDATA[cloudera-scm-agent/process/169-hue-HUE_LOAD_BALANCER/httpd.conf: Cannot load /usr/lib64/httpd/modules/mod_ssl.so into server: /usr/lib64/httpd/modules/mod_ssl.so: cannot open shared object file: No su...]]></description><category></category></item><item><title><![CDATA[centos下离线安装CM及其CDH5.14]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80882227</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80882227</guid><author>lilychen1983</author><pubDate>Tue, 03 Jul 2018 15:19:33 +0800</pubDate><description><![CDATA[参考官方文档：https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_install_path_c.html]]></description><category></category></item><item><title><![CDATA[Output directory hdfs://hadoop:8020/user/root/output already exists]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80895222</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80895222</guid><author>lilychen1983</author><pubDate>Tue, 03 Jul 2018 10:53:43 +0800</pubDate><description><![CDATA[异常提示： ERROR tool.ImportTool: Import failed: org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://hadoop:8020/user/root/output already exists解决方案：这是因为每次MR都会生成一个output目录但是不能自动删除，...]]></description><category></category></item><item><title><![CDATA[使用sqoop将数据从mysql导入hive遇到的问题]]></title><link>https://blog.youkuaiyun.com/lilychen1983/article/details/80894496</link><guid>https://blog.youkuaiyun.com/lilychen1983/article/details/80894496</guid><author>lilychen1983</author><pubDate>Tue, 03 Jul 2018 10:32:56 +0800</pubDate><description><![CDATA[问题1：java.lang.ClassNotFoundException: org.json.JSONObject错误16/06/07 08:49:01 WARN manager.MySQLManager: It looks like you are importing from mysql.
16/06/07 08:49:01 WARN manager.MySQLManager: This tr...]]></description><category></category></item></channel></rss>