<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[Adnerly的专栏]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/Adnerly</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; Adnerly]]></copyright><item><title><![CDATA[Cannot resolve plugin org.scala-tools:maven-scala-plugin: unknown]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/106767529</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/106767529</guid><author>Adnerly</author><pubDate>Mon, 15 Jun 2020 17:44:54 +0800</pubDate><description><![CDATA[使用maven下载IDEA的 maven-scala-plugin 时报如下4个错误：

Cannot resolve plugin org.scala-tools:maven-scala-plugin:&lt;unknown&gt;

Could not find artifact org.scala-lang:scala-compiler:pom:2.11.12 in scala-tools.org (http://scala-tools.org/repo-releases)

Could not fi]]></description><category></category></item><item><title><![CDATA[hive写入ES报错 FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/106442872</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/106442872</guid><author>Adnerly</author><pubDate>Sat, 30 May 2020 16:33:43 +0800</pubDate><description><![CDATA[HIVE整合ES场景：

ES版本：6.5.2

hive版本：2.3.4

插件包下载地址：https://repo.maven.apache.org/maven2/org/elasticsearch/elasticsearch-hadoop-hive/

整合过程网上很多资料，下载与自己ES版本匹配的插件包，然后将elasticsearch-hadoop-hive-6.5.2.jar拷贝到hive安装目录lib下。因为我的hive下已经有

commons-httpclient-3.0.1.jar文件了]]></description><category></category></item><item><title><![CDATA[FAILED: SemanticException No valid privileges User p55_u33_userchk does not have privileges for LOAD]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/102820204</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/102820204</guid><author>Adnerly</author><pubDate>Wed, 30 Oct 2019 15:37:41 +0800</pubDate><description><![CDATA[场景：大数据平台使用sentry做权限控制。使用代理用户从后台直接在hdfs上创建了目录/sap/webservice,将数据put到此目录,然后load数据到hive表中报错如下：


Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: Semantic...]]></description><category></category></item><item><title><![CDATA[requirement failed: Block broadcast_487 is already present in the MemoryStore]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/90900805</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/90900805</guid><author>Adnerly</author><pubDate>Wed, 05 Jun 2019 13:44:22 +0800</pubDate><description><![CDATA[场景：

以往正常执行的sparksql，今天在公司执行报如下错误：

第一次执行报错如下：


Caused by: java.sql.SQLException: org.apache.spark.SparkException: Job aborted due to stage failure: Task 1382 in stage 320.0 failed 4 times, most rece...]]></description><category></category></item><item><title><![CDATA[java.sql.SQLException: java.lang.RuntimeException: serious problem]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/90720676</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/90720676</guid><author>Adnerly</author><pubDate>Fri, 31 May 2019 18:13:11 +0800</pubDate><description><![CDATA[场景： spark on hive 使用sparksql查询hive的ORC表。

select * from evchk_ods.ODS_CAR_DRIVE_INFO_P_D

报错如下：

java.sql.SQLException: java.lang.RuntimeException: serious problem
at org.apache.hive.jdbc.HiveSta...]]></description><category></category></item><item><title><![CDATA[with as insert overwrite table]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/87857763</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/87857763</guid><author>Adnerly</author><pubDate>Thu, 21 Feb 2019 11:31:37 +0800</pubDate><description><![CDATA[习惯写sql的时候把insert overwrite table 写在首行,但是在使用with 语法的时候报错:


Error while compiling statement: FAILED: ParseException line 2:0 cannot recognize input near 'with' 't1' 'as' in statement

最初还以为是insert时不支持w...]]></description><category></category></item><item><title><![CDATA[[ERROR] SQLInstaller error 12: Invalid install path]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/84140312</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/84140312</guid><author>Adnerly</author><pubDate>Fri, 16 Nov 2018 15:38:19 +0800</pubDate><description><![CDATA[问题:

hxeadm@hxehost:/usr/sap/HXE/home/mysql-connector-odbc-5.3.11-linux-sles12-x86-64bit/bin&amp;gt; ./myodbc-installer -d -a -n &quot;MYSQL&quot; -t &quot;DRIVER=/usr/lib/libmyodbc5a.so;SETUP=/usr/lib/libmyodbc5a.so&quot;
[...]]></description><category></category></item><item><title><![CDATA[HANA通过unixODBC连接HIVE及遇到的问题]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/84110103</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/84110103</guid><author>Adnerly</author><pubDate>Thu, 15 Nov 2018 20:45:59 +0800</pubDate><description><![CDATA[1,首先安装unixODBC.前文已经安装过,不做赘述.

2,使用https://www.cloudera.com/downloads/connectors/hive/odbc/2-5-24.html下载hiveodbc驱动ClouderaHiveODBC-2.5.24.1017-1.suse12.x86_64.rpm,我这个是适合suse12 64位的版本,可以选择适合自己系统的版本.

3,...]]></description><category></category></item><item><title><![CDATA[suse安装unixODBC问题记录]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/83900982</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/83900982</guid><author>Adnerly</author><pubDate>Fri, 09 Nov 2018 17:37:15 +0800</pubDate><description><![CDATA[一,安装unixODBC

1,下载unixODBC最新版本:http://www.unixodbc.org/

2,#tar zxvf unixODBC-2.3.7.tar.gz

3,#cd unixODBC-2.3.7

4,#./configure --prefix=/usr/local/unixODBC-2.3.7 --includedir=/usr/include --libdir=/...]]></description><category></category></item><item><title><![CDATA[HAHA激活视图报 Insufficient privileges - not authorized 的权限问题]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/83898092</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/83898092</guid><author>Adnerly</author><pubDate>Fri, 09 Nov 2018 15:30:34 +0800</pubDate><description><![CDATA[场景:导入SAP HANA提供的虚拟机,启动完成后,通过eclipse使用SYSTEM用户连接HANA.

1, Catalog -&amp;gt; SYSTEM -&amp;gt; 新建一个test表.

2, Contnet -&amp;gt; 新建一个package -&amp;gt; 新建Attribute View 

3, add TEST表到 TEST 视图,并Activate视图.报如下错误.



描述如下:
...]]></description><category></category></item><item><title><![CDATA[spark-thrift-server 执行spark-sql 的OOM GC异常.]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/52856516</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/52856516</guid><author>Adnerly</author><pubDate>Wed, 19 Oct 2016 10:21:03 +0800</pubDate><description><![CDATA[场景 :  在前端页面提交一个spark-sql,然后通过spark-thrift-server 调用来执行. sql逻辑很简单, 就是使用join关联两表(一个大表90G,一个小表3G)查询,前台界面执行出错.后台抛出java.lang.OutOfMemoryError: GC overhead limit exceeded 异常;
               直接使用./spark-sql --master yarn --executor-memory 4G --num-executors 19 启动]]></description><category></category></item><item><title><![CDATA[安装oracle遇到的bug及解决方法]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/50945906</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/50945906</guid><author>Adnerly</author><pubDate>Mon, 21 Mar 2016 13:51:04 +0800</pubDate><description><![CDATA[因公司需要，搭建oracle数据库

服务器：ubuntu 14.0.4 LTS 64
oracle ： oracle 11g

jdk ： jdk 1.7

安装教程网络上很多。粘贴两篇我借鉴的教程

http://www.linuxdiyf.com/linux/9954.html

http://www.jb51.net/article/53769.htm



下面开始介绍安装...]]></description><category></category></item><item><title><![CDATA[java调用R语言包(JRI方式),bug记录]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/50314731</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/50314731</guid><author>Adnerly</author><pubDate>Tue, 15 Dec 2015 14:08:00 +0800</pubDate><description><![CDATA[java调用R语言包(JRI方式)]]></description><category></category></item><item><title><![CDATA[安装flume-1.6.0后,测试所遇bug]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/49305791</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/49305791</guid><author>Adnerly</author><pubDate>Wed, 21 Oct 2015 16:01:27 +0800</pubDate><description><![CDATA[案例1：Avro
Avro可以发送一个给定的文件给Flume，Avro 源使用AVRO RPC机制。
　　　　　　a)创建agent配置文件
vi /usr/local/flume-1.6.0/conf/avro.conf


a1.sources = r1
a1.sinks = k1
a1.channels = c1
  
# Describe/configure the s]]></description><category></category></item><item><title><![CDATA[hive1.0.0-1.2.1版本升级及升级中遇到bug]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/49074683</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/49074683</guid><author>Adnerly</author><pubDate>Mon, 12 Oct 2015 15:47:42 +0800</pubDate><description><![CDATA[1,现版本:hive1.0.0
2,目标升级版本:hive1.2.1


升级步骤:
1.关闭当前打开的连接.
2.备份mysql中的hive库(如若升级失败,便于恢复)
   mysqldump -uhive -phive hive > schem_hive-1.0.0.sql
3.解压新版本hive

4.修改环境变量
    指定HIVE_HOME到新版本hive目录]]></description><category></category></item><item><title><![CDATA[hadoop笔记]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/42646027</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/42646027</guid><author>Adnerly</author><pubDate>Mon, 12 Jan 2015 18:35:48 +0800</pubDate><description><![CDATA[1、SAAS、PAAS、IAAS、XAAS、都是什么意思，另外DAAS是什么意思？
   SAAS：应用软件服务，用户可以直接租用服务
   PAAS：管理软件资源的服务，通过他可以开发、管理软件服务
   IAAS：管理硬件资源的软件服务，通过他可以租用硬件
   XAAS：一切皆服务，指越来越多的通过互联网提供的服务，而不是指本地或现场服务。云计算的本质就是XAAS
   DAAS：]]></description><category></category></item><item><title><![CDATA[关于部分datanode不能正常启动的问题]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/39994865</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/39994865</guid><author>Adnerly</author><pubDate>Sat, 11 Oct 2014 15:20:47 +0800</pubDate><description><![CDATA[2014-10-11 14:42:51,415 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2014-10-11 14:42:51,421 INFO org.apache.hadoop.ipc.Server:]]></description><category></category></item><item><title><![CDATA[统计页面独立IP数的时候遇到的异常]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/39857889</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/39857889</guid><author>Adnerly</author><pubDate>Tue, 07 Oct 2014 19:50:43 +0800</pubDate><description><![CDATA[14/10/07 19:51:18 WARN mapred.LocalJobRunner: job_local_0001
java.io.IOException: Type mismatch in value from map: expected org.apache.hadoop.io.LongWritable, recieved org.apache.hadoop.io.Text
    ]]></description><category></category></item><item><title><![CDATA[在eclipse中调试Hadoop遇到的问题]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/39182669</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/39182669</guid><author>Adnerly</author><pubDate>Wed, 10 Sep 2014 16:22:09 +0800</pubDate><description><![CDATA[14/09/10 15:42:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/09/10 15:42:55 ERROR security.UserGroupInformatio...]]></description><category></category></item><item><title><![CDATA[常用的Hadoop Common组件属性分享]]></title><link>https://blog.youkuaiyun.com/Adnerly/article/details/38678543</link><guid>https://blog.youkuaiyun.com/Adnerly/article/details/38678543</guid><author>Adnerly</author><pubDate>Tue, 19 Aug 2014 10:44:26 +0800</pubDate><description><![CDATA[常用的hadoop]]></description><category></category></item></channel></rss>