<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[jo_joo的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/jo_joo</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; jo_joo]]></copyright><item><title><![CDATA[<7> hive  group by,order by]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/81749305</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/81749305</guid><author>jo_joo</author><pubDate>Thu, 16 Aug 2018 21:37:35 +0800</pubDate><description><![CDATA[group by ...having
1.select 后面非聚合列必须出现在group by 中
2.除了普通的列就是一些聚合操作
3.group by 后面可以跟表达式,比如substr(col)4.group by 使用了reduce操作,受限于reduce数量,设置reduce参数mapred.reduce.task改变reduce数量(hive-0.13)
set mapreduce.j...]]></description><category></category></item><item><title><![CDATA[<6> hive 表属性操作]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/81749274</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/81749274</guid><author>jo_joo</author><pubDate>Thu, 16 Aug 2018 21:35:41 +0800</pubDate><description><![CDATA[表属性操作
修改表名
create table if not exists testchange(name string,value string);
alter table testchange rename to a2;

增加列(默认添加到最后)
alter table tablename add columns(c1 string,c2 long);
alter table a2 add ...]]></description><category></category></item><item><title><![CDATA[<5>hive 数据导出和动态分区]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/81749245</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/81749245</guid><author>jo_joo</author><pubDate>Thu, 16 Aug 2018 21:33:56 +0800</pubDate><description><![CDATA[hive 数据导出
1.hadoop命令的方式
get
hadoop fs -get path localPath
text(可以对多种不同格式进行操作,相当于输出流改成了text)
hadoop fs -text path &amp;gt; e2.txt
2.通过insert...directory方式
insert overwrite local directory 'path' row format...]]></description><category></category></item><item><title><![CDATA[<4> hive 执行命令方式，数据加载]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/81749227</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/81749227</guid><author>jo_joo</author><pubDate>Thu, 16 Aug 2018 21:32:18 +0800</pubDate><description><![CDATA[hive执行命令的方式
hive -e &quot;hql&quot; 命令行执行hsql
hive -e &quot;select * from mydb2.c1&quot;
hive -S 静默模式,控制台不输出Logging信息
hive -S -e &quot;select * from mydb2.c1&quot;
hive -v 详细模式,会把执行的sql打印出来
hive -v -e &quot;select * from mydb2.c1&quot;
hive...]]></description><category></category></item><item><title><![CDATA[<3>hive 查询，排序，函数]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/81749162</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/81749162</guid><author>jo_joo</author><pubDate>Thu, 16 Aug 2018 21:28:58 +0800</pubDate><description><![CDATA[6.查询简单查询配置:set hive.fetch.task.conversion=more;/hive --hiveconf hive.fetch.task.conversion=more;/修改hive-site.xml文件;
函数nvl(x,0)不为空的则为0
当有值为空时的判断 is null/is not null
HQL严格区分字符大小写：
select * from view_stu...]]></description><category></category></item><item><title><![CDATA[<2>hive 外部表，分区表，动态分区，桶表，视图]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/81748893</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/81748893</guid><author>jo_joo</author><pubDate>Thu, 16 Aug 2018 21:11:10 +0800</pubDate><description><![CDATA[1.分区表
create table sample_data(id int,name string,gender string,x int,y int,z int)
row format delimited fields terminated by','

load data inpath '/student/sampleData.txt' into table sample_data;


cr...]]></description><category></category></item><item><title><![CDATA[<1>hive的一些基本操作]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/81748838</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/81748838</guid><author>jo_joo</author><pubDate>Thu, 16 Aug 2018 21:07:06 +0800</pubDate><description><![CDATA[1.创建库
create database if not exists mydb;
添加注释
create database if not exists mydb2
comment 'this is test database';
查看注释
describe database mydb2;
删除库
drop database if exists mydb2;(库中没有表的情况)
drop data...]]></description><category></category></item><item><title><![CDATA[Elasticsearch2.3.4+elasticsearch-jdbc-2.3.4.1同步oracle数据及简单调优]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/78436172</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/78436172</guid><author>jo_joo</author><pubDate>Fri, 03 Nov 2017 15:30:05 +0800</pubDate><description><![CDATA[Elasticsearch2.3.4+elasticsearch-jdbc-2.3.4.1同步oracle数据及简单调优]]></description><category></category></item><item><title><![CDATA[kafka环境搭建]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/73953904</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/73953904</guid><author>jo_joo</author><pubDate>Fri, 30 Jun 2017 10:57:59 +0800</pubDate><description><![CDATA[已经搭建好的zookeeper集群

下载kafka_2.11-0.10.0.1.tgz
tar -zxvf kafka_2.11-0.10.0.1.tgz
mv kafka_2.11-0.10.0.1 kafka
进入目录

cd kafka/config
修改配置文件

vim server.properties

broker.id=1
listeners=PLAI]]></description><category></category></item><item><title><![CDATA[elasticsearch2.4.3 javaAPI的一些基本操作]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/73939325</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/73939325</guid><author>jo_joo</author><pubDate>Fri, 30 Jun 2017 10:18:54 +0800</pubDate><description><![CDATA[elasticsearch2.4.3一些基本操作import org.elasticsearch.client.Client;import org.elasticsearch.client.transport.TransportClient;import org.elasticsearch.common.settings.Settings;import org.elasticsearch.comm]]></description><category></category></item><item><title><![CDATA[java poi读取excel文件]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/73935160</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/73935160</guid><author>jo_joo</author><pubDate>Fri, 30 Jun 2017 10:00:53 +0800</pubDate><description><![CDATA[需要导入poi-3.15.jar
import org.apache.poi.hssf.usermodel.HSSFCell;
import org.apache.poi.hssf.usermodel.HSSFRow;
import org.apache.poi.hssf.usermodel.HSSFSheet;
import org.apache.poi.hssf.usermodel.HSSF]]></description><category></category></item><item><title><![CDATA[java控制scp传输文件]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/73933652</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/73933652</guid><author>jo_joo</author><pubDate>Fri, 30 Jun 2017 09:56:16 +0800</pubDate><description><![CDATA[需要导入ganymed-ssh2-build210.jar

import ch.ethz.ssh2.Connection;
import ch.ethz.ssh2.SCPClient;

import java.io.IOException;

/**
 * Created by Administrator on 2017/6/29.
 */
public class testScp {
 ]]></description><category></category></item><item><title><![CDATA[sqoop环境配置AND常用基本操作01]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/70843700</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/70843700</guid><author>jo_joo</author><pubDate>Thu, 27 Apr 2017 10:27:00 +0800</pubDate><description><![CDATA[sqoop安装
官网下载sqoop-1.4.6.bin__hadoop-0.23.tar.gz
tar -xzvf sqoop-1.4.6.bin__hadoop-0.23.tar.gz


设置环境变量 
export HADOOP_COMMON_HOME=/home/spark/opt/hadoop-2.7(用来指明hadoop安装在哪个目录下)
export HADOOP_MA]]></description><category></category></item><item><title><![CDATA[SPARK+ANSJ 中文分词基本操作]]></title><link>https://blog.youkuaiyun.com/jo_joo/article/details/53689710</link><guid>https://blog.youkuaiyun.com/jo_joo/article/details/53689710</guid><author>jo_joo</author><pubDate>Fri, 16 Dec 2016 10:20:22 +0800</pubDate><description><![CDATA[ANSJ 5.0.2
这是一个基于n-Gram+CRF+HMM的中文分词的java实现.
分词速度达到每秒钟大约200万字左右（mac air下测试），准确率能达到96%以上
目前实现了.中文分词. 中文姓名识别 . 用户自定义词典,关键字提取，自动摘要，关键字标记等功能
可以应用到自然语言处理等方面,适用于对分词效果要求高的各种项目.

下载地址 ：http://maven.nlpc]]></description><category></category></item></channel></rss>