<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[flyeagle88的专栏]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/flyeagle88</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; flyeagle88]]></copyright><item><title><![CDATA[hive优化之-控制hive任务中的map数和reduce数]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/79008284</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/79008284</guid><author>flyeagle88</author><pubDate>Mon, 08 Jan 2018 23:15:52 +0800</pubDate><description><![CDATA[1.    通常情况下，作业会通过input的目录产生一个或者多个map任务。 
主要的决定因素有： input的文件总个数，input的文件大小，集群设置的文件块大小(目前为128M, 可在hive中通过set dfs.block.size;命令查看到，该参数不能自定义修改)；

2.    举例： 
a)    假设input目录下有1个文件a,大小为780M,那么hadoop会将该文]]></description><category></category></item><item><title><![CDATA[shell循环和条件判断]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/46122405</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/46122405</guid><author>flyeagle88</author><pubDate>Thu, 28 May 2015 14:16:03 +0800</pubDate><description><![CDATA[#!/bin/bash
source /data/xiaoju/.bashrc
cd /data/xiaoju/online/


# create some-days data
V_BEGINDATE='2015-05-12'
V_ENDDATE='2015-05-28'


while [[ "$V_BEGINDATE" 
    echo " -----"$V_BEGI]]></description><category></category></item><item><title><![CDATA[网址收藏]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/45604635</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/45604635</guid><author>flyeagle88</author><pubDate>Sat, 09 May 2015 21:04:09 +0800</pubDate><description><![CDATA[eclipse 配置黑色主题


http://www.cnblogs.com/csulennon/p/4231405.html]]></description><category></category></item><item><title><![CDATA[收集点击日志]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/42269161</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/42269161</guid><author>flyeagle88</author><pubDate>Tue, 30 Dec 2014 17:41:05 +0800</pubDate><description><![CDATA[===========apache===========
LogFormat "%q&rmthost=%{X-Forwarded-For}i&inTime=%{%F:%H:%M:%S}t" common


LogFormat "%{Referer}i -> %U" referer
LogFormat "%{User-agent}i" agent



    DocumentR]]></description><category></category></item><item><title><![CDATA[redis基本操作命令]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/41843919</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/41843919</guid><author>flyeagle88</author><pubDate>Wed, 10 Dec 2014 11:22:43 +0800</pubDate><description><![CDATA[有序集合查询：
ZRANGE es:11547 0 -1 WITHSCORES]]></description><category></category></item><item><title><![CDATA[linux安装vsfftpd]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/41650133</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/41650133</guid><author>flyeagle88</author><pubDate>Mon, 01 Dec 2014 17:53:23 +0800</pubDate><description><![CDATA[安装vsftpd：    yum install vsftpd
sudo useradd -m ftp
sudo passwd ftp
sudo chmod 777 /home/ftp
修改vsFTPd的配置 
  cd /etc/vsftpd/    vi vsFTPd.conf
监听地址和端口，是否打开tcp、psav模式等等
anonymous_enable=NO
local]]></description><category></category></item><item><title><![CDATA[linux（centos）搭建SVN服务器]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/40400901</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/40400901</guid><author>flyeagle88</author><pubDate>Thu, 23 Oct 2014 17:37:05 +0800</pubDate><description><![CDATA[安装步骤如下：
1、yum install subversion




2、输入rpm -ql subversion查看安装位置，如下图：

 

我们知道svn在bin目录下生成了几个二进制文件。

输入 svn --help可以查看svn的使用方法，如下图。










3、创建svn版本库目录

mkdir -p /var/svn/]]></description><category></category></item><item><title><![CDATA[kafka安装文档]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/40043649</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/40043649</guid><author>flyeagle88</author><pubDate>Mon, 13 Oct 2014 13:40:51 +0800</pubDate><description><![CDATA[参考：http://www.350351.com/jiagoucunchu/ZooKeeper/320969.html]]></description><category></category></item><item><title><![CDATA[linux 增加一个用户并打通ssh]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/39613629</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/39613629</guid><author>flyeagle88</author><pubDate>Sat, 27 Sep 2014 18:12:19 +0800</pubDate><description><![CDATA[1、增加用户
adduser hadoopadmin
usermod -a -G wheel hadoopadmin
passwd hadoopadmin




2、编辑文件
visudo -f /etc/sudoers
#chmod 0440 /etc/sudoers
将%wheel那两行打开


3、测试是否增加成功：
su - hadoopadmin
sud]]></description><category></category></item><item><title><![CDATA[centos-6.4 64位u盘安装盘制作]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/38495475</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/38495475</guid><author>flyeagle88</author><pubDate>Mon, 11 Aug 2014 17:06:24 +0800</pubDate><description><![CDATA[http://www.jspxcms.com/knowledge/140.html]]></description><category></category></item><item><title><![CDATA[hive常用命令]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/24414367</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/24414367</guid><author>flyeagle88</author><pubDate>Thu, 24 Apr 2014 15:00:01 +0800</pubDate><description><![CDATA[一、添加hive自定义函数


add jar /opt/cloudera/parcels/CDH/lib/hive/lib/bhdp-base-0.0.2.jar;


create temporary function decode_order_moblie as 'com.baihe.hadoop.hive.udf.DecodeOrderMobile';


select ]]></description><category></category></item><item><title><![CDATA[sol操作记录]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/20778579</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/20778579</guid><author>flyeagle88</author><pubDate>Sat, 08 Mar 2014 14:38:43 +0800</pubDate><description><![CDATA[一、solr命令
solrctl instancedir --delete baiheSearch 
solrctl instancedir --create baiheSearch $HOME/solr_configs
solrctl collection --delete baiheSearch
solrctl collection --create baiheSearch -s 3]]></description><category></category></item><item><title><![CDATA[hadoop学习参考网址]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/19436659</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/19436659</guid><author>flyeagle88</author><pubDate>Tue, 18 Feb 2014 23:01:23 +0800</pubDate><description><![CDATA[NFS安装配置及常见问题、/etc/exports配置文件、showmount命令



http://desert3.iteye.com/blog/1675522]]></description><category></category></item><item><title><![CDATA[kettle一些命令]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/18986931</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/18986931</guid><author>flyeagle88</author><pubDate>Sat, 08 Feb 2014 15:42:23 +0800</pubDate><description><![CDATA[安装kettle
cd  /usr/local

scp root@web115:/usr/local/soft/pdi/pdi-ce-5.0.1.A-stable.zip  ./
unzip pdi-ce-5.0.1.A-stable.zip

scp root@web115:/usr/local/data-integration/lib/mysql-connector-java-5]]></description><category></category></item><item><title><![CDATA[zookeeper异常处理]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/18188209</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/18188209</guid><author>flyeagle88</author><pubDate>Sun, 12 Jan 2014 19:27:20 +0800</pubDate><description><![CDATA[一、zookeeper报错：unable to load database on disk  


2014-01-12 18:59:39,039 INFO org.apache.zookeeper.server.persistence.FileSnap: Reading snapshot /var/lib/zookeeper/version-2/snapshot.1f0015b724
2]]></description><category></category></item><item><title><![CDATA[hbase异常处理]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/18187439</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/18187439</guid><author>flyeagle88</author><pubDate>Sun, 12 Jan 2014 18:44:24 +0800</pubDate><description><![CDATA[一、
2014-01-02 02:08:49,349 INFO org.apache.hadoop.hbase.regionserver.Store: Closed info
2014-01-02 02:08:49,349 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed kgroup_user_receiver,6607657]]></description><category></category></item><item><title><![CDATA[CDH的Cloudera Manage安装或升级]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/17569457</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/17569457</guid><author>flyeagle88</author><pubDate>Thu, 26 Dec 2013 00:20:35 +0800</pubDate><description><![CDATA[一.准备
centos6.2系统
java 1.6.31


二.下载rpm资源
http://archive.cloudera.com/cm4/redhat/6/x86_64/cm/4
RPMS的文件和repodata都得下


三.开启本地源
yum>

yum list installed cloudera-manager-server
yum list inst]]></description><category></category></item><item><title><![CDATA[hadoop遇到的一些问题]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/16986585</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/16986585</guid><author>flyeagle88</author><pubDate>Wed, 27 Nov 2013 15:38:44 +0800</pubDate><description><![CDATA[http://royripple.diandian.com/post/2011-07-14/40028719245]]></description><category></category></item><item><title><![CDATA[JAVA 线程操作]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/16801583</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/16801583</guid><author>flyeagle88</author><pubDate>Mon, 18 Nov 2013 10:39:51 +0800</pubDate><description><![CDATA[http://www.blogjava.net/jinfeng_wang/archive/2008/04/27/196477.html]]></description><category></category></item><item><title><![CDATA[IBATIS一些参数说明]]></title><link>https://blog.youkuaiyun.com/flyeagle88/article/details/13015853</link><guid>https://blog.youkuaiyun.com/flyeagle88/article/details/13015853</guid><author>flyeagle88</author><pubDate>Fri, 25 Oct 2013 09:43:46 +0800</pubDate><description><![CDATA[Pool.MaximumActiveConnections：数据库连接池可维持的最大容量
Pool.MaximumIdleConnections：数据库连接池中允许的挂起（idle）连接数
Pool.MaximumCheckoutTime：数据库联接池中，连接被某个任务所允许占用的最大时间， 如果超过这个时间限定，连接将被强制收回。（毫秒）

Pool.TimeToWait：当线程试图从连]]></description><category></category></item></channel></rss>