<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[db_guy的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/db_guy</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; db_guy]]></copyright><item><title><![CDATA[CentOS7使用Docker快速安装Davinci]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/131071270</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/131071270</guid><author>db_guy</author><pubDate>Tue, 06 Jun 2023 17:11:39 +0800</pubDate><description><![CDATA[CentOS7下使用docker快速搭建Davinci数据可视化工具]]></description><category></category></item><item><title><![CDATA[Hive last_value/first_value实现ignore nulls]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/111184452</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/111184452</guid><author>db_guy</author><pubDate>Mon, 14 Dec 2020 20:21:47 +0800</pubDate><description><![CDATA[1.创建一张测试表
drop table if exists default.test_tab purge;
create table default.test_tab
as
select date_add(current_timestamp(),-10) as event_time,'1' as id, 'A' as a,'B' as b,'C' as c
union all select date_add(current_timestamp(),-9) as event_time,'1' as id, ]]></description><category></category></item><item><title><![CDATA[PostgREST安装]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/101110237</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/101110237</guid><author>db_guy</author><pubDate>Sat, 21 Sep 2019 17:17:16 +0800</pubDate><description><![CDATA[背景说明
PostgREST用于直接产生restapi接口来进行CRUD操作，降低了后端开发工作量，提供高度一致规范的数据的接口，在某些场景下具有很重要的应用价值。
环境说明
OS版本：CentOS Linux release 7.7.1908
PostgreSQL版本：PostgreSQL  10，安装过程可以参考另一篇Blog。
注意PostgREST依赖PostgreSQL 9.5以上
1....]]></description><category></category></item><item><title><![CDATA[yum安装配置postgresql]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/101108553</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/101108553</guid><author>db_guy</author><pubDate>Sat, 21 Sep 2019 15:43:59 +0800</pubDate><description><![CDATA[环境说明
OS版本：CentOS Linux release 7.7.1908
1.根据yum源安装postgresql
查看：https://www.postgresql.org/download/linux/redhat/
选择合适的yum源头，这里我们选择安装postgresql10。
sudo yum install -y https://download.postgresql.org/p...]]></description><category></category></item><item><title><![CDATA[Sqoop解决宽表内存溢出OutOfMemoryError]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/99848511</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/99848511</guid><author>db_guy</author><pubDate>Tue, 20 Aug 2019 15:29:38 +0800</pubDate><description><![CDATA[oracle里面导入一张大款表，字段数非常多，而且有很多长文本，这些文本都需要用到，导入的时候报错OutOfMemoryError,内存溢出错误。
解决办法之一是增加内存，目前情况来说不显示，于是我采用另一种方法：减小
cache到内存的记录条数，即使用–fetch-size选项调整fetchSize。fetchSize默认值为1000,这里我们把它调小到200：
sqoop import  \
...]]></description><category></category></item><item><title><![CDATA[多种HDFS存储格式下的Sqoop全量和增量导入]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/99695622</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/99695622</guid><author>db_guy</author><pubDate>Sat, 17 Aug 2019 17:58:49 +0800</pubDate><description><![CDATA[背景环境介绍

CentOS 6.7
MySQL 5.7
Coudera 5.13.0

1.准备数据（MySQL）
1.在mysql中创建一张sqp_test表
drop table if exists sqp_test;
create table sqp_test(
    id bigint PRIMARY KEY AUTO_INCREMENT  COMMENT '主键ID',
    c1...]]></description><category></category></item><item><title><![CDATA[CentOS 7.6.1810虚拟机复制之后静态网络失效的解决办法]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/98518738</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/98518738</guid><author>db_guy</author><pubDate>Mon, 05 Aug 2019 21:15:55 +0800</pubDate><description><![CDATA[问题：
现在有一台虚拟机，已经安装CentOS版本为 7.6.1810，已经配置静态IP地址，但是克隆之后发现是自动生成的IP地址，修改网络配置文件也没法改变IP地址。
解决办法：
修改网卡配置文件/etc/sysconfig/network-scripts/，删除UUID哪一行配置信息。
重启网卡，发现还是自动获取IP。
cd  /etc/sysconfig/network-scripts/
v...]]></description><category></category></item><item><title><![CDATA[Kettle一些问题总结]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/95588874</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/95588874</guid><author>db_guy</author><pubDate>Fri, 12 Jul 2019 09:42:33 +0800</pubDate><description><![CDATA[1.oracle读取速度慢
解决办法：

]]></description><category></category></item><item><title><![CDATA[Hive无法删除表的解决办法]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/95588157</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/95588157</guid><author>db_guy</author><pubDate>Fri, 12 Jul 2019 09:12:51 +0800</pubDate><description><![CDATA[背景介绍：
业务系统（Oracle关系型数据库）针对同一个业务实体，每年设计不同的表，表结构并不一致，有细微差异。
最开始我并不了解这种情况，试图将多张不同结构的表导入同一张hive表，结果第一张表导入成功之后，再导入其他表的数据卡住了，想删除也无法删除该表。
解决办法：
1.解锁该表，删除目标表${table_name}
由于元数据冲突，该表已经被锁，hive存在两种锁，共享锁Shared(S)...]]></description><category></category></item><item><title><![CDATA[DBeaver连接hive]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/92786703</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/92786703</guid><author>db_guy</author><pubDate>Tue, 18 Jun 2019 14:26:27 +0800</pubDate><description><![CDATA[打开dbeaver,依次选择菜单：文件-&gt;新建-&gt;数据库连接-&gt;Apache Hive

1.配置hive连接，填写连接参数信息，编辑驱动文件



2.根据如下maven配置添加maven工件

如果不想通过maven的方式添加jar文件，可以下载我直接分享的hive-jdbc文件。


	    &lt;dependency&gt;
			&lt;groupId&gt;org...]]></description><category></category></item><item><title><![CDATA[Virtualbox桥接模式静态IP联结外网]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/90632759</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/90632759</guid><author>db_guy</author><pubDate>Tue, 28 May 2019 10:19:58 +0800</pubDate><description><![CDATA[摘要

桥接模式是virtualbox功能最为强大的一种，能够宿主机与虚拟机直接，多台虚拟机之间，以及虚拟机和外网环境的联网。本文描述了如何在win10环境，桥接模式下的虚拟网卡配置及Linux静态IP地址配置过程。

1.配置虚拟网卡

参考：https://www.cnblogs.com/hujiapeng/p/9575213.html

1、设备管理器，右键没添加过时硬件（如果没有，则在cm...]]></description><category></category></item><item><title><![CDATA[CentOS7安装sogou输入法，简单有效]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/79978631</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/79978631</guid><author>db_guy</author><pubDate>Tue, 17 Apr 2018 18:09:54 +0800</pubDate><description><![CDATA[1.安装alien依赖软件



sudo yum install alien -y



2.安装依赖软件



sudo yum install qtwebkit -y



3.转换rpm包



sudo alien -r sogoupinyin_2.2.0.0102_amd64.deb



4.安装



sudo rpm -ivh sogoupinyin-2.2.0.0102-2.x...]]></description><category></category></item><item><title><![CDATA[DataFrame使用笔记(持续更新中)]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/79861849</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/79861849</guid><author>db_guy</author><pubDate>Mon, 09 Apr 2018 10:01:39 +0800</pubDate><description><![CDATA[DataFrame使用笔记



元数据操作



&amp;amp;amp;gt;&amp;amp;amp;gt;&amp;amp;amp;gt; df = pd.DataFrame((np.random.rand(4, 4)*100), columns=list('ABCD'))
&amp;amp;amp;gt;&amp;amp;amp;gt;&amp;amp;amp;gt; df
           A          B          C          D
0  90.109671  7]]></description><category></category></item><item><title><![CDATA[Linux下使用dd命令向U盘中写入ISO镜像]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/79831873</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/79831873</guid><author>db_guy</author><pubDate>Fri, 06 Apr 2018 11:10:05 +0800</pubDate><description><![CDATA[查看Ｕ盘的挂载路径，如/dev/sdc之类



sudo fdisk -lh

假设U盘的分区为/dev/sdb,执行类似如下命令写入ISO文件



 sudo dd if=/home/xxx/xxx.iso of=/dev/sdb bs=4M]]></description><category></category></item><item><title><![CDATA[Python将通信达.day文件读取为DataFrame]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/79067008</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/79067008</guid><author>db_guy</author><pubDate>Mon, 12 Feb 2018 22:59:42 +0800</pubDate><description><![CDATA[import os
import struct
import pandas as pddef readTdxLdayFile(fname="C:\\TdxW_HuaTai\\vipdoc\\sh\\lday\\sh601628.day"):
    dataSet=[]
    with open(fname,'rb')  as fl:
        buffer=fl.read()  #读取数据]]></description><category></category></item><item><title><![CDATA[CentOS7 yum安装MySQL5.7]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/77991380</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/77991380</guid><author>db_guy</author><pubDate>Wed, 17 Jan 2018 11:37:22 +0800</pubDate><description><![CDATA[CentOS7 yum安装MySQL5.7



安装MySQL yum知识库

查看：https://dev.mysql.com/downloads/repo/yum/,找到yum 知识库说明，然后根据需要下载安装。



[root@localhost ~]# wget https://repo.mysql.com//mysql57-community-release-el7-11.noarc]]></description><category></category></item><item><title><![CDATA[linux下为用户配置免密码sudo权限]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/79065524</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/79065524</guid><author>db_guy</author><pubDate>Mon, 15 Jan 2018 15:56:58 +0800</pubDate><description><![CDATA[配置/etc/sudoers文件即可，过程如下chmod u+w /etc/sudoers
echo "gc-user        ALL=(ALL)       NOPASSWD: ALL" >> /etc/sudoers
chmod u-w /etc/sudoers]]></description><category></category></item><item><title><![CDATA[Centos7使用yum安装chrome浏览器]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/78811687</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/78811687</guid><author>db_guy</author><pubDate>Fri, 15 Dec 2017 12:50:23 +0800</pubDate><description><![CDATA[1.安装yum知识库新建 /etc/yum.repos.d/google-chrome.repo,写入如下内容:[google-chrome]
name=google-chrome
baseurl=http://dl.google.com/linux/chrome/rpm/stable/x86_64
enabled=1
gpgcheck=1
gpgkey=https://dl.google.com/]]></description><category></category></item><item><title><![CDATA[hive导入CSV数据，使用动态分区重新分区]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/78742071</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/78742071</guid><author>db_guy</author><pubDate>Thu, 07 Dec 2017 15:38:08 +0800</pubDate><description><![CDATA[创建数据表hive> create database cus;
hive> use cus;
hive> create table telno_md5(
    > phone string,
    > md5 string )
    >  ROW FORMAT DELIMITED
    > FIELDS TERMINATED BY ','
    > STORED AS TEXTFILE;导]]></description><category></category></item><item><title><![CDATA[PostgreSQL免安装版CentOS7配置]]></title><link>https://blog.youkuaiyun.com/db_guy/article/details/78651580</link><guid>https://blog.youkuaiyun.com/db_guy/article/details/78651580</guid><author>db_guy</author><pubDate>Tue, 28 Nov 2017 11:23:12 +0800</pubDate><description><![CDATA[安装准备安装依赖下载二禁止文件并解压wget https://get.enterprisedb.com/postgresql/postgresql-9.5.10-1-linux-x64-binaries.tar.gz
tar -xvf postgresql-9.5.10-1-linux-x64-binaries.tar.gz 配置创建数据目录cd pgsql/
mkdir data
export P]]></description><category></category></item></channel></rss>