<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[bingcore的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/bingcore</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; bingcore]]></copyright><item><title><![CDATA[flink 报错]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/133682137</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/133682137</guid><author>bingcore</author><pubDate>Sun, 08 Oct 2023 15:01:27 +0800</pubDate><description><![CDATA[All aggregates must be computed on the same window.]]></description><category></category></item><item><title><![CDATA[Vmware安装centos7]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/124208426</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/124208426</guid><author>bingcore</author><pubDate>Sat, 16 Apr 2022 09:27:25 +0800</pubDate><description><![CDATA[第一步：

第二步：

第三步：

第四步：

]]></description><category></category></item><item><title><![CDATA[sqoop安装]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/117704290</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/117704290</guid><author>bingcore</author><pubDate>Tue, 08 Jun 2021 15:26:25 +0800</pubDate><description><![CDATA[tar -zxvf flume-ng-1.6.0-cdh5.14.0.tar.gz -C /export/servers/
cd  /export/servers/apache-flume-1.6.0-cdh5.14.0-bin/conf
cp  flume-env.sh.template flume-env.sh
vim flume-env.sh
export JAVA_HOME=/export/servers/jdk1.8.0_144


]]></description><category></category></item><item><title><![CDATA[flume安装]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/109119786</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/109119786</guid><author>bingcore</author><pubDate>Fri, 16 Oct 2020 16:47:01 +0800</pubDate><description><![CDATA[第一步：下载解压修改配置文件
tar -zxvf flume-ng-1.6.0-cdh5.14.0.tar.gz -C /export/servers/
cd  /export/servers/apache-flume-1.6.0-cdh5.14.0-bin/conf
cp  flume-env.sh.template flume-env.sh
vim flume-env.sh
export JAVA_HOME=/export/servers/jdk1.8.0_144

第二步：开发配置文件
vim   /]]></description><category></category></item><item><title><![CDATA[scala下界的使用小结]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/107903780</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/107903780</guid><author>bingcore</author><pubDate>Mon, 10 Aug 2020 05:18:49 +0800</pubDate><description><![CDATA[scala下界的使用小结
def biophony[T &gt;: Animal](things: Seq[T]) = things
对于下界，可以传入任意类型
传入和 Animal 直系的，是 Animal 父类的还是父类处理，是 Animal 子类的按照 Animal 处理
和 Animal 无关的，一律按照 Object 处理
也就是下界，可以随便传，只是处理是方式不一样
不能使用上界的思路来类推下界的含义
————————————————
版权声明：本文为优快云博主「李昊轩的博客」的原创文章，遵循]]></description><category></category></item><item><title><![CDATA[kafka快速入门（官网）]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/107302578</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/107302578</guid><author>bingcore</author><pubDate>Sun, 12 Jul 2020 18:55:24 +0800</pubDate><description><![CDATA[1.下载、解压
kafka软件包下载
tar xvf kafka_2.12-2.5.0.tgz

2.启动
确保先启动zookeeper
/export/servers/zookeeper-3.4.5-cdh5.14.0/bin/zkServer.sh start

启动Kafka server
bin/kafka-server-start.sh config/server.properties

3.创建一个topic
bin/kafka-topics.sh --create --bootstrap-se]]></description><category></category></item><item><title><![CDATA[lua集成kafka]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/107290280</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/107290280</guid><author>bingcore</author><pubDate>Sat, 11 Jul 2020 20:37:02 +0800</pubDate><description><![CDATA[Nginx 文件:nginx.conf
cd /usr/local/openresty/nginx/conf
 vi nginx.conf

worker_processes 1; events{ worker_connections 1024; } http{ include mime.types;
default_type application/octet-stream; sendfile on; keepalive_timeout 65; #开启共享字典，设置内存大小为 10M，供每个 nginx ]]></description><category></category></item><item><title><![CDATA[hive安装]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/106966114</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/106966114</guid><author>bingcore</author><pubDate>Fri, 26 Jun 2020 09:38:44 +0800</pubDate><description><![CDATA[1、解压hive
cd /export/servers
tar -zxvf hive-1.1.0-cdh5.14.0.tar.gz

2.修改hive-env.sh
cd  /export/servers/hive-1.1.0-cdh5.14.0/conf
cp hive-env.sh.template hive-env.sh
vim hive-env.sh

HADOOP_HOME=/export/servers/hadoop-2.6.0-cdh5.14.0
export HIVE_CONF_DIR=/e]]></description><category></category></item><item><title><![CDATA[Phoenix安装]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/106818065</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/106818065</guid><author>bingcore</author><pubDate>Thu, 18 Jun 2020 06:12:45 +0800</pubDate><description><![CDATA[1、准备工作
提前安装好ZK集群、hadoop集群、Hbase集群
2、安装包
从对应的地址下载：http://phoenix.apache.org/download.html
这里我们使用的是：
apache-phoenix-4.14.0-cdh5.14.2-bin.tar.gz
3、上传、解压
将对应的安装包上传到对应的Hbase集群其中一个服务器的一个目录下
解压：
tar -zxvf apache-phoenix-4.14.0-cdh5.14.2-bin.tar.gz  -C /export/ser]]></description><category></category></item><item><title><![CDATA[hive与hbase整合]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/106816934</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/106816934</guid><author>bingcore</author><pubDate>Thu, 18 Jun 2020 06:12:14 +0800</pubDate><description><![CDATA[第一步：拷贝hbase的五个依赖jar包到hive的lib目录下
将我们HBase的五个jar包拷贝到hive的lib目录下
hbase的jar包都在/export/servers/hbase-1.2.0-cdh5.14.0/lib
我们需要拷贝五个jar包名字如下
hbase-client-1.2.0-cdh5.14.0.jar         	
hbase-hadoop2-compat-1.2.0-cdh5.14.0.jar
hbase-hadoop-compat-1.2.0-cdh5.14.0.ja]]></description><category></category></item><item><title><![CDATA[HBase的集群环境搭建]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/106815612</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/106815612</guid><author>bingcore</author><pubDate>Thu, 18 Jun 2020 06:11:32 +0800</pubDate><description><![CDATA[第一步：下载对应的HBase的安装包
所有关于CDH版本的软件包下载地址如下
http://archive.cloudera.com/cdh5/cdh/5/
HBase对应的版本下载地址如下
http://archive.cloudera.com/cdh5/cdh/5/hbase-1.2.0-cdh5.14.0.tar.gz
第二步：压缩包上传并解压
tar -zxvf hbase-1.2.0-cdh5.14.0-bin.tar.gz

第三步：修改配置文件
第一台机器进行修改配置文件
1.修改第一个配置文]]></description><category></category></item><item><title><![CDATA[mysql事务隔离级别]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/106544805</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/106544805</guid><author>bingcore</author><pubDate>Thu, 04 Jun 2020 14:47:57 +0800</pubDate><description><![CDATA[查询事务隔离级别
 show variables like '%tx_isolation%'\G

设置事务隔离级别
读未提交
 SET GLOBAL TRANSACTION ISOLATION LEVEL READ UNCOMMITTED;

读已提交
SET GLOBAL TRANSACTION ISOLATION LEVEL READ COMMITTED;

可重复读
SET GLOBAL TRANSACTION ISOLATION LEVEL REPEATABLE READ;


...]]></description><category></category></item><item><title><![CDATA[spark安装]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/106486201</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/106486201</guid><author>bingcore</author><pubDate>Tue, 02 Jun 2020 07:35:37 +0800</pubDate><description><![CDATA[1.下载spark安装包
下载地址spark官网：http://spark.apache.org/downloads.html
这里我们使用 spark-2.1.3-bin-hadoop2.7版本.
2.上传压缩包并解压
这里我们上传到第一台机子 /export/servers 目录下，并执行以下命令：
tar -zxvf spark-2.1.3-bin-hadoop2.7.tgz

3.修改配置文件
修改spark-env.sh
cd /export/servers/spark-2.1.3-bin-had]]></description><category></category></item><item><title><![CDATA[linux mysql 安装]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/106460769</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/106460769</guid><author>bingcore</author><pubDate>Sun, 31 May 2020 20:35:25 +0800</pubDate><description><![CDATA[1、Adding the MySQL Yum Repository；
rpm -Uvh mysql80-community-release-el7-3.noarch.rpm
2、Selecting a Release Series
修配置文件
vi /etc/yum.repos.d/mysql-community.repo
57 enabled改成1
80 enabled改成0
3、Installing MySQL
yum install mysql-community-server
4、Starting ]]></description><category></category></item><item><title><![CDATA[HADOOP CDH 伪分布式环境搭建]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/105907682</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/105907682</guid><author>bingcore</author><pubDate>Fri, 08 May 2020 08:50:13 +0800</pubDate><description><![CDATA[安装环境服务部署规划

	
	    服务器IP
	    192.168.72.110
	    192.168.72.120  
	    192.168.72.130  
	
	
	    HDFS
	    NameNode
	    
	     
	
	
	    Secondary
NameNode

	     
	      
	
	
	    DataNode
	     Da...]]></description><category></category></item><item><title><![CDATA[电影推荐系统基础环境搭建]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/105912944</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/105912944</guid><author>bingcore</author><pubDate>Mon, 04 May 2020 09:51:47 +0800</pubDate><description><![CDATA[电影推荐系统项目
基础环境搭建
如果机器的配置不足，推荐采用一台虚拟机进行配置，而非完全分布式，将该虚拟机CPU的内存设置的尽可能大，推荐为CPU &gt; 4、MEM &gt; 4GB
MongoDB（单节点）环境配置
// 通过WGET下载Linux版本的MongoDB
wget https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-rhe...]]></description><category></category></item><item><title><![CDATA[CDH版本的zookeeper环境搭建]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/105903851</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/105903851</guid><author>bingcore</author><pubDate>Sun, 03 May 2020 16:46:19 +0800</pubDate><description><![CDATA[1.下载，解压
下载地址为：
cdh5下载地址
我们这里下载CDH5.14.0这个版本的zookeeper的压缩包
2.修改配置文件
node01修改配置文件
创建zk数据存放目录
mkdir -p /export/servers/zookeeper-3.4.5-cdh5.14.0/zkdatas

修改zk配置文件
cd /export/servers/zookeeper-3.4.5-cdh5....]]></description><category></category></item><item><title><![CDATA[大数据集群环境准备(centos7)]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/105901426</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/105901426</guid><author>bingcore</author><pubDate>Sun, 03 May 2020 14:55:20 +0800</pubDate><description><![CDATA[1.三台虚拟机关闭防火墙
关闭防火墙，并禁止开机自启动

systemctl stop firewalld.service #停止firewall
systemctl disable firewalld.service #禁止firewall开机启动
systemctl status firewalld.service#查看firewall状态

2.三台机器关闭selinux
临时关闭
sete...]]></description><category></category></item><item><title><![CDATA[centos7安装]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/105894528</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/105894528</guid><author>bingcore</author><pubDate>Sun, 03 May 2020 11:16:16 +0800</pubDate><description><![CDATA[![在这里插入图片描述](https://img-blog.csdnimg.cn/20200502222
45660.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2Jpbmdjb3Jl,si...]]></description><category></category></item><item><title><![CDATA[hive分区分桶土话总结]]></title><link>https://blog.youkuaiyun.com/bingcore/article/details/94430786</link><guid>https://blog.youkuaiyun.com/bingcore/article/details/94430786</guid><author>bingcore</author><pubDate>Tue, 02 Jul 2019 09:42:53 +0800</pubDate><description><![CDATA[从形式来说，可以简单认为，分区就是分目录，分桶就是分文件。
从实际来说，海量数据，比如日志，往往按日存储，按日做离线分析，那么按日分区很自然。分桶可以避免两表jion时，全表做笛卡尔积操作。比如a、b两表，按id分桶，相同id的数据会放入相同的桶内，这样join时，只把两个桶内的数据做笛卡尔积就可以了。
给自己看。

...]]></description><category></category></item></channel></rss>