<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[vanni01的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/vanni01</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; vanni01]]></copyright><item><title><![CDATA[数据分析（1）描述分析]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/108502815</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/108502815</guid><author>vanni01</author><pubDate>Wed, 09 Sep 2020 22:55:06 +0800</pubDate><description><![CDATA[一、基本统计分析
1、样本均值：
2、样本中位数：
3、样本分位数
4、样本众数
5、样本极差
6、样本方差：SUM((样本值-样本均值)^2 )/n-1
7、样本标准差：POWER（样本方差，2）
8、频数：样本值出现次数
9、峰度：大于0比标准正太陡，小于0比正太分布平缓
10、偏度：大于0峰值靠右侧，小于0峰值靠左侧
11、Z分位：样本值与样本均值相差多少个标准差（标准差倍数）
12、T分位：Z分位的线性变换（为了数据更好看一些）
二、探索分析
1、正态性检验：样本是否符合正太分布
2、卡方检验：交叉]]></description><category></category></item><item><title><![CDATA[大数据项目实践--手机日志分析]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/107965524</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/107965524</guid><author>vanni01</author><pubDate>Mon, 17 Aug 2020 14:18:22 +0800</pubDate><description><![CDATA[一、准备win10开发环境
1、下载jdk-8u45-windows-x64.exe 安装于D:\Java8
2、修改JAVA_HOME为
D:\Java8\jdk1.8.0_45

3、修改HADOOP_HOME为
D:\hadoop272

4、复制hadoop 2.7.x 的  winutils等文件到D:\hadoop272\bin，否则eclipse无法进行调试
5、复制hadoop-eclipse-plugin-2.7.2至D:\eclipsehadoop272\plugins
二、搭建cent]]></description><category></category></item><item><title><![CDATA[Spark Core&Sql Scala&Java实验]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/107641515</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/107641515</guid><author>vanni01</author><pubDate>Sat, 01 Aug 2020 22:07:59 +0800</pubDate><description><![CDATA[1、Eclipse安装Scala插件
help-&gt;install new software    add
scala-ide
http://download.scala-ide.org/sdk/lithium/e44/scala211/stable/site

选择安装
scala ide for eclipse
重启eclipse
2、

]]></description><category></category></item><item><title><![CDATA[scala spark kafka 集群部署 及简单实验]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/107578354</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/107578354</guid><author>vanni01</author><pubDate>Sat, 25 Jul 2020 20:56:11 +0800</pubDate><description><![CDATA[1、上传scala-2.10.4.tgz 至 /usr 并解压
tar -zvxf scala-2.10.4.tgz

2、编辑/etc/profile
export SCALA_HOME=/usr/scala-2.10.4
export PATH=$PATH:${SCALA_HOME}/bin

更新系统设置
source /etc/profile

3、测试
[root@lining05 usr]# scala
Welcome to Scala version 2.10.4 (Java HotSpot(]]></description><category></category></item><item><title><![CDATA[flume实验]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/107561505</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/107561505</guid><author>vanni01</author><pubDate>Fri, 24 Jul 2020 16:05:47 +0800</pubDate><description><![CDATA[1、上传flume-ng-1.5.0-cdh5.3.6.tar.gz 至/opt/modules/cdh/ 并解压
2、编辑 /conf/flume-env.sh
export JAVA_HOME=/usr/java/jdk1.7.0_79

3、编辑/etc/profile
export FLUME_HOME=/opt/modules/cdh/apache-flume-1.5.0-cdh5.3.6-bin
export PATH=$PATH:$FLUME_HOME/bin

4、flume业务情景

fl]]></description><category></category></item><item><title><![CDATA[Hbase JAVA 项目实验]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/107455715</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/107455715</guid><author>vanni01</author><pubDate>Wed, 22 Jul 2020 21:23:29 +0800</pubDate><description><![CDATA[1、本项目使用MAVEN部署因此先部署本地MAVEN仓库，下载apache-maven-3.6.3 至D:\apache-maven-3.6.3，配置环境变量
     MAVEN_HOME=D:\apache-maven-3.6.3
     PATH=%MAVEN_HOME%\bin

2、修改D:\apache-maven-3.6.3\conf\settings.xml
修改本地仓库地址
  &lt;localRepository&gt;D:/apache-maven-3.6.3/repository]]></description><category></category></item><item><title><![CDATA[Sqoop 实验]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/107368100</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/107368100</guid><author>vanni01</author><pubDate>Wed, 15 Jul 2020 19:40:33 +0800</pubDate><description><![CDATA[1、使用windows客户端登录mysql建表
修改虚拟机mysql的远程登录权限
mysql -uroot -proot;
use mysql;
show tables;
update user set host='%' where host = 'localhost';
flush pricilges;

给本地ip 192.168.198.1及lining05授权
GRANT ALL PRIVILEGES ON *.* TO 'root'@'192.168.198.1' IDENTIFIED BY 
]]></description><category></category></item><item><title><![CDATA[CDH5.3.6在centos6.5上集群安装（2）]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/107309361</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/107309361</guid><author>vanni01</author><pubDate>Tue, 14 Jul 2020 16:39:39 +0800</pubDate><description><![CDATA[29、将zookeeper-3.4.5-cdh5.3.6.tar.gz 上传至/opt/modules/cdh
        cd /opt/modules/cdh
        tar -zxvf zookeeper-3.4.5-cdh5.3.6.tar.gz
        cd /opt/modules/cdh/zookeeper-3.4.5-cdh5.3.6
        mkdir data
        cd /opt/modules/cdh/zookeeper-3.4.5-cdh5.3]]></description><category></category></item><item><title><![CDATA[CDH5.3.6在centos6.5上集群安装（1）]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/107133690</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/107133690</guid><author>vanni01</author><pubDate>Sun, 05 Jul 2020 13:33:57 +0800</pubDate><description><![CDATA[1、/etc/selinux/config -&gt;  SELINUX=disabled
/etc/hosts   -&gt; 192.168.198.131  lining05
/etc/sysconfig   -&gt; HOSTNAME=lining05
/etc/sysconfig/network-scripts/ifcfg-eth0  -&gt;
	DEVICE="eth0"
	BOOTPROTO="static"
	NM_CONTROLLED="yes"
	ONBOOT="yes"
	TYPE]]></description><category></category></item><item><title><![CDATA[hive 操作笔记]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/107129945</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/107129945</guid><author>vanni01</author><pubDate>Sat, 04 Jul 2020 21:21:54 +0800</pubDate><description><![CDATA[1、CDH HIVE 5.3.6 配置
1.1 下载 CDH 组件环境
http://archive.cloudera.com/cdh5/cdh/5/jdk-7u79-linux-x64.tar.gz
http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.5.0-cdh5.3.6.tar.gz
http://archive.cloudera.com/cdh5/cdh/5/hive-0.13.1-cdh5.3.6.tar.gz
http://archive.cloud]]></description><category></category></item><item><title><![CDATA[Hdfs 初学实验笔记]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/106265768</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/106265768</guid><author>vanni01</author><pubDate>Fri, 22 May 2020 10:36:17 +0800</pubDate><description><![CDATA[Hdfs 实验Hdfs 实验1、windows 单机 安装hadoop2722、linux虚拟机 三台安装 hadoop 2.7.23、JAVA操作WINDOWS上的HDFS4、JAVA操作Linux上的HDFS5、MapReduce WordCount 项目6、MapReduce PhoneFlow 项目
Hdfs 实验
本篇文章为Hdfs基础实验整体流程，中间如有不详处，或因环境所致踩坑，请自行baidu解决
1、windows 单机 安装hadoop272
（hadoop3.2暂时没有windows环]]></description><category></category></item><item><title><![CDATA[MySql数据库更新表的物理排序]]></title><link>https://blog.youkuaiyun.com/vanni01/article/details/106137958</link><guid>https://blog.youkuaiyun.com/vanni01/article/details/106137958</guid><author>vanni01</author><pubDate>Fri, 15 May 2020 11:20:36 +0800</pubDate><description><![CDATA[表中数据原本是按插入顺序排列的，如想按照特定列重排表中数据，使用

alter table ‘tablename’ order by `field1` , `field2`;
]]></description><category></category></item></channel></rss>