<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[nickyu888的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/nickyu888</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; nickyu888]]></copyright><item><title><![CDATA[k8s-kubernetes入门-tomcat环境]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/107813616</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/107813616</guid><author>nickyu888</author><pubDate>Wed, 05 Aug 2020 13:54:12 +0800</pubDate><description><![CDATA[原文链接
上面一篇文章写得很好，我这里就不重复了。

]]></description><category></category></item><item><title><![CDATA[openswan在centos7上配置]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/107768155</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/107768155</guid><author>nickyu888</author><pubDate>Mon, 03 Aug 2020 17:07:10 +0800</pubDate><description><![CDATA[第一步:安装openswan
yum install -y make gcc gmp-devel xmlto bison flex xmlto libpcap-devel lsof vim-enhanced man
yum install nss
yum install libreswan


第二步:配置
1.	cat /etc/ipsec.conf
config setup
        protostack=netkey   
        nat_traversal=yes 
        o]]></description><category></category></item><item><title><![CDATA[openswan在centos6上配置指南]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/107766479</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/107766479</guid><author>nickyu888</author><pubDate>Mon, 03 Aug 2020 16:33:35 +0800</pubDate><description><![CDATA[第一步:安装openswan
yum install -y make gcc gmp-devel xmlto bison flex xmlto libpcap-devel lsof vim-enhanced man
yum install nss
yum install openswan 


第二步:配置

编辑 /etc/ipsec.conf  (此处具体根据要求进行修改)

cat /etc/ipsec.conf
config setup
        protostack=netkey   
  ]]></description><category></category></item><item><title><![CDATA[hbase导入数据]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/107711961</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/107711961</guid><author>nickyu888</author><pubDate>Fri, 31 Jul 2020 13:59:45 +0800</pubDate><description><![CDATA[hbase&gt;create 'warehouse.md5_key2_hbase',{NAME=&gt;'prop'} 
sudo -uhdfs hbase org.apache.hadoop.hbase.mapreduce.Driver importtsv -Dimporttsv.separator=, -Dimporttsv.bulk.output=/user/etl/md5_key2_hbase -Dimporttsv.columns=HBASE_ROW_KEY,prop:score  wareho]]></description><category></category></item><item><title><![CDATA[CDH 6.2.0安装]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/107686512</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/107686512</guid><author>nickyu888</author><pubDate>Thu, 30 Jul 2020 11:38:22 +0800</pubDate><description><![CDATA[CDH安装文档


概述
本文档主要内容为 cdh 生态环境各个应用搭建部署文档，CDH包括zookper、hadoop、saprk、hive、scala。


软件环境
集群软件环境确定如下：
软件名称	版本
OS			Centos 7.3
spark 		2.4.0-cdh6.2.1
python 	python 2.7.13
java 		1.8
hadoop 	3.0.0-cdh6.2.1
mariadb 	5.5.64
hive 		hive-2.1.1-cdh6.2.1
scala 		scal]]></description><category></category></item><item><title><![CDATA[zookeeper delete yarn rmstore]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/106267784</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/106267784</guid><author>nickyu888</author><pubDate>Thu, 21 May 2020 21:22:28 +0800</pubDate><description><![CDATA[cdh6.2仍然无法解决zookeeper注册信息过期造成yarn的主备脑裂问题。
摘录别人的文章：https://sukbeta.github.io/zookeeper-delete-yarn-rmstore/
错误日志（日志可能会有不同，现象就是无法手动切换主备）
2019-06-16 21:07:39,030 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn OPERATION=transitionT]]></description><category></category></item><item><title><![CDATA[SPARK动态添加节点]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/104416806</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/104416806</guid><author>nickyu888</author><pubDate>Thu, 20 Feb 2020 19:54:15 +0800</pubDate><description><![CDATA[参考：https://blog.51cto.com/beyond3518/1787498
最主要的：
sbin/start-slave.sh spark://DEV-HADOOP-01:7077

]]></description><category></category></item><item><title><![CDATA[Hadoop Namenode启动报错GC overhead limit exceeded]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/104327284</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/104327284</guid><author>nickyu888</author><pubDate>Sat, 15 Feb 2020 14:09:33 +0800</pubDate><description><![CDATA[参考：
https://blog.youkuaiyun.com/rongyongfeikai2/article/details/82878578
文中所述，由于fsimage的inodes过多，造成启动时内存不够用所致。
需要用以下命令查看fsimage文件占用的内存大小：
./hdfs oiv -p XML -printToScreen -i ${fsimage文件路径} -o /tmp/a

cat  /...]]></description><category></category></item><item><title><![CDATA[flask提交表单]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/103921718</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/103921718</guid><author>nickyu888</author><pubDate>Fri, 10 Jan 2020 11:31:26 +0800</pubDate><description><![CDATA[1.  创建test_flask.py主程序
test_flask.py
from flask import Flask, render_template, request
app = Flask(__name__)

@app.route('/')
def student():
    return render_template('student.html')

@app.route('/re...]]></description><category></category></item><item><title><![CDATA[python安装numpy和pandas]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/103163865</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/103163865</guid><author>nickyu888</author><pubDate>Wed, 20 Nov 2019 15:27:33 +0800</pubDate><description><![CDATA[最近要对一系列数据做同比比较，需要用到numpy和pandas来计算，不过使用python安装numpy和pandas因为linux环境没有外网遇到了很多问题就记下来了。首要条件，python版本必须是2.7以上。
linux首先安装依赖包
yum -y install blas blas-devel lapack-devel lapack
yum -y install seaborn scipy...]]></description><category></category></item><item><title><![CDATA[Python3 * 和 ** 运算符]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/102820091</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/102820091</guid><author>nickyu888</author><pubDate>Wed, 30 Oct 2019 15:38:02 +0800</pubDate><description><![CDATA[摘录自https://blog.youkuaiyun.com/yilovexing/article/details/80577510
我感兴趣的是如下内容
函数形参
*args 和 **kwargs 主要用于函数定义。
你可以将不定数量的参数传递给一个函数。不定的意思是：预先并不知道, 函数使用者会传递多少个参数给你, 所以在这个场景下使用这两个关键字。其实并不是必须写成 *args 和 **kwargs。 ...]]></description><category></category></item><item><title><![CDATA[MYSQL 5.7主从配置]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/102812868</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/102812868</guid><author>nickyu888</author><pubDate>Wed, 30 Oct 2019 09:59:34 +0800</pubDate><description><![CDATA[MARIADB的主从配置好像略有些区别，但总体和mysql的配置一个意思。
MYSQL5.7 加强了主从同步到性能。
配置参照：https://www.jianshu.com/p/6bb7bde1cd91  https://www.cnblogs.com/eleven24/p/7350000.html
性能调优：https://www.jianshu.com/p/6bb7bde1cd91
同步注意...]]></description><category></category></item><item><title><![CDATA[HDFS中将普通用户增加到超级用户组supergroup以及其应用场景]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/96476544</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/96476544</guid><author>nickyu888</author><pubDate>Fri, 19 Jul 2019 11:24:09 +0800</pubDate><description><![CDATA[参考了 https://blog.youkuaiyun.com/fenglibing/article/details/82261340
Hadoop平台会集成不同的组件，如hdfs、yarn、hive等，不同用户的操作权限不同，除了hdfs是超级用户以外，其它用户都默认是普通用户权限，但是有些场景之下，我们希望普通具有具有hdfs的超级权限，如我oozie中调试shell任务，其中shell调用sqoop从数...]]></description><category></category></item><item><title><![CDATA[SBT编译环境安装]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/91984697</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/91984697</guid><author>nickyu888</author><pubDate>Fri, 14 Jun 2019 17:02:58 +0800</pubDate><description><![CDATA[最初是参考林子雨的文章，http://dblab.xmu.edu.cn/blog/1307-2/ ，但发现sbt-0.13的版本已经不被支持了。
无奈参考这篇文章， https://www.cnblogs.com/hank-yan/p/8686281.html ，安装1.1.1版本。

安装相对容易，spark针对hbase的操作，需要注意如下事项。
1.每一个项目都会需要一个配置文件，即xxx....]]></description><category></category></item><item><title><![CDATA[Python的实用类和方法]]></title><link>https://blog.youkuaiyun.com/nickyu888/article/details/89680272</link><guid>https://blog.youkuaiyun.com/nickyu888/article/details/89680272</guid><author>nickyu888</author><pubDate>Mon, 29 Apr 2019 18:05:12 +0800</pubDate><description><![CDATA[Python的使用类和方法Python的实用类和方法SSH免密登录mysql操作类功能快捷键合理的创建标题，有助于目录的生成如何改变文本的样式插入链接与图片如何插入一段漂亮的代码片生成一个适合你的列表创建一个表格设定内容居中、居左、居右SmartyPants创建一个自定义列表如何创建一个注脚注释也是必不可少的KaTeX数学公式新的甘特图功能，丰富你的文章UML 图表FLowchart流程图导出与导...]]></description><category></category></item></channel></rss>