<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[Iv_zzy的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/Iv_zzy</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; Iv_zzy]]></copyright><item><title><![CDATA[spark报错：WARN TaskSchedulerImpl: Initial job has not accepted any resources； check your cluster UI...]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/127704415</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/127704415</guid><author>Iv_zzy</author><pubDate>Sat, 05 Nov 2022 15:51:50 +0800</pubDate><description><![CDATA[Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources]]></description><category></category></item><item><title><![CDATA[pytest简介 及 和unittest（pyunit）的区别]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/127509133</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/127509133</guid><author>Iv_zzy</author><pubDate>Tue, 25 Oct 2022 11:25:54 +0800</pubDate><description><![CDATA[简单介绍pytest，以及，pytest和unittest的区别总结]]></description><category></category></item><item><title><![CDATA[报错：Allocation of ******* exceeds 10% of free system memory.]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/125382682</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/125382682</guid><author>Iv_zzy</author><pubDate>Mon, 20 Jun 2022 23:44:15 +0800</pubDate><description><![CDATA[存储空间不足，导致模型训练时报错]]></description><category></category></item><item><title><![CDATA[ERROR: Could not install packages due to an OSError: [Errno 2] No such file or directory]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/125105802</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/125105802</guid><author>Iv_zzy</author><pubDate>Thu, 02 Jun 2022 19:25:00 +0800</pubDate><description><![CDATA[安装torch时报错]]></description><category></category></item><item><title><![CDATA[ValueError: X.dtype should be np.float32, got float64]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/121315070</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/121315070</guid><author>Iv_zzy</author><pubDate>Sun, 14 Nov 2021 11:12:30 +0800</pubDate><description><![CDATA[背景
在用GBDT系列训练时，报错ValueError: X.dtype should be np.float32, got float64，如下所示。
ValueError                                Traceback (most recent call last)
&lt;ipython-input-14-aa936862d7d7&gt; in &lt;module&gt;()
----&gt; 1 abc.apply(X_train)

~/tmp/dataset/]]></description><category></category></item><item><title><![CDATA[ValueError: Input data must be 2 dimensional and non empty]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/121255882</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/121255882</guid><author>Iv_zzy</author><pubDate>Wed, 10 Nov 2021 20:29:10 +0800</pubDate><description><![CDATA[背景
在做点击率预估GBDT+LR模型时，使用lightgbm训练时，报错
# create dataset for lightgbm
lgb_train = lgb.Dataset(X_train, label = y_train)
lgb_eval = lgb.Dataset(X_test, label = y_test)

params = {
    'task': 'train',
    'boosting_type': 'gbdt',
    'objective': 'binary',
  ]]></description><category></category></item><item><title><![CDATA[Py4JError: org.apache.spark.api.python.PythonUtils.getPythonAuthSocketTimeout does not exist in the]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/120863314</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/120863314</guid><author>Iv_zzy</author><pubDate>Wed, 20 Oct 2021 11:54:49 +0800</pubDate><description><![CDATA[背景
就是版本没统一
spark和pyspark的版本需要统一
我的spark是3.0.3的
然后使用的是anaconda内的python，安装pyspark的时候没指定版本，默认安装最新的3.2
导致我在使用jupyter的时候报错
解决办法
pip uninstall pyspark
pip install pyspark==3.0.3

然后重启jupyter即可

...]]></description><category></category></item><item><title><![CDATA[linux centos7 安装docker]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/120812571</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/120812571</guid><author>Iv_zzy</author><pubDate>Sun, 17 Oct 2021 16:36:57 +0800</pubDate><description><![CDATA[bo主写的很好，直接搬运

https://cloud.tencent.com/developer/article/1701451


]]></description><category></category></item><item><title><![CDATA[虚拟网络设置]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/120811737</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/120811737</guid><author>Iv_zzy</author><pubDate>Sun, 17 Oct 2021 15:45:20 +0800</pubDate><description><![CDATA[环境
linux
centos7
vmware

https://blog.youkuaiyun.com/baidu_18696283/article/details/89062241


]]></description><category></category></item><item><title><![CDATA[【hadoop报错】JAR does not exist or is not a normal file]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/120808098</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/120808098</guid><author>Iv_zzy</author><pubDate>Sun, 17 Oct 2021 10:30:47 +0800</pubDate><description><![CDATA[背景
linux
centos7
hadoop
执行 hadoop jar 命令时，一直报错
解决方法
1、确定自己的jar目录是切实存在的，别弄错了
我的是

“/export/server/hadoop-3.1.4/share/hadoop/tools/lib/hadoop-streaming-3.1.4.jar”

2、网上找了很多解决办法，最后看到这个

https://www.mmbyte.com/article/45643.html
对比我的路径和对方的路径


想着有没有可能是我直接写了绝对路]]></description><category></category></item><item><title><![CDATA[运行sh文件 报错 Permission denied]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/120807902</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/120807902</guid><author>Iv_zzy</author><pubDate>Sun, 17 Oct 2021 10:22:20 +0800</pubDate><description><![CDATA[背景
linux
centos7
hadoop
本人小白，第一次写sh文件，写完了放在机器上，确一直运行失败，文件内的命令单独都可运行，放在文件内就Permission denied，最后发现是权限的问题
解决方法
1、在hdfs-site.xml中加入以下配置
&lt;property&gt;    
	&lt;name&gt;dfs.permissions&lt;/name&gt;
	&lt;value&gt;false&lt;/value&gt;
&lt;/property&gt;

hdfs-sit]]></description><category></category></item><item><title><![CDATA[centos7安装anaconda3]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/120807712</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/120807712</guid><author>Iv_zzy</author><pubDate>Sun, 17 Oct 2021 10:04:40 +0800</pubDate><description><![CDATA[准备工作
机器内的下载命令 bzip2、wget
yum -y install bzip2
yum install wget

镜像
anaconda的官网下载镜像有点慢，所以在镜像网站下

https://mirrors.tuna.tsinghua.edu.cn/anaconda/archive/

选择最新的

下载安装
wget https://mirrors.tuna.tsinghua.edu.cn/anaconda/archive/Anaconda3-5.3.1-Linux-x86_64.sh -]]></description><category></category></item><item><title><![CDATA[【hadoop报错】（ssh）Connection timed out]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/120779830</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/120779830</guid><author>Iv_zzy</author><pubDate>Fri, 15 Oct 2021 11:35:55 +0800</pubDate><description><![CDATA[背景
在虚拟机上启动hadoop，报错

Starting namenodes on [node1.huike.cn]
Last login: Thu Oct 14 22:36:08 EDT 2021 on pts/0
node1.huike.cn: ssh: connect to host node1.huike.cn port 22: Connection timed out
Starting datanodes
Last login: Thu Oct 14 22:53:14 EDT 2021 on p]]></description><category></category></item><item><title><![CDATA[使用screen离线运行程序常用命令]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/118501236</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/118501236</guid><author>Iv_zzy</author><pubDate>Mon, 05 Jul 2021 23:38:51 +0800</pubDate><description><![CDATA[看了一堆乱七八糟的资料，还是没有讲清楚，感觉很多很乱，所以就整理一下我自己常用的命令吧，希望能帮助刚上手的小伙伴们快速使用
1、screen官网
喜欢看官方使用的小伙伴看过来~
http://www.gnu.org/software/screen/

2、常用命令
anaconda中安装
conda install screen

screen常用命令
screen -S w1 新建一个w1工作窗口
screen -ls 查看当前所有的运行窗口
screen -d w1 将w1窗口离线
screen -r ]]></description><category></category></item><item><title><![CDATA[anaconda已pip isntall mysql 但是import 失败 no module named ‘mysql’]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/118358723</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/118358723</guid><author>Iv_zzy</author><pubDate>Wed, 30 Jun 2021 13:07:05 +0800</pubDate><description><![CDATA[背景

做项目时 发现from mysql import connector报错，显示no module named ‘mysql’
按照惯例，没有啥就pip install，ok，安装完毕，一看，import mysql 还是报错。。。确实是安装了，但是确实一直import error
环境
anaconda3
python3.6.8
解决办法
不要把目光盯在mysql上，要知道本身是 connector 导入失败，所以可以退一步
就不要用pip了，直接进anaconda prompt 用conda命令，]]></description><category></category></item><item><title><![CDATA[bash 中文乱码，无法输入中文]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/114885937</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/114885937</guid><author>Iv_zzy</author><pubDate>Tue, 16 Mar 2021 16:17:37 +0800</pubDate><description><![CDATA[环境
win10
centos7
mobaxterm
问题描述
git commit ""时，输入中文乱码，或显示不了
解决办法
1、输入locale，查看支持的所有编码
locale


2、修改
export LANG=zh_CN.GBK

检查修改
locale


ok，再次输入时，问题解决

...]]></description><category></category></item><item><title><![CDATA[MobaXterm登录堡垒机/跳板机]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/114537238</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/114537238</guid><author>Iv_zzy</author><pubDate>Mon, 08 Mar 2021 17:57:43 +0800</pubDate><description><![CDATA[前言
xshell很好用，但是没找到正式版本，公司不允许使用，看了网上的一些资料，发现MobaXterm是比较好的替代产品。但是找了无数资料，发现网上的登录堡垒机的方法都无法正常登录，试了好久，气死！！！终于找到了方法~
【来自xshell用户 转 mobaXterm萌新，其他用的贼溜的小伙伴请自动绕行哈】
安装
版本
v21.0
链接
官网的免费版本：
https://mobaxterm.mobatek.net/download-home-edition.html
直接portable edition就可]]></description><category></category></item><item><title><![CDATA[ubuntu下LaTeX+texmaker安装与排版练习]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/109472195</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/109472195</guid><author>Iv_zzy</author><pubDate>Tue, 03 Nov 2020 16:46:16 +0800</pubDate><description><![CDATA[刚接触LaTeX,在win10下捣鼓了好久,安装半天才装好,然后又是各种报错,忍不了…直接转向ubuntu,果然,很快就弄好了,本篇不讲内容,只为小白入门指引,引导相关链接…内容全是亲测有效的~
1 ubuntu16.04安装latex

https://blog.youkuaiyun.com/zzc15806/article/details/82113759

2 解决中文输入问题
首先,啥也不说,安装完texmaker之后,回到终端,先下载
sudo apt-get install latex-cjk-all
su]]></description><category></category></item><item><title><![CDATA[ubuntu 远程服务器文件与本地文件的上传与下载]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/109412198</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/109412198</guid><author>Iv_zzy</author><pubDate>Sun, 01 Nov 2020 10:36:46 +0800</pubDate><description><![CDATA[1、从服务器下载文件到本地
scp -r root@10.10.256.1:/home/username/KG-Policy/kgpolicy/out_yelp2018 /home/aha/

root:远程服务器用户名
10.10.256.1：远程服务器的ip地址
/home/username/KG-Policy/kgpolicy/out_yelp2018：需要下载的文件及其路径；我需要下的是out_yelp2018.txt，但是加上txt后会报错，去掉txt就ok
2、上传本地文件到服务器
scp -r]]></description><category></category></item><item><title><![CDATA[解决在anaconda中torch1.1.0下载过慢的问题Read timed out.]]></title><link>https://blog.youkuaiyun.com/Iv_zzy/article/details/109393182</link><guid>https://blog.youkuaiyun.com/Iv_zzy/article/details/109393182</guid><author>Iv_zzy</author><pubDate>Fri, 30 Oct 2020 21:28:45 +0800</pubDate><description><![CDATA[尝试了修改anaconda镜像源，完全按照网友的操作做完后，还是15KB/s左右的速度，龟速前进，最终Read timed out.
我一度以为是我网速的问题。。。结果让小伙伴帮我测试了一下，差不多都是10-30kb的亚子。。。
没用归没用，咱们还是乖乖先把镜像源修改了：
1、在终端输入：
conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free/
conda config --add channe]]></description><category></category></item></channel></rss>