Bsj' blog

spark Caused by: java.net.UnknownHostException: XXXException in thread "main" java.lang.reflect.UndeclaredThrowableException at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1761) at org.apache.spark.deploy.S

org.apache.spark.api.python.PythonUtils.getPythonAuthSocketTimeout does not exist in the JVM我使用pex打包python环境运行我的python脚本，但是出现这个错。解决方案是：# 比如spark的版本是3.0.0，pyspark的版本也要是3.0.0pex 'pyspark==3.0.0' pandas -o test.pexpyspark要与spark的版本一致！...

solutionexecute this command to install cmake package.apt-get install -y cmake

VSCode：所选环境中没有可用的Pip安装程序我提供一种解决方案。设置vscode的python安装路径：在file -> preferences -> setting中搜索 python.pythonPath，然后把本地的python安装路径写上去，bingo！

{ “message”: “Failed to decode JSON object: Expecting value: line 1 column 1 (char 0)” }自己踩了一个坑，就此记录一下:字典不能设置默认值！# ...# 会报错param_value = json_data.get('param', 0)# ...服务端(正确的服务端代码)：# 得到的json数据json_data = request.json# 我这里的param_value是dict类型的，所

TypeError: descriptor 'WhichOneof' requires a 'google.protobuf.pyext._message.CMessage' object but received a 'GeneratedProtocolMessageType'

One of the configured repositories failed (Unknown),and yum doesn’t have enough cached data to continue. At this point the onlysafe thing yum can do is fail. There are a few ways to work “fix” this: 1. Contact the upstream for the repository and get the

OSError: [WinError 10038] An operation was attempted on something that is not a socket服务端的conn.close()写在while循环的外部，不然关闭连接之后会重新连接。

命令行下执行：关闭npm的https（取消npm的https认证）npm config set strict-ssl falseok

Scrapy报错 Modue not Found: no module named XXX.settings  本来程序是没错的，当时调通之后个人也测试了一下，但是报的找不到 BlogSpider.settings这个settings文件的错误，网上有个老兄说把Python卸载重装… 阿弥陀佛，重装大法好。不过我没用。  后来请教大牛，把我运行爬虫的文件，放到了上级文件夹目录问题解决...