一、关闭PySpark中的INFO日志记录
1、进入spark安装目录,进入conf目录
cd /usr/local/spark/conf
cp log4j.properties.template log4j.properties
2、编辑log4j.properties:
# Set everything to be logged to the console
log4j.rootCategory=INFO, console
log4j.appender.console=org.apache.