- 博客(4)
- 收藏
- 关注
RSS订阅原创 Spark Shuffle过程报错org.apache.spark.shuffle.MetadataFetchFailedException
具体错误提示： Most recent failure reason: **org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 18** at org.apache.spark.MapOutputTracker$$anonfun$convertMapStatuses$2.apply(MapOutputTracker.scala:882) at org.apache.spar
2021-08-27 09:52:02
992
原创 airflow schedule start time
start_date = datetime(2019, 02, 11) default_args = { ‘owner’: ‘xxx’, ‘start_date’: start_date, } dag = DAG( dag_id=‘Loreal_Load’, default_args=default_args, schedule_interval=‘0 3 * * *’) The importan...
2019-02-12 16:43:42
843
原创 linux后台执行命令，以确保终端断掉程序不会断。
nohup command & exit Then the terminal will close. If you want to find this process and kill it due to some emergency, try "ps -aux|grep part_of_your_command " to find the PID, then “kill -9 PID” ...
2019-01-23 18:46:09
1630
原创 Linux里，shell脚本连接sftp
from subprocess import call def main(): cmd5 = “”“sftp -oIdentityfile=…openssh targetAddress <<EOT put filename exit EOT”"" call(cmd5,shell=True) if name == ‘main’: main() 注意： EOT： end of text。...
2019-01-17 13:44:58
8438
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人