hive mr过程创建文件数太多导致job被kill

1.报错如下：

[Fatal Error] total number of created files now is 100088, which exceeds 100000. Killing the job.
MapReduce Total cumulative CPU time: 5 days 23 hours 48 minutes 22 seconds 380 msec
Ended Job = job_1558921609180_25976 with errors
Error during job, obtaining debugging information...

2.查看mr job具体信息：

如图所示总的map数为154361，超过了 100088

3.参考链接：https://blog.youkuaiyun.com/u010002184/article/details/88572872

手动设置hive.exec.max.created.files调大能够创建的文件数，再次尝试改job

SET hive.exec.max.created.files=900000;

4.再次执行任务成功：

这些failed和killed是机器挂了引起的。。。，跑到最后机器挂了，