[Fatal Error] total number of created files now is 100043, which exceeds 100000. Killing the job
由于我这个是分区表,表也比较大,在做表的备份,把数据拷贝到另外一张表。拷贝的过程是: insert overwrite table as select * from table1ERROR:[Fatal Error] total number of created files now is 100043, which exceeds 100000. Killing the job解决:sql 后面加distributeby dt ,原理是让insert sql产生reduce过程,从...
原创
2020-07-07 17:27:05 ·
745 阅读 ·
0 评论