Scala Collection

本文深入介绍了Scala中的集合类型,包括可变和不可变集合的区别,以及List、Set、Map、元组、Option和Iterator等常见集合类型的使用方法和特性。

Scala Collection

Scala提供了一套很好的集合实现,提供了一些集合类型的抽象。

Scala 集合分为可变的和不可变的集合。

可变集合可以在适当的地方被更新或扩展。这意味着你可以修改,添加,移除一个集合的元素。

而不可变集合类,相比之下,永远不会改变。不过,你仍然可以模拟添加,移除或更新操作。但是这些操作将在每一种情况下都返回一个新的集合,同时使原来的集合不发生改变。

接下来我们将为大家介绍几种常用集合类型的应用:

序号集合及描述
1Scala List(列表)

List的特征是其元素以线性方式存储,集合中可以存放重复对象。

参考 API文档

2Scala Set(集合)

Set是最简单的一种集合。集合中的对象不按特定的方式排序,并且没有重复对象。

参考 API文档

3Scala Map(映射)

Map 是一种把键对象和值对象映射的集合,它的每一个元素都包含一对键对象和值对象。

参考 API文档

4Scala 元组

元组是不同类型的值的集合

5Scala Option

Option[T] 表示有可能包含值的容器,也可能不包含值。

6Scala Iterator(迭代器)

迭代器不是一个容器,更确切的说是逐一访问容器内元素的方法。

实例

以下代码判断,演示了所有以上集合类型的定义实例:

// 定义整型 List
val x = List(1,2,3,4)

// 定义 Set
val x = Set(1,3,5,7)

// 定义 Map
val x = Map("one" -> 1, "two" -> 2, "three" -> 3)

// 创建两个不同类型元素的元组
val x = (10, "Runoob")

// 定义 Option
val x:Option[Int] = Some(5)
execute_queries_and_insert()成功建立与数据库的连接,连接对象: <databricks.sql.client.Connection object at 0x7fa41db65810> 查询本次校验的规则范围SQL为:select t1.rulesql from dm_urp_bui_dgs.ruleTypeConfig t1 inner join dm_urp_bui_dgs.rulecodetosys t3 on t1.rulecode=t3.rulecode where t1.rulestatus ='0' and t1.runstates = '0' and t1.module = 'EAST2' and t1.rulesource = '' union all select t1.rulesql from dm_urp_bui_dgs.ruleTypeConfig t1 where t1.rulestatus ='0' and t1.runstates = '0' and t1.module = 'EAST2' and t1.rulesource = '03' insert into dm_urp_bui_dgs.errorDataDetail_east select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(GRBDH,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06747' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat( '批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';保单终止日期:', nvl(bdzzrq1, '') ) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from ( select * from dm_urp_bui_east2.RDS_GRBDB where 1 = 1 ) t where t.bdzzyy1 is not null and t.bdzzrq1 is null and t.dt = '{dt}' and BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(TTBDH,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06748' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat('批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';保单终止日期:', nvl(BDZZRQ1, '')) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from(select t.* from dm_urp_bui_east2.RDS_TTBDB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and BDZZYY1 is not NULL and BDZZRQ1 is null)t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(TBDH,''),';',nvl(TTBDH,''),';',nvl(TDBXXZHM,''),';',nvl(GRBDH,''),';',nvl(GDBXXZHM,''),';',nvl(HBYWLX,''),';',nvl(HBSXH,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06749' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat( '批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';核保顺序号:', nvl(HBSXH, '') ) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from ( select * from dm_urp_bui_east2.RDS_BDXZHBXXB where 1=1 and dt = '2025032300' and dt = '{dt}' ) t where HBSXH is null and exists( select 1 from dm_urp_bui_east2.RDS_BDXZHBXXB t2 where t.TTBDH = t2.TTBDH AND t.GRBDH = t2.GRBDH AND t.HBYWLX= t2.HBYWLX AND t.HBSXH <> t2.HBSXH and t2.dt = '{dt}' ) and BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(GRBDH,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06750' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat( '批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';保费:', nvl(bf, '') ) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from ( select * from dm_urp_bui_east2.RDS_GRBDB where 1 = 1 ) t where t.bf <= 0 and t.dt = '{dt}' and BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(GRBDH,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06751' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat( '批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';签单日期:', nvl(qdrq, '') ) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from ( select * from dm_urp_bui_east2.RDS_GRBDB where 1 = 1 ) t where (t.qdrq = '99991231' or t.qdrq = '99990101') and (t.bdsxrq = '99991231' or t.bdsxrq = '99990101') and (t.sqjfrq = '99991231' or t.sqjfrq = '99990101') and t.dt = '{dt}' and BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(TTBDH,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06752' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat('批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';保费:', nvl(BF, '')) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from(select t.* from dm_urp_bui_east2.RDS_TTBDB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and BF < 1)t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(TTBDH,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06753' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat('批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';签单日期:', nvl(QDRQ, '')) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from(select t.* from dm_urp_bui_east2.RDS_TTBDB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and (qdrq in ('99991231','99990101') or bdsxrq in ('99991231','99990101') or bdsxrq in ('99991231','99990101')) )t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(TTBDH,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06754' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat('批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';保单状态:', nvl(BDZT, '')) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from(select t.* from dm_urp_bui_east2.RDS_TTBDB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and TBZRS < 1)t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(GRBDH,''),';',nvl(GDBXXZHM,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST' as module, 'EAST06755' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat( '批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';当期保费:', nvl(dqbf, '') ) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from ( select * from dm_urp_bui_east2.RDS_GRXZB where 1 = 1 ) t where t.dqbf <= '0' and t.dt = '{dt}' and BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(GRBDH,''),';',nvl(GDBXXZHM,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST' as module, 'EAST06756' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat( '批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';保险责任生效日期:', nvl(bxzrsxrq, '') ) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from ( select * from dm_urp_bui_east2.RDS_GRXZB where 1 = 1 ) t where (t.bxzrsxrq = '99991231' or t.bxzrsxrq = '99990101') and t.dt = '{dt}' and BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(GRBDH,''),';',nvl(GDBXXZHM,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST' as module, 'EAST06757' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat( '批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';首期交费日期:', nvl(sqjfrq, '') ) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from ( select * from dm_urp_bui_east2.RDS_GRXZB where 1 = 1 ) t where (t.sqjfrq = '99991231' or t.sqjfrq = '99990101') and t.dt = '{dt}' and BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(TTBDH,''),';',nvl(TDBXXZHM,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06758' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat('批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';当期保费:', nvl(DQBF, '')) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from(select t.* from dm_urp_bui_east2.RDS_TTXZB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and dqbf <= 0) t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(TTBDH,''),';',nvl(TDBXXZHM,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06759' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat('批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';保险责任生效日期:', nvl(BXZRSXRQ, '')) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from(select t.* from dm_urp_bui_east2.RDS_TTXZB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and BXZRSXRQ in ('99991231','99990101')) t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(NBJGH,''),';',nvl(TTBDH,''),';',nvl(TDBXXZHM,''),';Y') as id, concat('c_','east2','_','2025033100') as checkbatchno, 'EAST2' as module, 'EAST06760' as rulecode, '1' as state, '' as problemCode, '' as problemdessou, concat('批次号:', nvl(BATCHNO, ''), ';业务号:', nvl(BUSSNO, ''), ';首期交费日期:', nvl(SQJFRQ, '')) as detaildata, '' as issueid, '' as innerdes, current_date() as modifydate, current_date() as checkdate, '' as remark, datasrc as datasrc, '' as transno, '' as valueno, '2025032300' as dt from(select t.* from dm_urp_bui_east2.RDS_TTXZB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and SQJFRQ in ('99991231','99990101')) t where BATCHNO = '2025033100'; union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06761' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';姓名:' ,nvl(XM,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.SPL_GRKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and xm not regexp '^([一-龥㐀-䶿 0-⩭F⩰0-⭳F⭴0-⮁F⮂0-⳪FⳫ0-⺾F])$' and xm not regexp '^[A-Za-z]+$') t where BATCHNO = '2025033100'; union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06762' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';职业:' ,nvl(ZY,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_GRKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and zy = '其他-其他-其他') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06763' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';证件号码:' ,nvl(GRKHZJHM,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.SPL_GRKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and GRKHZJHM not RLIKE '^[a-zA-Z0-9]{70}$') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06764' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';姓名:' ,nvl(XM,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_GRKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and XM LIKE '%信托%') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06765' as rulecode ,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';负责人姓名:' ,nvl(FZRXM,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.SPL_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and FZRXM not regexp '^[\u4E00-\u9FA5]$' and FZRXM not regexp '^[A-Za-z]+$' ) t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06766' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';负责人姓名:' ,nvl(FZRXM,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and nvl(FZRXM,'N/A') = 'N/A') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06767' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';联系人姓名:' ,nvl(LXRXM,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.SPL_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and LXRXM not regexp '^[\u4E00-\u9FA5]$' and LXRXM not regexp '^[A-Za-z]+$' ) t where BATCHNO = '2025033100' union all SELECT concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') AS checkbatchno ,'EAST2' AS module ,'EAST06768' AS rulecode,'1' AS state ,'' AS problemCode ,'' AS problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';负责人证件号码:' ,nvl(FZRZJHM,'')) AS detaildata ,'' AS issueid ,'' AS innerdes ,current_date() AS modifydate ,current_date() AS checkdate ,'' AS remark , datasrc AS datasrc , '' AS transno , '' AS valueno , '' AS dt FROM(SELECT t.* FROM dm_urp_bui_east2.SPL_JGKHXXB t WHERE 1=1 and dt = '2025032300' AND BATCHNO = '2025033100' AND FZRZJHM NOT RLIKE '^[a-zA-Z0-9]{70}$') t WHERE BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06769' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';证件号码:' ,nvl(ZJHM,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and zjlx = '2010' and ZJHM not RLIKE '^[1-9ANY][1-39][0-9A-Za-z]{16}$') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06770' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';证件类型:' ,nvl(ZJLX,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and zjlx <> '2010' and ZJHM RLIKE '^[1-9ANY][1-39][0-9A-Za-z]{16}$') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06771' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';客户名称:' ,nvl(KHMC,''))as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and KHMC not RLIKE '[^a-zA-Z0-9s一-鿿_]') t where BATCHNO = '2025033100 union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06772' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';证件号码:' ,nvl(ZJHM,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and ZJHM not RLIKE '^[0-9A-Z]+$') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06773' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';证件号码:' ,nvl(ZJHM,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and ZJHM not RLIKE '^[0-9A-Z]+$') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06774' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';注册地址所在街道:' ,nvl(ZCDZSZJD,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and ZCDZSZJD not RLIKE '.*[\u4e00-\u9fa5].*[\u4e00-\u9fa5].*[\u4e00-\u9fa5].*') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06775' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';注册地址所在街道:' ,nvl(ZCDZSZJD,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and ZCDZSZJD not RLIKE '.*[\u4e00-\u9fa5].*[\u4e00-\u9fa5].*[\u4e00-\u9fa5].*') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06776' as rulecode,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';证件到期日期:' ,nvl(ZJDQRQ,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and nvl(ZJDQRQ,'N/A') = 'N/A') t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id ,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06777' as rulecode ,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号:',nvl(BATCHNO,''),';业务号:',nvl(BUSSNO,'') ,';银行名称:' ,nvl(YHMC,'')) as detaildata ,'' as issueid ,'' as innerdes ,current_date() as modifydate ,current_date() as checkdate ,'' as remark , datasrc as datasrc , '' as transno , '' as valueno , '2025032300' as dt from( select t.* from dm_urp_bui_east2.RDS_JGKHXXB t where 1=1 and dt = '2025032300' and BATCHNO = '2025033100' and not ( (COALESCE(yhmc, '') = '' AND COALESCE(yhzh, '') = '' AND (COALESCE(yhzhmc, '') = '')) OR ( (COALESCE(yhmc, '') <> '') AND COALESCE(yhzh, '') <> '' AND COALESCE(yhzhmc, '') <> '') ) ) t where BATCHNO = '2025033100' union all select concat(nvl(BATCHNO,''),';',nvl(BUSSNO,''),';',nvl(BXJGDM,''),';',nvl(KHBH,''),';Y') as id,concat('c_','east2','_','2025033100') as checkbatchno ,'EAST2' as module ,'EAST06778' as rulecode ,'1' as state ,'' as problemCode ,'' as problemdessou ,concat('批次号 *** WARNING: max output size exceeded, skipping output. *** ache spark sql execution SparkPlan org apache spark sql execution SparkPlan withExecuteQueryLogging SparkPlan scala 132 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 399 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution SparkPlan execute SparkPlan scala 336 at org apache spark sql execution exchange ShuffleExchangeExec inputRDD lzycompute ShuffleExchangeExec scala 312 at org apache spark sql execution exchange ShuffleExchangeExec inputRDD ShuffleExchangeExec scala 312 at org apache spark sql execution exchange ShuffleExchangeExec shuffleDependency lzycompute ShuffleExchangeExec scala 375 at org apache spark sql execution exchange ShuffleExchangeExec shuffleDependency ShuffleExchangeExec scala 366 at org apache spark sql execution exchange ShuffleExchangeExec shuffleId ShuffleExchangeExec scala 328 at org apache spark sql execution exchange ShuffleExchangeLike anonfun relationFuture 2 ShuffleExchangeExec scala 156 at scala runtime java8 JFunction0 mcI sp apply JFunction0 mcI sp java 23 at org apache spark sql execution SparkPlan org apache spark sql execution SparkPlan withExecuteQueryLogging SparkPlan scala 132 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 399 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution exchange ShuffleExchangeLike anonfun relationFuture 1 ShuffleExchangeExec scala 156 at org apache spark sql SparkSession withActive SparkSession scala 1210 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 7 SQLExecution scala 905 at com databricks util LexicalThreadLocal Handle runWith LexicalThreadLocal scala 63 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 6 SQLExecution scala 905 at com databricks util LexicalThreadLocal Handle runWith LexicalThreadLocal scala 63 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 5 SQLExecution scala 905 at scala util DynamicVariable withValue DynamicVariable scala 62 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 4 SQLExecution scala 904 at scala util DynamicVariable withValue DynamicVariable scala 62 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 3 SQLExecution scala 903 at com databricks sql transaction tahoe ConcurrencyHelpers withOptimisticTransaction ConcurrencyHelpers scala 57 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 2 SQLExecution scala 902 at org apache spark JobArtifactSet withActiveJobArtifactState JobArtifactSet scala 97 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 1 SQLExecution scala 886 at java util concurrent CompletableFuture AsyncSupply run CompletableFuture java 1604 at org apache spark util threads SparkThreadLocalCapturingRunnable anonfun run 1 SparkThreadLocalForwardingThreadPoolExecutor scala 157 at scala runtime java8 JFunction0 mcV sp apply JFunction0 mcV sp java 23 at com databricks spark util IdentityClaim withClaim IdentityClaim scala 48 at org apache spark util threads SparkThreadLocalCapturingHelper anonfun runWithCaptured 4 SparkThreadLocalForwardingThreadPoolExecutor scala 113 at com databricks unity UCSEphemeralState Handle runWith UCSEphemeralState scala 51 at org apache spark util threads SparkThreadLocalCapturingHelper runWithCaptured SparkThreadLocalForwardingThreadPoolExecutor scala 112 at org apache spark util threads SparkThreadLocalCapturingHelper runWithCaptured SparkThreadLocalForwardingThreadPoolExecutor scala 89 at org apache spark util threads SparkThreadLocalCapturingRunnable runWithCaptured SparkThreadLocalForwardingThreadPoolExecutor scala 154 at org apache spark util threads SparkThreadLocalCapturingRunnable run SparkThreadLocalForwardingThreadPoolExecutor scala 157 at java util concurrent ThreadPoolExecutor runWorker ThreadPoolExecutor java 1149 at java util concurrent ThreadPoolExecutor Worker run ThreadPoolExecutor java 624 at java lang Thread run Thread java 750 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_east2','An error occurred while calling o2340 collectToPython org apache spark SparkException SCALAR SUBQUERY TOO MANY ROWS More than one row returned by a subquery used as an expression SQLSTATE 21000 SQL line 1 position 168 BATCHNO WHERE t2 GROUPRULECODE SELECT GROUPRULECODE FROM dm urp bui dgs checkbatchno WHERE checkbatchno c east2 2025033100 AND t1 CHECKBATCHNO c east2 2 at org apache spark sql errors QueryExecutionErrors multipleRowScalarSubqueryError QueryExecutionErrors scala 3050 at org apache spark sql execution ScalarSubquery updateResult subquery scala 91 at org apache spark sql execution SparkPlan anonfun waitForSubqueries 1 SparkPlan scala 442 at org apache spark sql execution SparkPlan anonfun waitForSubqueries 1 adapted SparkPlan scala 441 at scala collection mutable ResizableArray foreach ResizableArray scala 62 at scala collection mutable ResizableArray foreach ResizableArray scala 55 at scala collection mutable ArrayBuffer foreach ArrayBuffer scala 49 at org apache spark sql execution SparkPlan waitForSubqueries SparkPlan scala 441 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 398 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution CodegenSupport produce WholeStageCodegenExec scala 98 at org apache spark sql execution CodegenSupport produce WholeStageCodegenExec scala 97 at org apache spark sql execution FilterExec produce basicPhysicalOperators scala 216 at org apache spark sql execution aggregate HashAggregateExec doProduceWithKeys HashAggregateExec scala 632 at org apache spark sql execution aggregate AggregateCodegenSupport doProduce AggregateCodegenSupport scala 76 at org apache spark sql execution aggregate AggregateCodegenSupport doProduce AggregateCodegenSupport scala 72 at org apache spark sql execution aggregate HashAggregateExec doProduce HashAggregateExec scala 53 at org apache spark sql execution CodegenSupport anonfun produce 1 WholeStageCodegenExec scala 103 at org apache spark sql execution SparkPlan org apache spark sql execution SparkPlan withExecuteQueryLogging SparkPlan scala 132 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 399 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution CodegenSupport produce WholeStageCodegenExec scala 98 at org apache spark sql execution CodegenSupport produce WholeStageCodegenExec scala 97 at org apache spark sql execution aggregate HashAggregateExec produce HashAggregateExec scala 53 at org apache spark sql execution WholeStageCodegenExec doCodeGen WholeStageCodegenExec scala 714 at org apache spark sql execution WholeStageCodegenExec doExecute WholeStageCodegenExec scala 777 at org apache spark sql execution SparkPlan anonfun execute 2 SparkPlan scala 341 at com databricks spark util FrameProfiler record FrameProfiler scala 94 at org apache spark sql execution SparkPlan anonfun execute 1 SparkPlan scala 341 at org apache spark sql execution SparkPlan org apache spark sql execution SparkPlan withExecuteQueryLogging SparkPlan scala 132 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 399 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution SparkPlan execute SparkPlan scala 336 at org apache spark sql execution exchange ShuffleExchangeExec inputRDD lzycompute ShuffleExchangeExec scala 312 at org apache spark sql execution exchange ShuffleExchangeExec inputRDD ShuffleExchangeExec scala 312 at org apache spark sql execution exchange ShuffleExchangeExec shuffleDependency lzycompute ShuffleExchangeExec scala 375 at org apache spark sql execution exchange ShuffleExchangeExec shuffleDependency ShuffleExchangeExec scala 366 at org apache spark sql execution exchange ShuffleExchangeExec shuffleId ShuffleExchangeExec scala 328 at org apache spark sql execution exchange ShuffleExchangeLike anonfun relationFuture 2 ShuffleExchangeExec scala 156 at scala runtime java8 JFunction0 mcI sp apply JFunction0 mcI sp java 23 at org apache spark sql execution SparkPlan org apache spark sql execution SparkPlan withExecuteQueryLogging SparkPlan scala 132 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 399 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution exchange ShuffleExchangeLike anonfun relationFuture 1 ShuffleExchangeExec scala 156 at org apache spark sql SparkSession withActive SparkSession scala 1210 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 7 SQLExecution scala 905 at com databricks util LexicalThreadLocal Handle runWith LexicalThreadLocal scala 63 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 6 SQLExecution scala 905 at com databricks util LexicalThreadLocal Handle runWith LexicalThreadLocal scala 63 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 5 SQLExecution scala 905 at scala util DynamicVariable withValue DynamicVariable scala 62 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 4 SQLExecution scala 904 at scala util DynamicVariable withValue DynamicVariable scala 62 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 3 SQLExecution scala 903 at com databricks sql transaction tahoe ConcurrencyHelpers withOptimisticTransaction ConcurrencyHelpers scala 57 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 2 SQLExecution scala 902 at org apache spark JobArtifactSet withActiveJobArtifactState JobArtifactSet scala 97 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 1 SQLExecution scala 886 at java util concurrent CompletableFuture AsyncSupply run CompletableFuture java 1604 at org apache spark util threads SparkThreadLocalCapturingRunnable anonfun run 1 SparkThreadLocalForwardingThreadPoolExecutor scala 157 at scala runtime java8 JFunction0 mcV sp apply JFunction0 mcV sp java 23 at com databricks spark util IdentityClaim withClaim IdentityClaim scala 48 at org apache spark util threads SparkThreadLocalCapturingHelper anonfun runWithCaptured 4 SparkThreadLocalForwardingThreadPoolExecutor scala 113 at com databricks unity UCSEphemeralState Handle runWith UCSEphemeralState scala 51 at org apache spark util threads SparkThreadLocalCapturingHelper runWithCaptured SparkThreadLocalForwardingThreadPoolExecutor scala 112 at org apache spark util threads SparkThreadLocalCapturingHelper runWithCaptured SparkThreadLocalForwardingThreadPoolExecutor scala 89 at org apache spark util threads SparkThreadLocalCapturingRunnable runWithCaptured SparkThreadLocalForwardingThreadPoolExecutor scala 154 at org apache spark util threads SparkThreadLocalCapturingRunnable run SparkThreadLocalForwardingThreadPoolExecutor scala 157 at java util concurrent ThreadPoolExecutor runWorker ThreadPoolExecutor java 1149 at java util concurrent ThreadPoolExecutor Worker run ThreadPoolExecutor java 624 at java lang Thread run Thread java 750 ','288','','','2025-03-23 00:00:00') An error occurred while calling o2340 collectToPython org apache spark SparkException SCALAR SUBQUERY TOO MANY ROWS More than one row returned by a subquery used as an expression SQLSTATE 21000 SQL line 1 position 168 BATCHNO WHERE t2 GROUPRULECODE SELECT GROUPRULECODE FROM dm urp bui dgs checkbatchno WHERE checkbatchno c east2 2025033100 AND t1 CHECKBATCHNO c east2 2 at org apache spark sql errors QueryExecutionErrors multipleRowScalarSubqueryError QueryExecutionErrors scala 3050 at org apache spark sql execution ScalarSubquery updateResult subquery scala 91 at org apache spark sql execution SparkPlan anonfun waitForSubqueries 1 SparkPlan scala 442 at org apache spark sql execution SparkPlan anonfun waitForSubqueries 1 adapted SparkPlan scala 441 at scala collection mutable ResizableArray foreach ResizableArray scala 62 at scala collection mutable ResizableArray foreach ResizableArray scala 55 at scala collection mutable ArrayBuffer foreach ArrayBuffer scala 49 at org apache spark sql execution SparkPlan waitForSubqueries SparkPlan scala 441 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 398 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution CodegenSupport produce WholeStageCodegenExec scala 98 at org apache spark sql execution CodegenSupport produce WholeStageCodegenExec scala 97 at org apache spark sql execution FilterExec produce basicPhysicalOperators scala 216 at org apache spark sql execution aggregate HashAggregateExec doProduceWithKeys HashAggregateExec scala 632 at org apache spark sql execution aggregate AggregateCodegenSupport doProduce AggregateCodegenSupport scala 76 at org apache spark sql execution aggregate AggregateCodegenSupport doProduce AggregateCodegenSupport scala 72 at org apache spark sql execution aggregate HashAggregateExec doProduce HashAggregateExec scala 53 at org apache spark sql execution CodegenSupport anonfun produce 1 WholeStageCodegenExec scala 103 at org apache spark sql execution SparkPlan org apache spark sql execution SparkPlan withExecuteQueryLogging SparkPlan scala 132 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 399 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution CodegenSupport produce WholeStageCodegenExec scala 98 at org apache spark sql execution CodegenSupport produce WholeStageCodegenExec scala 97 at org apache spark sql execution aggregate HashAggregateExec produce HashAggregateExec scala 53 at org apache spark sql execution WholeStageCodegenExec doCodeGen WholeStageCodegenExec scala 714 at org apache spark sql execution WholeStageCodegenExec doExecute WholeStageCodegenExec scala 777 at org apache spark sql execution SparkPlan anonfun execute 2 SparkPlan scala 341 at com databricks spark util FrameProfiler record FrameProfiler scala 94 at org apache spark sql execution SparkPlan anonfun execute 1 SparkPlan scala 341 at org apache spark sql execution SparkPlan org apache spark sql execution SparkPlan withExecuteQueryLogging SparkPlan scala 132 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 399 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution SparkPlan execute SparkPlan scala 336 at org apache spark sql execution exchange ShuffleExchangeExec inputRDD lzycompute ShuffleExchangeExec scala 312 at org apache spark sql execution exchange ShuffleExchangeExec inputRDD ShuffleExchangeExec scala 312 at org apache spark sql execution exchange ShuffleExchangeExec shuffleDependency lzycompute ShuffleExchangeExec scala 375 at org apache spark sql execution exchange ShuffleExchangeExec shuffleDependency ShuffleExchangeExec scala 366 at org apache spark sql execution exchange ShuffleExchangeExec shuffleId ShuffleExchangeExec scala 328 at org apache spark sql execution exchange ShuffleExchangeLike anonfun relationFuture 2 ShuffleExchangeExec scala 156 at scala runtime java8 JFunction0 mcI sp apply JFunction0 mcI sp java 23 at org apache spark sql execution SparkPlan org apache spark sql execution SparkPlan withExecuteQueryLogging SparkPlan scala 132 at org apache spark sql execution SparkPlan anonfun executeQuery 1 SparkPlan scala 399 at org apache spark rdd RDDOperationScope withScope RDDOperationScope scala 165 at org apache spark sql execution SparkPlan executeQuery SparkPlan scala 395 at org apache spark sql execution exchange ShuffleExchangeLike anonfun relationFuture 1 ShuffleExchangeExec scala 156 at org apache spark sql SparkSession withActive SparkSession scala 1210 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 7 SQLExecution scala 905 at com databricks util LexicalThreadLocal Handle runWith LexicalThreadLocal scala 63 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 6 SQLExecution scala 905 at com databricks util LexicalThreadLocal Handle runWith LexicalThreadLocal scala 63 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 5 SQLExecution scala 905 at scala util DynamicVariable withValue DynamicVariable scala 62 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 4 SQLExecution scala 904 at scala util DynamicVariable withValue DynamicVariable scala 62 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 3 SQLExecution scala 903 at com databricks sql transaction tahoe ConcurrencyHelpers withOptimisticTransaction ConcurrencyHelpers scala 57 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 2 SQLExecution scala 902 at org apache spark JobArtifactSet withActiveJobArtifactState JobArtifactSet scala 97 at org apache spark sql execution SQLExecution anonfun withThreadLocalCaptured 1 SQLExecution scala 886 at java util concurrent CompletableFuture AsyncSupply run CompletableFuture java 1604 at org apache spark util threads SparkThreadLocalCapturingRunnable anonfun run 1 SparkThreadLocalForwardingThreadPoolExecutor scala 157 at scala runtime java8 JFunction0 mcV sp apply JFunction0 mcV sp java 23 at com databricks spark util IdentityClaim withClaim IdentityClaim scala 48 at org apache spark util threads SparkThreadLocalCapturingHelper anonfun runWithCaptured 4 SparkThreadLocalForwardingThreadPoolExecutor scala 113 at com databricks unity UCSEphemeralState Handle runWith UCSEphemeralState scala 51 at org apache spark util threads SparkThreadLocalCapturingHelper runWithCaptured SparkThreadLocalForwardingThreadPoolExecutor scala 112 at org apache spark util threads SparkThreadLocalCapturingHelper runWithCaptured SparkThreadLocalForwardingThreadPoolExecutor scala 89 at org apache spark util threads SparkThreadLocalCapturingRunnable runWithCaptured SparkThreadLocalForwardingThreadPoolExecutor scala 154 at org apache spark util threads SparkThreadLocalCapturingRunnable run SparkThreadLocalForwardingThreadPoolExecutor scala 157 at java util concurrent ThreadPoolExecutor runWorker ThreadPoolExecutor java 1149 at java util concurrent ThreadPoolExecutor Worker run ThreadPoolExecutor java 624 at java lang Thread run Thread java 750 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 执行成功!: insert into dm_urp_bui_dgs.databrickserror values ('dm_urp_bui_all_datacheck_prip','','355','','','2025-03-23 00:00:00') 检核执行错误的任务 2025032300 def execute_insert_to_biaojiandatacalculation(dt):成功建立与数据库的连接,连接对象: <databricks.sql.client.Connection object at 0x7fa41c502950> 分公司E类规则开始,当前时间: 2025-08-25 20:50:03.608117 select batchno from dm_urp_bui_east2.rds_reportflow where dt = '2025032300' 分公司规则加工结束,当前时间: 2025-08-25 20:50:04.117786
最新发布
08-27
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值