hive实现update和delete

最新推荐文章于 2024-05-23 09:18:37 发布

MeKa

最新推荐文章于 2024-05-23 09:18:37 发布

阅读量496

点赞数

分类专栏： hive

本文链接：https://blog.youkuaiyun.com/qq_38601362/article/details/109745781

版权

hive 专栏收录该内容

3 篇文章

订阅专栏

设置配置：

set hive.support.concurrency=true; 
set hive.exec.dynamic.partition.mode=nonstrict;
set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
set hive.compactor.initiator.on=true;
set hive.compactor.worker.threads=1;

修改表存储格式(store)为orc,表分桶，属性tblproperties('transactional'='true')，例子如下：

create table test.test(
barcode string,
del string,
qty int",
)
PARTITIONED BY (dt string)
CLUSTERED BY (qty) --根据某个字段分桶
INTO 7 BUCKETS
row format delimited fields terminated by '\t'    
lines terminated by '\n'   
stored as orc tblproperties('transactional'='true');