REPLACE COLUMNS is only supported with v2 tables

最新推荐文章于 2023-11-28 13:28:48 发布
最新推荐文章于 2023-11-28 13:28:48 发布
阅读量3.2k 收藏 1
点赞数 2
文章标签： spark big data
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.youkuaiyun.com/jiashenshi/article/details/125071308
版权 
22/05/31 18:33:28 INFO CodeGenerator: Code generated in 13.5779 ms
22/05/31 18:33:28 INFO BlockManagerInfo: Removed broadcast_4_piece0 on DESKTOP-2JV12RE:52104 in memory (size: 5.2 KiB, free: 3.0 GiB)
22/05/31 18:33:28 INFO BlockManagerInfo: Removed broadcast_3_piece0 on DESKTOP-2JV12RE:52104 in memory (size: 27.6 KiB, free: 3.0 GiB)
22/05/31 18:33:29 INFO InMemoryFileIndex: It took 49 ms to list leaf files for 1 paths.
alter table abc replace columns (country string,province string,city string,ip string,district string,fx_time string)
Exception in thread "main" org.apache.spark.sql.AnalysisException: REPLACE COLUMNS is only supported with v2 tables.
	at org.apache.spark.sql.catalyst.analysis.ResolveSessionCatalog$$anonfun$apply$1.applyOrElse(ResolveSessionCatalog.scala:79)
	at org.apache.spark.sql.catalyst.analysis.ResolveSessionCatalog$$anonfun$apply$1.applyOrElse(ResolveSessionCatalog.scala:48)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUp$3(AnalysisHelper.scala:90)
	at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:73)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUp$1(AnalysisHelper.scala:90)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:221)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp(AnalysisHelper.scala:86)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp$(AnalysisHelper.scala:84)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsUp(LogicalPlan.scala:29)
	at org.apache.spark.sql.catalyst.analysis.ResolveSessionCatalog.apply(ResolveSessionCatalog.scala:48)
	at org.apache.spark.sql.catalyst.analysis.ResolveSessionCatalog.apply(ResolveSessionCatalog.scala:39)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$2(RuleExecutor.scala:216)
	at scala.collection.LinearSeqOptimized.foldLeft(LinearSeqOptimized.scala:126)
	at scala.collection.LinearSeqOptimized.foldLeft$(LinearSeqOptimized.scala:122)
	at scala.collection.immutable.List.foldLeft(List.scala:89)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1(RuleExecutor.scala:213)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1$adapted(RuleExecutor.scala:205)
	at scala.collection.immutable.List.foreach(List.scala:392)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:205)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.org$apache$spark$sql$catalyst$analysis$Analyzer$$executeSameContext(Analyzer.scala:196)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:190)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:155)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$executeAndTrack$1(RuleExecutor.scala:183)
	at org.apache.spark.sql.catalyst.QueryPlanningTracker$.withTracker(QueryPlanningTracker.scala:88)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.executeAndTrack(RuleExecutor.scala:183)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.$anonfun$executeAndCheck$1(Analyzer.scala:174)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.markInAnalyzer(AnalysisHelper.scala:228)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.executeAndCheck(Analyzer.scala:173)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$analyzed$1(QueryExecution.scala:73)
	at org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:111)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:143)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:772)
	at org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:143)
	at org.apache.spark.sql.execution.QueryExecution.analyzed$lzycompute(QueryExecution.scala:73)
	at org.apache.spark.sql.execution.QueryExecution.analyzed(QueryExecution.scala:71)
	at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:63)
	at org.apache.spark.sql.Dataset$.$anonfun$ofRows$2(Dataset.scala:98)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:772)
	at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:96)
	at org.apache.spark.sql.SparkSession.$anonfun$sql$1(SparkSession.scala:615)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:772)
	at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:610)
	at com.cncbi.sink.HiveSink.SinkToHive(HiveSink.java:90)
	at com.cncbi.sink.HiveSink.main(HiveSink.java:168)
22/05/31 18:33:29 INFO SparkContext: Invoking stop() from shutdown hook
22/05/31 18:33:29 INFO SparkUI: Stopped Spark web UI at http://DESKTOP-2JV12RE:4040
22/05/31 18:33:29 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
22/05/31 18:33:29 INFO MemoryStore: MemoryStore cleared
22/05/31 18:33:29 INFO BlockManager: BlockManager stopped
22/05/31 18:33:29 INFO BlockManagerMaster: BlockManagerMaster stopped
22/05/31 18:33:29 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
22/05/31 18:33:29 INFO SparkContext: Successfully stopped SparkContext
22/05/31 18:33:29 INFO ShutdownHookManager: Shutdown hook called

JIA绅士-
关注
SparkSQL使用MySQL中的数据进行写操作时出现的错误：无法解析 org.apache.spark.sql.AnalysisException
CqcVue的博客
10-16 1339
在使用SparkSQL时，当尝试使用MySQL中的数据进行写操作时，可能会遇到 org.apache.spark.sql.AnalysisException 无法解析的错误。在使用SparkSQL连接MySQL之前，首先确保已正确配置数据库连接参数，包括主机名、端口、用户名和密码等。当写入数据时，SparkSQL会根据表的定义和给定的数据进行类型匹配。请仔细检查在写操作中使用的表名和列名的拼写是否正确。请根据实际情况修改上述代码中的连接参数、数据路径、表名等信息，并确保已正确配置MySQL数据库。
一些笔者原创或者搜集的 ABAP 小工具集合（一），持续更新中！！
最新发布
2007 年 ~ 2025 年，深耕 SAP 技术 18 年
10-15 1643
每个报表短小精悍，拷贝到系统激活即可运行。不少报表脑洞大开。
Error in query: DELETE is only supported with v2 tables.
青春不流名
11-28 1169
Error in query: DELETE is only supported with v2 tables.
Hive修改表名，列名，列注释，表注释，增加列，调整列顺序，属性名等操作
热门推荐
helloxiaozhe的博客
06-20 15万+
Alter Table 语句它是在Hive中用来修改的表。语法声明接受任意属性，我们希望在一个表中修改以下语法。ALTER TABLE name RENAME TO new_name ALTER TABLE name ADD COLUMNS (col_spec[, col_spec ...]) ALTER TABLE name DROP [COLUMN] column_name ALTER TAB...
ALTER TABLE RENAME COLUMN is not supported in DB2 V9.1 or later version.
04-08 1672
今天居然发现了DB2 资料的错误。在DB2 redbook上，有如下表述： ALTER TABLE table-name (1) (2) (3)ADD column-definitionunique-constraintrefe...
hive alter table (删除某一列)语句
zhoujj303030的专栏
03-13 3万+
HIVE alter table 语句结构： CREATE TABLE test ( creatingTs BIGINT, a STRING, b BIGINT, c STRING, d STRING, e BIGINT, f BIGINT ); 如果需要删除 column f 列，可以使用以下语句： ALTER TABLE test REPLACE COLU
Replace columns is not supported for table，SerDe may be incompatible.
帅成一匹马
09-26 1739
ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Replace columns is not supported for table hw_dwsdb.dws_student_classroom_homework_statistics. SerDe may be incompatible. INFO : Completed executing command(queryI.
Hudi Spark SQL源码学习总结-Create Table
主要分享大数据相关的知识，如Spark、Hudi
07-22 1842
简要总结HudiSparkSql源码执行逻辑，从建表开始。其实从去年开始接触Hudi的时候就研究学习了HudiSparkSQL的部分源码，并贡献了几个PR，但是完整的逻辑有些地方还没有完全梳理清楚，所以现在想要从头开始学习，搞懂一些知识难点，这样以后看相关源码的时候就不会导致因为一些关键点不懂影响进度。由于本人能力和精力有限，本文只讲解自己觉得比较关键的点，主要目的是梳理整个流程。搞懂了SparkSQL默认的sqlParser为,那么Hudi是一样的吗？那我们就需要看一下开始的这里的f为为。...
大数据笔记
qq_40220816的博客
05-09 1840
hadoop 生态圈： HDFS 分布式文件储存系统 MapReduce 分布式离线计算引擎 Yarn 资源调用 Zookeeper 分布式协调服务 Hive 数据仓库/数据分析 Flume 数据采集 Spoop 数据迁移 ...
Oracle Applications Multiple Organizations Access Control for Custom Code
淡
11-06 5955
文档 ID 420787.1 White Paper Oracle Applications Multiple Organizations Access Control for Custom Code Checked for relevance on 12-JAN-2011 See Change Record This document discusses how to
一个读取图片的代码
chao
04-24 4137
摘自 https://github.com/nothings/stb 单头文件 不用添加多余依赖 比较方便使用 /* stb_image - v2.12 - public domain image loader - http://nothings.org/stb_image.h no warranty implied;...
表的改名和删表
cchenxudong的博客
03-29 1430
一.修改表 (1)修改表名 alter table 原表名 rename to 修改名; 二.删除表 drop table 表名;
hive 表中常用的 增加/修改/替换列操作
zkyxgs518的博客
12-26 5354
1)语法 更新列 ALTER TABLE table_name CHANGE [COLUMN] col_old_name col_new_name column_type [COMMENT col_comment] [FIRST|AFTER column_name] 增加和替换列 ALTER TABLE table_name ADD|REPLACE COLUMNS (col_name da...
hive sql alter table 修改表操作小记
qq_41018861的博客
01-06 4533
ALTER TABLE仅仅会修改表的元数据，但是不会对表数据本身作任何修改 有全量表如下： create external table test.class_info( class string, student array<string>, user_info map<string, int>, position struct<province:string, city:string, district:string> ) row format delimi.
hive无法rename表名
分布式应用与服务器架构专栏
09-25 9142
最近在做表名重命名的时候，出现了以下问题，运行情况如下：   hive>     >     >     > alter table test rename to test2; Invalid alter operation: table new location hdfs://master:8020/user/hive/warehouse/test_db.db/test2 is
关于2表删除的问题
三十七计
03-21 471
问题：表1 aa bb cc AA 1 afdf AA 2 dfa AA 3 efafe BB 2 dfa CC 3 vagd CC 4 rgdfad 表2 aa bb AA 2 CC 4 aa,bb为主键，当表2出现时，删除表1的相应行，操作后表1为 aa bb cc AA 1 afdf AA 3 efafe BB 2 dfa CC 3 vagd  create table #tab1(
Hive如何删除、添加、修改表中的字段
别人笑我太疯癫，我笑他人看不穿。
04-13 2万+
1、添加字段： alter table table_name add columns (column_1 string,column_2 string) 添加之后字段由于hive底层是文件和系列化的设计因此查数据会发现新增的列在所有已有列的后面 2、修改字段 alter table table_name change 已有列 修改名称 类型 comment ''; 3、删除列 Hive不能直接删除列，不然底层系列化就乱了，我们可以通过replace来替换字段，达到同样的效果 alter table ta
HIVE 修改表
不言尘世
01-02 316
重命名 语法: alter table 表名 rename to 新表名; 添加字段: alter table 表名 add columns ( 字段名1 数据类型1 ，… ); 修改字段 替换所有字段 alter table 表名 replace columns ( 字段名1 数据类型1 ，… ); 添加表的分区 本质是在hdfs上添加一个新的分区子目录 a...
hive1.2.2删除table报错
Andeve的博客
07-04 669
启动Hadoop-2.8.3启动hiveserver2启动beeline !connect jdbc:hive2://localhost:10000/defaultusername root password rootdrop table ivivtes;异常信息:MetaException(message:For direct MetaStore DB connections, we don...
TypeError: Indexing a Series with DataFrame is not supported, use the appropriate DataFrame column
03-31
This error occurs when you try to index a pandas Series using a pandas DataFrame. For example, suppose you have a DataFrame `df` with columns 'A' and 'B', and you want to access the values in column 'A' using the DataFrame: ``` df = pd.DataFrame({'A': [1, 2, 3], 'B': [4, 5, 6]}) df['A'][0] # This works ``` However, if you try to access the values in column 'A' using a DataFrame slice, you will get the "Indexing a Series with DataFrame is not supported" error: ``` df[['A']][0] # This raises an error ``` To fix this error, you can either use the Series index to access a specific value, or select the column directly as a DataFrame: ``` df['A'].iloc[0] # Use Series index to access a specific value df[['A']].iloc[0] # Select column as a DataFrame ```
评论 4
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值