spark2.x不支持phoenix4.8 悲剧

当前发布的Phoenix版本暂不支持Spark2.x,预计在即将到来的4.10.0版本中将得到解决。若想提前使用,可自行编译。文章详细描述了尝试在Spark2.1中写入DataFrame到Phoenix时遇到的错误及解决方案。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

Spark 2.x isn’t currently supported in a released Phoenix version, but is
slated for the upcoming 4.10.0 release.

If you’d like to compile your own version in the meantime, you can find the
ticket/patch here:
https://issues.apache.org/jira/browse/PHOENIX-3333

or:
https://github.com/apache/phoenix/commit/a0e5efcec5a1a732b2dce9794251242c3d66eea6

Josh

On Tue, Jan 10, 2017 at 10:27 PM, lk_phoenix lk_phoenix@163.com wrote:

hi,all:
I try to write a dataframe to phoenix with spark2.1:
df.write.format(“org.apache.phoenix.spark”).mode(SaveMode.Overwrite).options(Map(“table”
-> “biz”,“zkUrl” -> “slave1:2181,slave2:2181”)).save()
but it’s not work,I got error:
java.lang.AbstractMethodError: org.apache.phoenix.spark.
DefaultSource.createRelation(Lorg/apache/spark/sql/
SQLContext;Lorg/apache/spark/sql/SaveMode;Lscala/
collection/immutable/Map;Lorg/apache/spark/sql/Dataset;)
Lorg/apache/spark/sql/sources/BaseRelation;
at org.apache.spark.sql.execution.datasources.
DataSource.write(DataSource.scala:426)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:215)
… 60 elided

评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值