flink开发过程中遇到的问题

最新推荐文章于 2025-01-17 07:45:00 发布

原创

最新推荐文章于 2025-01-17 07:45:00 发布 · 3.9k 阅读

3 ·

CC 4.0 BY-SA版权

文章标签：

#flink #大数据 #常见 #bug

本文解决Flink部署至YARN集群时的类转换异常、水印异常、Kafka连接异常等问题，涉及Hadoop、Scala版本冲突、水印设置、Kafka兼容性等关键信息。

文章目录

类转换异常
local class incompatible
ClassCastException
使用kafka异常
水印异常
No ExecutorFactory found to execute the application
Deployment took more than 60 seconds

类转换异常

cannot be cast to com.google.protobuf.Message


Caused by: java.lang.ClassCastException: org.apache.hadoop.yarn.proto.YarnServiceProtos$RegisterApplicationMasterRequestProto cannot be cast to com.google.protobuf.Message
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:227)
	at com.sun.proxy.$Proxy14.registerApplicationMaster(Unknown Source)
	at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationMasterProtocolPBClientImpl.registerApplicationMaster(ApplicationMasterProtocolPBClientImpl.java:106)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect