Storm初始化时抛出NotSerializableException

最新推荐文章于 2024-08-27 22:04:21 发布

define_us

最新推荐文章于 2024-08-27 22:04:21 发布

阅读量867

点赞数

CC 4.0 BY-SA版权

分类专栏：故障排查

本文链接：https://blog.youkuaiyun.com/define_us/article/details/82216499

故障排查专栏收录该内容

10 篇文章

订阅专栏

博客指出启动topo时抛出异常，在storm、bolt和spout中不能含非静态且对象创建时初始化的字段。给出解决方案，bolt在pepare方法中初始化，spout可重构或冒险序列化，并提出实行序列化有何危险的疑问。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

启动topo抛出如下异常：

Exception in thread "main" java.lang.IllegalStateException: Spout 'DetrUpdateEvent' contains a non-serializable field of type com.gdl.trolley.stormclient.TrolleySpout$StormMessageListner, which was instantiated prior to topology creation. com.gdl.trolley.stormclient.TrolleySpout$StormMessageListner should be instantiated within the prepare method of 'DetrUpdateEvent at the earliest.
    at backtype.storm.topology.TopologyBuilder.createTopology(TopologyBuilder.java:138)
    at com.gdl.gdl.gdlpsr.processor.detrupdate.DetrupdateTopology.main(DetrupdateTopology.java:42)
Caused by: java.lang.RuntimeException: java.io.NotSerializableException: com.gdl.trolley.stormclient.TrolleySpout$StormMessageListner
    at backtype.storm.utils.Utils.javaSerialize(Utils.java:196)
    at backtype.storm.topology.TopologyBuilder.createTopology(TopologyBuilder.java:135)
    ... 1 more
Caused by: java.io.NotSerializableException: com.gdl.trolley.stormclient.TrolleySpout$StormMessageListner
    at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
    at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
    at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
    at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
    at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
    at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
    at backtype.storm.utils.Utils.javaSerialize(Utils.java:192)
    ... 2 more

在storm和bolt和spout中不能包含非静态且在对象创建时初始化的字段。如下面代码时不被允许的。

public class TrolleySpout extends KafkaSpout {
    private static KafkaSpoutConfig.Builder builder = KafkaSpoutConfig.builderStringBytes(UpdateConfig.getInstance().getBrokerHosts()
            , UpdateConfig.getInstance().getAppid());
    private StormMessageListner stormMessageListner = new StormMessageListner();

解决方案：对于bolt，在pepare方法中完成初始化。对于spout，要么重构，要么冒险进行序列化。
实行序列化有什么危险呢？