kafka Stream报错

最新推荐文章于 2024-08-16 00:25:52 发布

原创最新推荐文章于 2024-08-16 00:25:52 发布 · 1.2k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#kafka #java #spring

在Windows 10环境下，Kafka Streams应用遇到异常，导致所有流线程死亡。异常源于RocksDB的初始化错误，具体为UnsupportedOperationException，无法确定JNI库名称。解决方案可参考相关GitHub问题#91。

2022-07-25 13:29:31.112 ERROR 19712 --- [-StreamThread-1] o.a.k.s.KafkaStreams : stream-client [kafka-demo_stream_cid] All stream threads have died. The instance will be in error state and should be closed.
2022-07-25 13:29:31.112 INFO 19712 --- [-StreamThread-1] o.a.k.s.p.i.StreamThread : stream-thread [kafka-demo_stream_cid-StreamThread-1] Shutdown complete
Exception in thread "kafka-demo_stream_cid-StreamThread-1" java.lang.ExceptionInInitializerError
   at org.rocksdb.RocksDB.loadLibrary(RocksDB.java:64)
   at org.rocksdb.RocksDB.<clinit>(RocksDB.java:35)
   at org.rocksdb.DBOptions.<clinit>(DBOptions.java:21)
   at org.apache.kafka.streams.state.internals.RocksDBStore.openDB(RocksDBStore.java:133)
   at org.apache.kafka.streams.state.internals.TimestampedSegment.openDB(TimestampedSegment.java:49)
   at org.apache.kafka.streams.state.internals.TimestampedSegments.getOrCreateSegment(TimestampedSegments.java:50)
   at org.apache.kafka.streams.state.internals.TimestampedSegments.getOrCreateSegment(TimestampedSegments.java:25)
   at org.apache.kafka.streams.state.internals.AbstractSegments.getOrCreateSegmentIfLive(AbstractSegments.java:84)
   at org.apache.kafka.streams.state.internals.AbstractRocksDBSegmentedBytesStore.put(AbstractRocksDBSegmentedBytesStore.java:147)
   at org.apache.kafka.streams.state.internals.RocksDBWindowStore.put(RocksDBWindowStore.java:62)
   at org.apache.kafka.streams.state.internals.RocksDBWindowStore.put(RocksDBWindowStore.java:27)
   at org.apache.kafka.streams.state.internals.ChangeLoggingWindowBytesStore.put(ChangeLoggingWindowBytesStore.java:111)
   at org.apache.kafka.streams.state.internals.ChangeLoggingWindowBytesStore.put(ChangeLoggingWindowBytesStore.java:34)
   at org.apache.kafka.streams.state.internals.CachingWindowStore.putAndMaybeForward(CachingWindowStore.java:106)
   at org.apache.kafka.streams.state.internals.CachingWindowStore.lambda$initInternal$0(CachingWindowStore.java:86)
   at org.apache.kafka.streams.state.internals.NamedCache.flush(NamedCache.java:151)
   at org.apache.kafka.streams.state.internals.NamedCache.flush(NamedCache.java:109)
   at org.apache.kafka.streams.state.internals.ThreadCache.flush(ThreadCache.java:124)
   at org.apache.kafka.streams.state.internals.CachingWindowStore.flush(CachingWindowStore.java:291)
   at org.apache.kafka.streams.state.internals.WrappedStateStore.flush(WrappedStateStore.java:84)
   at org.apache.kafka.streams.state.internals.MeteredWindowStore.lambda$flush$4(MeteredWindowStore.java:200)
   at org.apache.kafka.streams.processor.internals.metrics.StreamsMetricsImpl.maybeMeasureLatency(StreamsMetricsImpl.java:806)
   at org.apache.kafka.streams.state.internals.MeteredWindowStore.flush(MeteredWindowStore.java:200)
   at org.apache.kafka.streams.processor.internals.ProcessorStateManager.flush(ProcessorStateManager.java:285)
   at org.apache.kafka.streams.processor.internals.AbstractTask.flushState(AbstractTask.java:177)
   at org.apache.kafka.streams.processor.internals.StreamTask.flushState(StreamTask.java:554)
   at org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:490)
   at org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:478)
   at org.apache.kafka.streams.processor.internals.AssignedTasks.commit(AssignedTasks.java:226)
   at org.apache.kafka.streams.processor.internals.TaskManager.commitAll(TaskManager.java:543)
   at org.apache.kafka.streams.processor.internals.StreamThread.maybeCommit(StreamThread.java:977)
   at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:823)
   at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:697)
   at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:670)
Caused by: java.lang.UnsupportedOperationException: Cannot determine JNI library name for ARCH='x86' OS='windows 10' name='rocksdb'
   at org.rocksdb.util.Environment.getJniLibraryName(Environment.java:84)
   at org.rocksdb.NativeLibraryLoader.<clinit>(NativeLibraryLoader.java:19)
   ... 34 more

解决方案参考：Exception in thread "kafka-music-charts-53af5ee5-082b-419b-93fd-5efbc5c23e29-StreamThread-1" java.lang.ExceptionInInitializerError at org.rocksdb.RocksDB.loadLibrary(RocksDB.java:64). · Issue #91 · confluentinc/kafka-streams-examples · GitHub