Flume Exception in thread “SinkRunner-PollingRunner-DefaultSinkProcessor“ java.lang.NoSuchMethodErro

最新推荐文章于 2024-10-26 13:26:39 发布
原创 最新推荐文章于 2024-10-26 13:26:39 发布 · 1.3k 阅读 · 2 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
文章标签：

#hadoop #flume #大数据

这篇博客讲述了在使用Flume过程中遇到的Java NoSuchMethodError异常，该异常由于Hadoop版本（3.1.3）与Flume中依赖的Guava库版本不兼容导致。解决方案是删除Flume的lib目录下的旧版Guava jar包（guava-11.0.2.jar），以消除版本冲突。 
Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338)
        at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1679)
        at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:206)
        at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:504)
        at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:406)
        at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
        at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
        at java.lang.Thread.run(Thread.java:748)

解决办法：因为Hadoop是3.1.3版本的，所以这里要在Flume的lib文件夹下将rm -rf guava-11.0.2.jar删除

csding11
关注
【CentOS】flume 报错：“SinkRunner-PollingRunner-DefaultSinkProcessor“
懂得一千零一种,赋予你失败的方法！
02-20 2478
在执行flume任务的时候报了错，如下: Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.ExceptionInInitializerError at org.apache.hadoop.tracing.SpanReceiverHost.get(SpanReceiverHost.java:79) at org.apache.hadoop.hdfs.DFSClient.<init>(D.
flume 时报 NoSuchMethodError: com.google.common.base.Preconditions.checkArgument
yang灬仔
07-07 1429
问题 服务器上环境hadoop 3.0、flume 1.9 运行flume报错： 2020-07-07 16:39:56,359 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:459)] process failed java.lang.NoSuchMethodError: com.google.c.
解决Exception in thread “SinkRunner-PollingRunner-DefaultSinkProcessor“ java.lang.NoSuchMethodError: c
weixin_47303949的博客
08-14 4383
执行flume任务时报错： Exception in thread “SinkRunner-PollingRunner-DefaultSinkProcessor” java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V 解决办法： 将flume的lib下的低版本guava-11.0.2.jar换成Hadoop下的高版本gua
Exception in thread “SinkRunner-PollingRunner-DefaultSinkProcessor“ java.lan
qq_43668173的博客
04-07 845
添加链接描述
报错Exception in thread “SinkRunner-PollingRunner-DefaultSinkProcessor“ java.lang.NoSuchMethodError:
2301_78459756的博客
10-26 594
删除flume自带guava的jar包即可。
apache-flume-1.9.0-bin.tar.gz
07-27
Apache Flume是一个分布式的、可靠且可用的服务，用于有效地从多个源高效地收集、聚合和移动大量日志数据。它的设计目标是将数据从各种不同的源收集起来，并将它们安全地传输到集中式数据存储系统中。Flume具有简单...
2025-10-24 21:24:46,662 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:459)] process failed java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357) at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338) at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1679) at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:221) at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:572) at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412) at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67) at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145) at java.lang.Thread.run(Thread.java:750) Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357) at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338) at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1679) at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:221) at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:572) at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412) at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67) at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145) at java.lang.Thread.run(Thread.java:750)2025-10-24 21:24:46,662 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:459)] process failed java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357) at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338) at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1679) at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:221) at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:572) at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412) at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67) at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145) at java.lang.Thread.run(Thread.java:750) Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357) at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338) at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1679) at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:221) at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:572) at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412) at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67) at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145) at java.lang.Thread.run(Thread.java:750)
最新发布
10-26
mv /opt/flume/apache-flume-1.9.0-bin/lib/guava-11.0.2.jar /opt/flume/apache-flume-1.9.0-bin/lib/guava-11.0.2.jar.bak ``` 2. 复制Hadoop的guava到Flume的lib目录： ``` cp /opt/hadoop/hadoop-3.2.1/...
Flume采集MySQL数据必须的jar包，包含flume-ng-sql-source-1.5.2.jar和mysql-connector-java.jar，免去了自己打包的麻烦
08-28
Flume采集MySQL数据必须的jar包，包含flume-ng-sql-source-1.5.2.jar和mysql-connector-java.jar，免去了自己打包的麻烦
2025-10-06 05:43:27,152 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 32 2025-10-06 05:32 } 2025-10-06 05:43:27,152 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 32 2025-10-06 05:32 } 2025-10-06 05:43:27,152 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 32 2025-10-06 05:32 } 2025-10-06 05:43:27,152 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 33 2025-10-06 05:33 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 33 2025-10-06 05:33 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 33 2025-10-06 05:33 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 33 2025-10-06 05:33 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 33 2025-10-06 05:33 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 33 2025-10-06 05:33 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 33 2025-10-06 05:33 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 34 2025-10-06 05:34 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 34 2025-10-06 05:34 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 34 2025-10-06 05:34 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 34 2025-10-06 05:34 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 34 2025-10-06 05:34 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 34 2025-10-06 05:34 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 34 2025-10-06 05:34 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 35 2025-10-06 05:35 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 35 2025-10-06 05:35 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 35 2025-10-06 05:35 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 35 2025-10-06 05:35 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 35 2025-10-06 05:35 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 35 2025-10-06 05:35 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 35 2025-10-06 05:35 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 36 2025-10-06 05:36 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 36 2025-10-06 05:36 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 36 2025-10-06 05:36 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 36 2025-10-06 05:36 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 36 2025-10-06 05:36 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 36 2025-10-06 05:36 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 36 2025-10-06 05:36 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 37 2025-10-06 05:37 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 37 2025-10-06 05:37 } 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 37 2025-10-06 05:37 } 2025-10-06 05:43:27,153 (pool-3-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:497)] Preparing to move file /var/log/hdfstest/hadoop-root-namenode-master.log to /var/log/hdfstest/hadoop-root-namenode-master.log.COMPLETED 2025-10-06 05:43:27,153 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 37 2025-10-06 05:37 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 37 2025-10-06 05:37 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 37 2025-10-06 05:37 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 37 2025-10-06 05:37 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 38 2025-10-06 05:38 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 38 2025-10-06 05:38 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 38 2025-10-06 05:38 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 38 2025-10-06 05:38 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 38 2025-10-06 05:38 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 38 2025-10-06 05:38 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 38 2025-10-06 05:38 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 39 2025-10-06 05:39 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 39 2025-10-06 05:39 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 39 2025-10-06 05:39 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 39 2025-10-06 05:39 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 39 2025-10-06 05:39 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 39 2025-10-06 05:39 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 33 39 2025-10-06 05:39 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 30 2025-10-06 05:40 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 30 2025-10-06 05:40 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 30 2025-10-06 05:40 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 30 2025-10-06 05:40 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 30 2025-10-06 05:40 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 30 2025-10-06 05:40 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 30 2025-10-06 05:40 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 31 2025-10-06 05:41 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 31 2025-10-06 05:41 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 31 2025-10-06 05:41 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 31 2025-10-06 05:41 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 31 2025-10-06 05:41 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 31 2025-10-06 05:41 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 31 2025-10-06 05:41 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 32 2025-10-06 05:42 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 32 2025-10-06 05:42 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 32 2025-10-06 05:42 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 32 2025-10-06 05:42 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 32 2025-10-06 05:42 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 32 2025-10-06 05:42 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 32 2025-10-06 05:42 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 33 2025-10-06 05:43 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 33 2025-10-06 05:43 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 33 2025-10-06 05:43 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 33 2025-10-06 05:43 } 2025-10-06 05:43:27,154 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 33 2025-10-06 05:43 } 2025-10-06 05:43:27,155 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 33 2025-10-06 05:43 } 2025-10-06 05:43:27,155 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 32 30 32 35 2D 31 30 2D 30 36 20 30 35 3A 34 33 2025-10-06 05:43 } 2025-10-06 05:51:13,273 (pool-3-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents(ReliableSpoolingFileEventReader.java:384)] Last read took us just up to a file boundary. Rolling to the next file, if there is one. 2025-10-06 05:51:13,273 (pool-3-thread-1) [INFO - org.apache.flume.client.avro.ReliableSpoolingFileEventReader.rollCurrentFile(ReliableSpoolingFileEventReader.java:497)] Preparing to move file /var/log/hdfstest/hadoop-root-resourcemanager-master.out.4 to /var/log/hdfstest/hadoop-root-resourcemanager-master.out.4.COMPLETED 2025-10-06 05:51:17,981 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 63 6F 72 65 20 66 69 6C 65 20 73 69 7A 65 20 20 core file size }
10-15
我们正在分析Flume日志以解决HDFS中/tmp/flume目录下文件不可见的问题。虽然用户没有提供具体的日志内容，但我们可以根据常见的Flume日志模式进行问题分类和解决方案推导。 根据之前的问题描述，文件写入正常但...
FLUME Exception in thread “SinkRunner-PollingRunner-DefaultSinkProcessor“ java.lang.NoSuchMethodErro
80后大叔爱学习
03-17 611
更换与hadoop的版本一直，我是hadoop3.1.3
Flume传输Hadoop日志报错Exception in thread “SinkRunner-PollingRunner-DefaultSinkProcessor“ java.lang.NoSuc
qq_74407830的博客
04-26 860
在测试Flume传输Hadoop日志时报错)V和异常Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;)V。
flume报错：ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.hdfs.HDFSEventS
bella1213811111的博客
05-26 5674
flume传输文件到hdfs时报错： ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.hdfs.HDFSEventSink.process:459) - process failed java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/
Flume【问题记录 02】【java.lang.NoSuchMethodError:com.google.common.base.Preconditions.checkArgument】【避坑指南】
シ風
08-24 946
问题 使用hdfs作为sinks时报错信息如下： 2021-08-24 15:10:11,638 INFO avro.ReliableSpoolingFileEventReader: Preparing to move file /tmp/logs/log.txt to /tmp/logs/log.txt.COMPLETED 2021-08-24 15:10:15,199 INFO hdfs.HDFSDataStream: Serializer = TEXT, UseRawLocalFileSystem
flume遇到的坑
小强签名设计 的博客
03-16 704
内存溢出 报错： Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.OutOfMemoryError: GC overhead limit exceeded at java.util.Arrays.copyOfRange(Arrays.java:3664) at java.lang.Str...
flume接收kafka消息过多导致的GC错误的解决办法
sxj的专栏
04-22 2866
当flume接收kafka消息过多会导致如下错误： Exception in thread "PollableSourceRunner-KafkaSource-s1" java.lang.OutOfMemoryError: GC overhead limit exceeded at java.lang.StringCoding$StringDecoder.decode(StringCodin...
Flume启动报错，guava.java包冲突
weixin_43441221的博客
02-11 875
Flume启动时报错如下： (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:459)] process failed java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/Stri
flume1.8兼容hadoop3 bug
qq_41018861的博客
05-05 342
下的guava-xx.jar，将其升级到两者中的较高版本。jar包这里笔者就不在给出了，大家可以直接去官网下载。下的guava-xx.jar和hadoop 下。
大数据技术-Flume学习笔记
xiaoyixiao_的博客
03-01 2029
大数据技术-Flume学习笔记
flume编译源码后启动报错
dymkkj的专栏
07-30 609
19/07/30 11:13:22 INFO util.RestClientHelper: es_username: null, es_password: null, es_hostName: 172.16.10.10,172.16.10.11, es_port: 9200 Exception in thread "SinkRunner-PollingRunner-DefaultSink...
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
表情包 代码片
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值