记录kafka一次故障

关注公众号 `N学无止界` 获取更多

[WARN ] [org.springframework.kafka.KafkaListenerEndpointContainer#2-0-C-1] org.apache.kafka.clients.consumer.internals.ConsumerCoordinator - [Consumer clientId=consumer-1, groupId=xxxx-group] Synchronous auto-commit of offsets {queue-2=OffsetAndMetadata{offset=373051269, metadata=''}} failed: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records.
2022-03-08 11:16:49.835 [INFO ] [org.springframework.kafka.KafkaListenerEndpointContainer#2-0-C-1] org.apache.kafka.clients.consumer.internals.ConsumerCoordinator - [Consumer clientId=consumer-1, groupId=xxxx-group] Revoking previously assigned partitions [queue-2]
2022-03-08 11:16:49.835 [INFO ] [org.springframework.kafka.KafkaListenerEndpointContainer#2-0-C-1] org.apache.kafka.clients.consumer.internals.AbstractCoordinator - [Consumer clientId=consumer-1, groupId=xxxx-group] (Re-)joining group

先记录下日志

2022-11-18 原因分析:

根本原因是 方法体为异步调用工程，数据库操作部分操作时间太长（数据库事务内有个统计任务耗时太长，此处又远程调用其他服务，耗时longlong），导致资源不足，运行缓慢，程序进入假死状态。