一、filebeat连kafka报错:circuit breaker is open
现象:疯狂重复下列打印
2021-06-17T09:10:56.052Z INFO [publisher] pipeline/retry.go:219 retryer: send unwait signal to consumer
2021-06-17T09:10:56.052Z INFO [publisher] pipeline/retry.go:223 done
在filebeat的yml文件中添加下列选项打开调试信息:
logging.level: debug
重启进程,就会获得更多的打印信息:
2021-06-17T09:10:58.312Z DEBUG [kafka] kafka/client.go:292 Kafka publish failed with: circuit breaker is open
2021-06-17T09:10:58.312Z INFO [publisher] pipeline/retry.go:219 retryer: send unwait signal to consumer
2021-06-17T09:10:58.312Z INFO [publisher] pipeline/retry.go:223 done
[kafka] kafka/client.go:292 Kafka publish failed with: circuit breaker is open 的原因google了下很多,但都没有找到我的这种情况。最后发现原因是 filebeat 推送的 topic 在 kafka 上不存在。修改topic后就正常了。
二、netstat 查看系统中的连接
netstat -nat
# -n: Show numerical addresses instead of trying to determine symbolic host, port or user names.
# -a: 不管已连接还是未连接都显示。Show both listening and non-listening (for TCP this means established connections) sockets.
# -t: 只看tcp连接。不加这个选项会会同时显示 unix udp 等类型。
https://blog.51cto.com/sadoc/1932028