ReferenceError: weakly-referenced object no longer exists Python kafka

最新推荐文章于 2025-04-21 10:04:56 发布

转载最新推荐文章于 2025-04-21 10:04:56 发布 · 1.1k 阅读

文章标签：

#大数据 #python

本文详细介绍了在使用Python向Kafka推送数据时遇到的ReferenceError异常，该异常通常由弱引用的对象不再存在引起。通过在代码中加入producer.stop()解决了这一问题，确保了Kafka生产者正确关闭，避免了内存泄漏和引用错误。

Python存入kafka报错，ReferenceError: weakly-referenced object no longer exists。

Exception in thread 14: pykafka.OwnedBroker.queue_reader for broker 101:
Traceback (most recent call last):
  File "C:\Python27\lib\threading.py", line 801, in __bootstrap_inner
    self.run()
  File "C:\Python27\lib\threading.py", line 754, in run
    self.__target(*self.__args, **self.__kwargs)
  File "C:\Python27\lib\site-packages\pykafka\producer.py", line 624, in queue_reader
    self.producer._worker_exception = sys.exc_info()
ReferenceError: weakly-referenced object no longer exists

　　解决办法是加入 producer.stop()

完整代码是：

# kafka 连接
KAFKA_IP_PORT = '192.168.1.13:9082'
# KAFKA_IP_PORT = '192.168.0.23:9082'
KAFKA_TOPIC_NAME = 'test-topic'


def kafka_save(data):
    print "获得的信息是：",data

    client = KafkaClient(hosts=KAFKA_IP_PORT)
    producer = client.topics[KAFKA_TOPIC_NAME.encode(encoding="UTF-8")].get_producer()
    data_str = str(data)
    producer.produce(data_str.encode(encoding='UTF-8'))
   producer.stop()
   print "推送到kafka成功"