pymongo 出现pymongo.errors.AutoReconnect: connection closed

最新推荐文章于 2024-06-04 11:15:32 发布

原创最新推荐文章于 2024-06-04 11:15:32 发布 · 4.4k 阅读

0 ·

CC 4.0 BY-SA版权

mongodb 专栏收录该内容

7 篇文章

订阅专栏

本文介绍了一个常见的pymongo错误'AutoReconnect:connection closed'的原因及解决方案。错误发生在遍历MongoDB集合时，通过使用带有no_cursor_timeout参数的find方法，并在操作完成后关闭游标，可以有效避免该问题。

pymongo.errors.AutoReconnect: connection closed

原因是：

for col in sinaDetailCollection.find({}):
    ....

更改为：

curors = sinaDetailCollection.find({},no_cursor_timeout=True)
for col in curors :
    ..........
curors.close()

确定要放弃本次机会？

福利倒计时

: :

立减 ¥

普通VIP年卡可用

立即使用

正在努力学习的zz

关注关注

1
点赞
踩
0

收藏

觉得还不错? 一键收藏
0
评论
分享

复制链接

分享到 QQ

分享到新浪微博

扫一扫
举报

举报

专栏目录

【mongodb】【Python】AutoReconnect: connection closed && directory-sync: Too many open files

「熊猫系列项目」ing

05-05

1451

OverviewTest CaseIssue: Too many open filesSolution - n/a Mongo DB issue: directory-sync: Too many open files Test Case In [20]: for i in range(100000): ...: coll_name = prefix + str(i) ...

MongoDB相关（不定期更新）

frnk

06-21

458

汇总了一下之前遇到过的问题，有空会再更新 1.超时 2.count()函数报warning 3.去重相同字段 4.allowDiskUse:true 5.

参与评论您还未登录，请先登录后发表或查看评论

关于scrapy mongodb pymongo.errors.AutoReconnect: connection closed

a5601564的博客

10-15

627

Traceback (most recent call last): File "C:\Users\li.pinliang\anaconda3\lib\site-packages\scrapy\utils\defer.py", line 161, in maybeDeferred_coro result = f(*args, **kw) File "C:\Users\li.pinliang\anaconda3\lib\site-packages\pydispatch\robustappl..

Pymong pymongo.errors.AutoReconnect: 127.0.0.1:27017 [已解决]

从零开始学习python --zeropython

10-17

1291

最近做个Spark 的项目，发现如果插入3000多天数据竟然报错； Python Pymong <span class="wp_keywordlink_affiliate"><a href="https://www.168seo.cn/ta...

Python pymongo模块常用操作分析

09-20

如果使用pymongo.Connection()提示没有该包，可能需要更新pymongo版本或者检查环境配置。在进行数据库操作时，需要注意操作的原子性和事务的一致性，尤其在多用户环境下，对同一数据进行操作时可能会出现冲突。...

D:\Users\lenovo\Desktop\PythonProject111\.venv\Scripts\python.exe D:\Users\lenovo\Desktop\PythonProject111\project11\test3.py Traceback (most recent call last): File "D:\Users\lenovo\Desktop\PythonProject111\project11\test3.py", line 50, in <module> pipeline = DataPipeline("mongodb://localhost:27017/", "spider_db") File "D:\Users\lenovo\Desktop\PythonProject111\project11\test3.py", line 11, in __init__ self.collection.create_index("unique_key", unique=True) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\synchronous\collection.py", line 2378, in create_index return (self._create_indexes([index], session, **cmd_options))[0] ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\_csot.py", line 125, in csot_wrapper return func(self, *args, **kwargs) File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\synchronous\collection.py", line 2231, in _create_indexes with self._conn_for_writes(session, operation=_Op.CREATE_INDEXES) as conn: ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\synchronous\collection.py", line 578, in _conn_for_writes return self._database.client._conn_for_writes(session, operation) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\synchronous\mongo_client.py", line 1844, in _conn_for_writes server = self._select_server(writable_server_selector, session, operation) File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\synchronous\mongo_client.py", line 1827, in _select_server server = topology.select_server( server_selector, ...<2 lines>... operation_id=operation_id, ) File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\synchronous\topology.py", line 409, in select_server server = self._select_server( selector, ...<4 lines>... operation_id=operation_id, ) File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\synchronous\topology.py", line 387, in _select_server servers = self.select_servers( selector, operation, server_selection_timeout, address, operation_id ) File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\synchronous\topology.py", line 294, in select_servers server_descriptions = self._select_servers_loop( selector, server_timeout, operation, operation_id, address ) File "D:\Users\lenovo\Desktop\PythonProject111\.venv\Lib\site-packages\pymongo\synchronous\topology.py", line 344, in _select_servers_loop raise ServerSelectionTimeoutError( f"{self._error_message(selector)}, Timeout: {timeout}s, Topology Description: {self.description!r}" ) pymongo.errors.ServerSelectionTimeoutError: localhost:27017: [WinError 10061] 由于目标计算机积极拒绝，无法连接。 (configured timeouts: socketTimeoutMS: 20000.0ms, connectTimeoutMS: 20000.0ms), Timeout: 30s, Topology Description: <TopologyDescription id: 6899ecf882761f7f218a1c3f, topology_type: Unknown, servers: [<ServerDescription ('localhost', 27017) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27017: [WinError 10061] 由于目标计算机积极拒绝，无法连接。 (configured timeouts: socketTimeoutMS: 20000.0ms, connectTimeoutMS: 20000.0ms)')>]> 进程已结束，退出代码为 1

最新发布

08-12

在使用 `pymongo` 连接 MongoDB 时，出现 `pymongo.errors.ServerSelectionTimeoutError` 错误通常表明连接 MongoDB 服务器的过程中出现了网络或配置问题。以下是常见的解决方法： ### 1. 检查 MongoDB 服务器是否...

mongodb踩坑：复制集(尤其是单台服务器多个mongo服务的)服务节点挂载问题

Chenftli的博客

09-04

2868

问题我在一台服务器上下面是报错： pymongo.errors.ServerSelectionTimeoutError: 127.0.0.1:27019: [WinError 10061] 由于目标计算机积极拒绝，无法连接。,127.0.0.1:27018: [WinError 10061] 由于目标计算机积极拒绝，无法连接。, Timeout: 30s, Topology Description: <TopologyDescription id: 5f4de49d2be4dd66f0ebc6b

python 使用retry处理pymongo.errors.AutoReconnect

枪枪枪的博客

11-26

1511

百度搜索后了解到 pymongo有自带的连接池和自动重连机制，但是仍需要捕捉AutoReconnect异常并重新发起请求。 from pymongo.errors import AutoReconnect from retry import retry @retry(AutoReconnect, tries=4, delay=1) def from_database_table_get_data(cursor, sql): record = cursor.find_one(sql) ret

pymongo中AutoReconnect异常的正确避免方式

HelloW先生的博客

11-04

7595

pymongo中AutoReconnect异常的正确避免方式问题来源解决思路解决方案最终方案问题来源在windows系统运行一下代码，会出现问题。非windows系统可以exit了。 import time from pymongo import MongoClient mongodb_setting = dict( host='127.0.0.1', port=27017...

python close用法_pymongo不使用close方法时，内存占用很大，求解

weixin_39707612的博客

12-09

1027

爬虫时，如果不使用pymongo的close方法，python xxx.py内存会一点一点的上涨，最开始900多M，慢慢的就1个多G，快到2G了。但是速度快，在tail -f log的时候，基本看不清输出信息。如果使用了close方法，内存稳定在500M左右，但是读和取数据库速度慢，在tail log的时候，能看到正在保存哪个URL，正在获取哪个URL。请问我该如何解决这个问题呢。#-*-codi...

pymongo 如何处理异常 AutoReconnect ，防止数据丢失

Never的博客

06-11

6316

Retrying Tutorial 在使用pymongo的时候，自带的线程池存在连接失效 raise AutoReconnect("connection closed") 解决方式，加入retry 防止丢失数据 from pymongo.errors import AutoReconnect def retry_if_auto_reconnect_error(exc...

python 连接数据库 ([Errno 111] Connection refused)

weixin_40434614的博客

08-24

6969

python 连接 docker 中的 mysql 数据库问题命令行报错 peewee.OperationalError: (2003, “Can’t connect to MySQL server on ‘172.17.0.2’ ([Errno 111] Connection refused)”) 可能的问题及解决办法 mysql不允许远程连接 ; 允许所有ip连接mysql，为用户名m...

【Python】解决Python报错：OSError: [Errno 111] Connection refused

科技改变人类，技术成就未来

06-04

1777

解决Python报错：OSError: [Errno 111] Connection refused

Python 中 ConnectionRefusedError: [Errno 111] Connection Refused 错误