ImportError: cannot import name 'log' from 'scrapy'

最新推荐文章于 2025-05-15 17:16:25 发布
原创 最新推荐文章于 2025-05-15 17:16:25 发布 · 3.8k 阅读 · 2 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。

本文档详细解析了从Scrapy旧版本升级到2.1.0版本时，因scrapy.log模块被弃用而可能遇到的问题及解决方案。对于从1.6.0以前版本升级的用户尤其重要，提供了必要的代码调整建议。 
[root@localhost ~]# python3
Python 3.8.2 (default, Apr 20 2020, 10:10:11) 
[GCC 4.8.5 20150623 (Red Hat 4.8.5-39)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import scrapy
>>> 
>>> from scrapy import log
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: cannot import name 'log' from 'scrapy' (/opt/python3/lib/python3.8/site-packages/scrapy/__init__.py)
>>>

scrapy 目前最新的版本是 2.1.0

在使用最新的版本跑以前(1.6.0 以前)的代码可能出现这个问题，

在 1.7.0版本 scrapy.log 已经被弃用

这将对你有帮助 文档

《Python基础教程》内容总览篇（持续更新中）
weixin_43178406的博客
08-26 31万+
大家好，我是爱编程的喵喵。双985硕士毕业，现担任全栈工程师一职，热衷于将数据思维应用到工作与生活中。从事机器学习以及相关的前后端开发工作。曾在阿里云、科大讯飞、CCF等比赛获得多次Top名次。现为优快云博客专家、人工智能领域优质创作者。喜欢通过博客创作的方式对所学的知识进行总结与归纳，不仅形成深入且独到的理解，而且能够帮助新手快速入门。个人精心开设的《Python基础课程》专栏订阅量接近900，帮助不少同学解决了Bug。
ROS2报错：ImportError: cannot import name ‘Log‘ from ‘rosgraph_msgs.msg‘
超爱吃小蛋糕的66的博客
09-13 5548
排查原因后发现命令写错了，ROS1用习惯了，使用的。在使用ros2的bag命令查看数据集信息时报错。
IMPORTERROR: CANNOT IMPORT NAME ‘LOG‘ FROM ‘SCRAPY‘
qq824756152的博客
03-06 1452
在 1.7.0版本 scrapy.log 已经被弃用 Logging — Scrapy 2.6.1 documentation 改为用下面的写法 import logging logging.info("This is a info") logging.warning("This is a warning")
ImportError: cannot import name log
mohuisheng的博客
10-24 7334
问题：方法：
修复ImportError: cannot import name ‘log‘ from ‘torch.distributed.elastic.agent.server.api报错
love530love的博客
05-15 1706
此问题据说会在较新的DeepSpeed版本中被修复。
成功解决ImportError: cannot import name ‘log‘ from ‘torch.distributed.elastic.agent.server.api‘
zik的博客
08-21 8849
欢迎大家关注笔者，你的关注是我持续更博的最大动力。建议将“log”更改为“logger”。微信：suihailiang0816。原创文章，转载告知，盗版必究。wx公众号：仰望星空的小随。
python3 -c "from rosgraph_msgs.msg import Log; print(Log.__doc__)" Traceback (most recent call last): File "<string>", line 1, in <module> ImportError: cannot import name 'Log' from 'rosgraph_msgs.msg' (/opt/ros/humble/local/lib/python3.10/dist-packages/rosgraph_msgs/msg/__init__.py)
09-19
首先，用户查询是关于在Python 3中执行`from rosgraph_msgs.msg import Log`时出现的`ImportError: cannot import name 'Log' from 'rosgraph_msgs.msg'`错误。错误信息表明在导入模块时找不到'Log'这个名字。 从...
C:\Users\Administrator>scrapy startproject NetEase CloudMusic Traceback (most recent call last): File "C:\Program Files\Python\Python3.9.7\lib\runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Program Files\Python\Python3.9.7\lib\runpy.py", line 87, in _run_code exec(code, run_globals) File "C:\Program Files\Python\Python3.9.7\Scripts\scrapy.exe\__main__.py", line 4, in <module> File "C:\Program Files\Python\Python3.9.7\lib\site-packages\scrapy\__init__.py", line 12, in <module> from scrapy.http import FormRequest, Request File "C:\Program Files\Python\Python3.9.7\lib\site-packages\scrapy\http\__init__.py", line 10, in <module> from scrapy.http.request.form import FormRequest File "C:\Program Files\Python\Python3.9.7\lib\site-packages\scrapy\http\request\form.py", line 11, in <module> from lxml.html import FormElement, HtmlElement, HTMLParser, SelectElement File "C:\Program Files\Python\Python3.9.7\lib\site-packages\lxml\html\__init__.py", line 53, in <module> from .. import etree File "src\lxml\etree.pyx", line 74, in init lxml.etree ImportError: cannot import name _elementpath 生成文件成功了吗
06-05
当运行 `scrapy startproject` 命令时，如果遇到类似 `ImportError: cannot import name '_elementpath'` 的错误，这通常是由于依赖库版本不兼容或安装环境配置不当引起的。以下是可能的原因及解决方案： #### 1. *...
PS C:\Users\童琪琪\Desktop\bishe.6\biyesheji.6\movie_analysis_project> scrapy crawl maoyan -s LOG_LEVEL=INFO >> 2025-11-14 19:14:53 [scrapy.utils.log] INFO: Scrapy 2.11.0 started (bot: movie_analysis_project) 2025-11-14 19:14:53 [scrapy.utils.log] INFO: Versions: lxml 5.2.1.0, libxml2 2.13.1, cssselect 1.2.0, parsel 1.8.1, w3lib 2.1.2, Twisted 22.10.0, Python 3.12.7 | packaged by Anaconda, Inc. | (main, Oct 4 2024, 13:17:27) [MSC v.1929 64 bit (AMD64)], pyOpenSSL 24.2.1 (OpenSSL 3.0.15 3 Sep 2024), cryptography 43.0.0, Platform Windows-11-10.0.26100-SP0 2025-11-14 19:14:53 [scrapy.addons] INFO: Enabled addons: [] 2025-11-14 19:14:53 [py.warnings] WARNING: D:\Anaconda\Lib\site-packages\scrapy\utils\request.py:254: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy. See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation. return cls(crawler) 2025-11-14 19:14:53 [scrapy.extensions.telnet] INFO: Telnet Password: b9dbfee686c0aa3d 2025-11-14 19:14:54 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.logstats.LogStats'] 2025-11-14 19:14:54 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'movie_analysis_project', 'CONCURRENT_REQUESTS': 1, 'DOWNLOAD_DELAY': 2, 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'movie_analysis_project.spiders', 'RETRY_TIMES': 3, 'SPIDER_MODULES': ['movie_analysis_project.spiders'], 'USER_AGENT': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36'} 2025-11-14 19:14:55 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2025-11-14 19:14:55 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] Unhandled error in Deferred: 2025-11-14 19:14:58 [twisted] CRITICAL: Unhandled error in Deferred: Traceback (most recent call last): File "D:\Anaconda\Lib\site-packages\scrapy\crawler.py", line 265, in crawl return self._crawl(crawler, *args, **kwargs) File "D:\Anaconda\Lib\site-packages\scrapy\crawler.py", line 269, in _crawl d = crawler.crawl(*args, **kwargs) File "D:\Anaconda\Lib\site-packages\twisted\internet\defer.py", line 1947, in unwindGenerator return _cancellableInlineCallbacks(gen) File "D:\Anaconda\Lib\site-packages\twisted\internet\defer.py", line 1857, in _cancellableInlineCallbacks _inlineCallbacks(None, gen, status, _copy_context()) --- <exception caught here> --- File "D:\Anaconda\Lib\site-packages\twisted\internet\defer.py", line 1697, in _inlineCallbacks result = context.run(gen.send, result) File "D:\Anaconda\Lib\site-packages\scrapy\crawler.py", line 158, in crawl self.engine = self._create_engine() File "D:\Anaconda\Lib\site-packages\scrapy\crawler.py", line 172, in _create_engine return ExecutionEngine(self, lambda _: self.stop()) File "D:\Anaconda\Lib\site-packages\scrapy\core\engine.py", line 100, in __init__ self.scraper = Scraper(crawler) File "D:\Anaconda\Lib\site-packages\scrapy\core\scraper.py", line 109, in __init__ self.itemproc: ItemPipelineManager = itemproc_cls.from_crawler(crawler) File "D:\Anaconda\Lib\site-packages\scrapy\middleware.py", line 90, in from_crawler return cls.from_settings(crawler.settings, crawler) File "D:\Anaconda\Lib\site-packages\scrapy\middleware.py", line 66, in from_settings mwcls = load_object(clspath) File "D:\Anaconda\Lib\site-packages\scrapy\utils\misc.py", line 79, in load_object mod = import_module(module) File "D:\Anaconda\Lib\importlib\__init__.py", line 90, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1387, in _gcd_import File "<frozen importlib._bootstrap>", line 1360, in _find_and_load File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 935, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 995, in exec_module File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed File "C:\Users\童琪琪\Desktop\bishe.6\biyesheji.6\movie_analysis_project\movie_analysis_project\pipelines.py", line 8, in <module> from .utils.data_cleaner import clean_text, convert_date, extract_gender builtins.ImportError: cannot import name 'extract_gender' from 'movie_analysis_project.utils.data_cleaner' (C:\Users\童琪琪\Desktop\bishe.6\biyesheji.6\movie_analysis_project\movie_analysis_project\utils\data_cleaner.py) 2025-11-14 19:14:58 [twisted] CRITICAL: Traceback (most recent call last): File "D:\Anaconda\Lib\site-packages\twisted\internet\defer.py", line 1697, in _inlineCallbacks result = context.run(gen.send, result) File "D:\Anaconda\Lib\site-packages\scrapy\crawler.py", line 158, in crawl self.engine = self._create_engine() File "D:\Anaconda\Lib\site-packages\scrapy\crawler.py", line 172, in _create_engine return ExecutionEngine(self, lambda _: self.stop()) File "D:\Anaconda\Lib\site-packages\scrapy\core\engine.py", line 100, in __init__ self.scraper = Scraper(crawler) File "D:\Anaconda\Lib\site-packages\scrapy\core\scraper.py", line 109, in __init__ self.itemproc: ItemPipelineManager = itemproc_cls.from_crawler(crawler) File "D:\Anaconda\Lib\site-packages\scrapy\middleware.py", line 90, in from_crawler return cls.from_settings(crawler.settings, crawler) File "D:\Anaconda\Lib\site-packages\scrapy\middleware.py", line 66, in from_settings mwcls = load_object(clspath) File "D:\Anaconda\Lib\site-packages\scrapy\utils\misc.py", line 79, in load_object mod = import_module(module) File "D:\Anaconda\Lib\importlib\__init__.py", line 90, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1387, in _gcd_import File "<frozen importlib._bootstrap>", line 1360, in _find_and_load File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 935, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 995, in exec_module File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed File "C:\Users\童琪琪\Desktop\bishe.6\biyesheji.6\movie_analysis_project\movie_analysis_project\pipelines.py", line 8, in <module> from .utils.data_cleaner import clean_text, convert_date, extract_gender ImportError: cannot import name 'extract_gender' from 'movie_analysis_project.utils.data_cleaner' (C:\Users\童琪琪\Desktop\bishe.6\biyesheji.6\movie_analysis_project\movie_analysis_project\utils\data_cleaner.py) PS C:\Users\童琪琪\Desktop\bishe.6\biyesheji.6\movie_analysis_project>
最新发布
11-15
ImportError: cannot import name 'extract_gender' from 'movie_analysis_project.utils.data_cleaner' ``` 这说明：**你在 `pipelines.py` 中尝试导入一个叫 `extract_gender` 的函数，但这个函数在 `data_...
你提供的源码 这是我的终端 PS D:\Experience\booscraper> scrapy genspider books books.toscrape.com Created spider 'books' using template 'basic' in module: booscraper.spiders.books PS D:\Experience\booscraper> scrapy crawl bookspider Traceback (most recent call last): File "<frozen runpy>", line 198, in _run_module_as_main File "<frozen runpy>", line 88, in _run_code File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Scripts\scrapy.exe\__main__.py", line 7, in <module> File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\site-packages\scrapy\cmdline.py", line 204, in execute cmd.crawler_process = CrawlerProcess(settings) ^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\site-packages\scrapy\crawler.py", line 430, in __init__ super().__init__(settings) File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\site-packages\scrapy\crawler.py", line 301, in __init__ self.spider_loader: SpiderLoaderProtocol = self._get_spider_loader(settings) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\site-packages\scrapy\crawler.py", line 293, in _get_spider_loader "SpiderLoaderProtocol", loader_cls.from_settings(settings.frozencopy()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\site-packages\scrapy\spiderloader.py", line 98, in from_settings return cls(settings) ^^^^^^^^^^^^^ File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\site-packages\scrapy\spiderloader.py", line 53, in __init__ self._load_all_spiders() File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\site-packages\scrapy\spiderloader.py", line 82, in _load_all_spiders for module in walk_modules(name): ^^^^^^^^^^^^^^^^^^ File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\site-packages\scrapy\utils\misc.py", line 98, in walk_modules submod = import_module(fullpath) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\importlib\__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "<frozen importlib._bootstrap>", line 1204, in _gcd_import File "<frozen importlib._bootstrap>", line 1176, in _find_and_load File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 690, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 940, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "D:\Experience\booscraper\booscraper\spiders\books.py", line 3, in <module> from scrapy_playwright.page import PageCoroutine ImportError: cannot import name 'PageCoroutine' from 'scrapy_playwright.page' (C:\Users\lihon\AppData\Local\Programs\Python\Python311\Lib\site-packages\scrapy_playwright\page.py)
08-17
ImportError: cannot import name 'PageCoroutine' from 'scrapy_playwright.page' ``` 这意味着： > 你尝试从 `scrapy_playwright.page` 导入 `PageCoroutine`，但这个模块中**不存在该类**。 --- ## 问题根源...
python报错 ImportError: cannot import name ‘SKIP_ADMIN_LOG‘ from ‘import_export.admin‘
weixin_40459875的博客
01-09 8177
运行python项目时报错：ImportError: cannot import name 'SKIP_ADMIN_LOG' from 'import_export.admin' 如下： 打开报错文件，发现直接红色提示了。 分析步骤： 1.打开 import_export/admin.py，搜索“SKIP_ADMIN_LOG”，发现确实没有SKIP_ADMIN_LOG 变量，只有一个方法 get_skip_admin_log(self) ，此方法返回了skip_admin_log，而这个方法是在
[Django]ImportError:cannot import name debug问题
.NET博文收藏
06-08 3624
[Django]ImportError:cannot import name debug问题 Version Date Creator
python - ImportError: Cannot import name ‘XXX’问题出现
热门推荐
young的博客
12-05 4万+
问题： python报错 - ImportError: Cannot import name ‘XXX’ 解决办法： 1.XXX版本更新。 2.自己的python文件与导入的包重名了，导致引入路径错乱，文件命名尽量不要用关键词。 ...
【Scrapy】Scrapy在Python3下报错：“cannot import name '_win32stdio'”解决办法
小小时光
10-19 3466
由于之前都是在Python2的环境下用的Scrapy，然后最近在用Python3的环境，今天试着用Scrapy启动一个爬虫的时候居然报错。 操作 scrapy crawl demo 报错 Traceback (most recent call last): File "c:\python34\lib\site-packages\scrapy\commands\crawl.py", line 57
python之scrapy模块logging日志
weixin_30949361的博客
06-24 361
1、知识点 """ logging : scrapy： settings中设置LOG_LEVEL="WARNING" settings中设置LOG_FILE="./log.log" #设置日志保存的位置，设置后在终端不会显示日志内容 import logging 实例化一个logger的方式在任何文件中使用logger输出内容...
Scrapy 中 log 功能
Great Expectations的博客
08-22 1238
Scrapy提供了log功能，可以通过 logging 模块使用 可以在settings 中添加使用 LOG_FILE = "mySpider.log" LOG_LEVEL = "INFO" LOG_FILE 储存log文件路径 LOG_LEVEL 日志等级 Scrapy提供5层logging级别: CRITICAL - 严重错误(critical) ERROR - 一般错误...
Python ImportError: cannot import name XXX from XXX 问题的一个起因和解决方案
lockt6531590的博客
08-16 2万+
Python ImportError: cannot import name XXX from XXX 问题的一个起因和解决方案
scrapy引用包出错ImportError : cannot import name '_win32stdio'
mwmoo的博客
01-03 2871
今天决定开始折腾scrapy。 python 3.5 scrapy 1.1 win10 比照官方文档（英文1.2.4版本，中文早期版本）在执行scrapy crawl quotes出现ImportError : cannot import name '_win32stdio',搜索SF找到解决方案，如下： Scrapy can work with Python 3 on windows if
python scrapy 使用时报错 cannot import name xmlrpc_client
风雨兼程
07-11 2888
python scrapy 使用时报错 cannot import name xmlrpc_client在使用时处出现下面错误： Traceback (most recent call last): File “/usr/local/bin/scrapy”, line 7, in from scrapy.cmdline import execute File “/Libra
ImportError: cannot import name ABNF from websocket
12-04
ImportError: cannot import name ABNF from websocket 这个错误信息表明在尝试从 `websocket` 模块中导入名为 `ABNF` 的对象时发生了问题。可能的原因有以下几种： 1. **模块版本不匹配**：你可能使用的 `...
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值