安装scrapy报错: Could not find a version that satisfies the requirement Twisted-18.9.0-cp36-cp36m-win_a

本文详细记录了从零开始安装Scrapy爬虫的过程,包括解决安装中遇到的各种错误,如Twisted安装失败和Microsoft Visual C++ 14.0环境缺失等问题。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

小书死磕爬虫,学会一样,再攻一样。今天学习scrapy 时安装就出错了,不能忍,开搞pip install scrapy Collecting scrapy Downloading https://files.pythonhosted.org/packages/5d/12/a6197eaf97385e96fd8ec56627749a6229a9b3178ad73866a0b1fb377379/Scrapy-1.5.1-py2.py3-none-any.whl (249kB) 100% |████████████████████████████████| 256kB 410kB/s Collecting parsel>=1.1 (from scrapy) Downloading https://files.pythonhosted.org/packages/96/69/d1d5dba5e4fecd41ffd71345863ed36a45975812c06ba77798fc15db6a64/parsel-1.5.1-py2.py3-none-any.whl .................................... 出错啦!!!!!
解决问题吧:开搞啦

第一步: 先找到scrapy的官网如:(https://doc.scrapy.org/en/master/intro/install.html#installing-scrapy)

第二步:往下滑你会看到:
在这里插入图片描述
也就是说这里面涉及到的东西你都需要安装,这个很好用,你直接点pyOpenSSL就会跳到另一个网址,里面有安装代码,直接复制即可。
在这里插入图片描述
如果你都能成功安装上那就没问题啦!
小书还要第三步呢!!!
安装过程中:Twisted报错,效果如下:

 Could not find a version that satisfies the requirement Twisted-18.9.0-cp36-cp36m-win_amd64 (from versions: )
No matching distribution found for Twisted-18.9.0-cp36-cp36m-win_amd64

解决吧:
我找到Twisted的网址(https://pypi.org/project/Twisted/)
在这里插入图片描述
安装很顺利的出错啦!!!

error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools

    ----------------------------------------
Command "c:\users\shu\appdata\local\programs\python\python36\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\Shu\\AppData\\Local\\Temp\\pip-install-w62o51mg\\Twisted\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\Shu\AppData\Local\Temp\pip-record-tj7glxk8\install-record.txt --single-version-externally-managed --compile" failed with error code 1 in C:\Users\Shu\AppData\Local\Temp\pip-install-w62o51mg\Twisted\

奔溃>>>>>>>>>>>>>此处已过去两小时

第三步:安装Twisted
先解决一个问题,这儿说什么缺少一个 Microsoft Visual C++ 14.0环境,听我的,别去搞,我花了一个积分下载了别人的一个,包都是错的。我们需要做的是进入下面这个官网:[(https://www.lfd.uci.edu/~gohlke/pythonlibs/)
去里面找到,找到与你电脑版本和python版本一致的whl文件下载

下载好后,存放在电脑桌面,然后开始安装:

C:\Users\Shu\Desktop>pip install C:\Users\Shu\Desktop\Twisted-18.9.0-cp36-cp36m-win_amd64.whl
Processing c:\users\shu\desktop\twisted-18.9.0-cp36-cp36m-win_amd64.whl
Requirement already satisfied: Automat>=0.3.0 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted==18.9.0) (0.7.0)
Requirement already satisfied: constantly>=15.1 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted==18.9.0) (15.1.0)
Requirement already satisfied: PyHamcrest>=1.9.0 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted==18.9.0) (1.9.0)
Requirement already satisfied: attrs>=17.4.0 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted==18.9.0) (18.2.0)
Requirement already satisfied: incremental>=16.10.1 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted==18.9.0) (17.5.0)
Requirement already satisfied: hyperlink>=17.1.1 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted==18.9.0) (18.0.0)
Requirement already satisfied: zope.interface>=4.4.2 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted==18.9.0) (4.6.0)
Requirement already satisfied: six in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Automat>=0.3.0->Twisted==18.9.0) (1.11.0)
Requirement already satisfied: setuptools in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from PyHamcrest>=1.9.0->Twisted==18.9.0) (39.1.0)
Requirement already satisfied: idna>=2.5 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from hyperlink>=17.1.1->Twisted==18.9.0) (2.7)
Installing collected packages: Twisted
Successfully installed Twisted-18.9.0

成功啦!!!!!!开不开心?

第四步:安装Scrapy

C:\Users\Shu\Desktop>pip install scrapy
Collecting scrapy
  Using cached https://files.pythonhosted.org/packages/5d/12/a6197eaf97385e96fd8ec56627749a6229a9b3178ad73866a0b1fb377379/Scrapy-1.5.1-py2.py3-none-any.whl
Requirement already satisfied: six>=1.5.2 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from scrapy) (1.11.0)
Requirement already satisfied: cssselect>=0.9 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from scrapy) (1.0.3)
Collecting queuelib (from scrapy)
  Using cached https://files.pythonhosted.org/packages/4c/85/ae64e9145f39dd6d14f8af3fa809a270ef3729f3b90b3c0cf5aa242ab0d4/queuelib-1.5.0-py2.py3-none-any.whl
Collecting service-identity (from scrapy)
  Using cached https://files.pythonhosted.org/packages/29/fa/995e364220979e577e7ca232440961db0bf996b6edaf586a7d1bd14d81f1/service_identity-17.0.0-py2.py3-none-any.whl
Requirement already satisfied: parsel>=1.1 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from scrapy) (1.5.1)
Requirement already satisfied: w3lib>=1.17.0 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from scrapy) (1.19.0)
Collecting PyDispatcher>=2.0.5 (from scrapy)
Requirement already satisfied: Twisted>=13.1.0 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from scrapy) (18.9.0)
Requirement already satisfied: lxml in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from scrapy) (4.2.5)
Requirement already satisfied: pyOpenSSL in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from scrapy) (18.0.0)
Collecting pyasn1-modules (from service-identity->scrapy)
  Using cached https://files.pythonhosted.org/packages/19/02/fa63f7ba30a0d7b925ca29d034510fc1ffde53264b71b4155022ddf3ab5d/pyasn1_modules-0.2.2-py2.py3-none-any.whl
Collecting pyasn1 (from service-identity->scrapy)
  Using cached https://files.pythonhosted.org/packages/d1/a1/7790cc85db38daa874f6a2e6308131b9953feb1367f2ae2d1123bb93a9f5/pyasn1-0.4.4-py2.py3-none-any.whl
Requirement already satisfied: attrs in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from service-identity->scrapy) (18.2.0)
Requirement already satisfied: incremental>=16.10.1 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted>=13.1.0->scrapy) (17.5.0)
Requirement already satisfied: constantly>=15.1 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted>=13.1.0->scrapy) (15.1.0)
Requirement already satisfied: zope.interface>=4.4.2 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted>=13.1.0->scrapy) (4.6.0)
Requirement already satisfied: PyHamcrest>=1.9.0 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted>=13.1.0->scrapy) (1.9.0)
Requirement already satisfied: Automat>=0.3.0 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted>=13.1.0->scrapy) (0.7.0)
Requirement already satisfied: hyperlink>=17.1.1 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from Twisted>=13.1.0->scrapy) (18.0.0)
Requirement already satisfied: cryptography>=2.2.1 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from pyOpenSSL->scrapy) (2.3.1)
Requirement already satisfied: setuptools in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from zope.interface>=4.4.2->Twisted>=13.1.0->scrapy) (39.1.0)
Requirement already satisfied: idna>=2.5 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from hyperlink>=17.1.1->Twisted>=13.1.0->scrapy) (2.7)
Requirement already satisfied: asn1crypto>=0.21.0 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from cryptography>=2.2.1->pyOpenSSL->scrapy) (0.24.0)
Requirement already satisfied: cffi!=1.11.3,>=1.7 in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from cryptography>=2.2.1->pyOpenSSL->scrapy) (1.11.5)
Requirement already satisfied: pycparser in c:\users\shu\appdata\local\programs\python\python36\lib\site-packages (from cffi!=1.11.3,>=1.7->cryptography>=2.2.1->pyOpenSSL->scrapy) (2.19)
Installing collected packages: queuelib, pyasn1, pyasn1-modules, service-identity, PyDispatcher, scrapy
Successfully installed PyDispatcher-2.0.5 pyasn1-0.4.4 pyasn1-modules-0.2.2 queuelib-1.5.0 scrapy-1.5.1 service-identity-17.0.0

成功安装!!!!
第五步:测试

C:\Users\Shu\Desktop>python
Python 3.6.4 (v3.6.4:d48eceb, Dec 19 2017, 06:54:40) [MSC v.1900 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import scrapy
>>>

好开森!!!
希望我的经历对你有所帮助,小书,一个21世纪的python小白,我坚信知行合一,知道并且做到,让我们一起努力,为美好的未来奋斗吧!!!(这个插入代码部分今天刚学会,不知道效果如何)

### 解决Scrapy安装时版本不匹配的问题 当尝试通过 `pip install scrapy` 安装 Scrapy 时,如果遇到类似于 “No matching distribution found for Twisted>=10.0.0 (from scrapy)” 的错误[^1],通常是因为 Python 版本或依赖库的兼容性问题。 以下是可能的原因以及解决方案: #### 原因分析 1. **Python 版本过低** Scrapy 需要至少 Python 3.5 或更高版本的支持。如果当前使用的 Python 是较旧的版本,则可能导致无法找到合适的依赖项。 2. **网络连接问题** 如果本地环境无法访问 PyPI(Python Package Index),则可能会导致下载失败或者找不到对应的包。 3. **操作系统差异** 某些依赖库(如 Twisted 和 pywin32)可能存在特定于操作系统的二进制文件。例如,在 Windows 上安装某些扩展模块时会更复杂[^5]。 4. **已存在的冲突包** 已经安装的一些包可能与新需求存在版本冲突,这会导致安装过程中的错误提示。 --- #### 解决方案 ##### 方法一:升级 Python 到最新稳定版 确保使用的是支持 Scrapy 的最低 Python 版本(建议使用 Python 3.7 及以上)。可以通过以下命令检查当前 Python 版本: ```bash python --version ``` 如果需要更新 Python,请从官方站点 [https://www.python.org/downloads/](https://www.python.org/downloads/) 下载并安装最新的稳定版本。 ##### 方法二:手动指定依赖版本 有时默认的依赖解析器会选择不适合的操作系统或架构的版本。可以显式地指定所需的具体版本来解决问题。例如: ```bash pip install twisted==20.3.0 pip install scrapy ``` 这里选择了 Twisted 的具体版本号以适配目标平台的要求。 ##### 方法三:离线安装 对于网络受限的情况,可以从其他镜像源获取所需的 whl 文件进行本地安装。例如,针对 `enum34` 报错情况下的处理方式如下[^2]: 1. 访问地址 [https://pypi.org/project/enum34/#files](https://pypi.org/project/enum34/#files),下载适合您系统的 `.whl` 文件; 2. 使用命令完成安装: ```bash pip install /path/to/downloaded/file.whl ``` ##### 方法四:更换国内镜像加速 由于国际网络波动较大,推荐切换到国内常用镜像服务器加快资源加载速度。设置临时参数执行安装指令: ```bash pip install scrapy -i https://pypi.tuna.tsinghua.edu.cn/simple ``` 此方法能够有效缓解部分国外仓库不可达引发的一系列连锁反应。 ##### 方法五:清理残留数据重新构建虚拟环境 如果有先前未完全卸载干净的老版本组件干扰到了新的配置流程,那么先销毁再重建一个新的隔离空间不失为一种明智之举。步骤如下所示: 1. 创建全新目录作为工作区; 2. 初始化独立运行区域: ```bash python -m venv my_scrapy_env source my_scrapy_env/bin/activate # Linux/MacOS下激活 .\my_scrapy_env\Scripts\activate # Windows环境下启动 ``` 3. 在该区域内按照常规手段引入必要工具集即可规避潜在污染风险。 --- ### 示例代码验证成功状态 确认最终成果无误之后可通过下面这条语句测试基本功能是否正常运作: ```bash scrapy --version ``` 预期输出应显示类似这样的信息表明一切就绪: ``` Scrapy 1.5.1 - no active project Usage: scrapy <command> [options] [args] Available commands: ... ``` 上述现象即代表基础框架搭建完毕可供后续开发调用了[^3]。 ---
评论 16
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值