pip install scrapy

最新推荐文章于 2025-05-17 13:33:31 发布

weixin_40681749

最新推荐文章于 2025-05-17 13:33:31 发布

阅读量200

点赞数

CC 4.0 BY-SA版权

本文链接：https://blog.youkuaiyun.com/weixin_40681749/article/details/103523503

本文详细记录了在Windows环境下使用pip安装Scrapy爬虫框架的过程，并演示了如何通过命令行创建一个新的Scrapy项目。同时，文章还展示了在项目目录下生成蜘蛛爬虫的基本步骤。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

##1、安装scrapy

…
File “c:\users\thinkpad\appdata\local\programs\python\python37\lib\site-packages\pip-19.3.1-py3.7.egg\pip_vendor\urllib3\response.py”, line 430, in _error_catcher
raise ReadTimeoutError(self._pool, None, “Read timed out.”)
pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host=‘files.pythonhosted.org’, port=443): Read timed out.
D:\csdn\zhaobiao>pip --default-timeout=100 install -U pip

WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by ‘ReadTimeoutError(“HTTPSConnectionPool(host=‘pypi.org’, port=443): Read timed out. (read timeout=100.0)”)’: /simple/pip/
Requirement already up-to-date: pip in c:\users\thinkpad\appdata\local\programs\python\python37\lib\site-packages\pip-19.3.1-py3.7.egg (19.3.1)
D:\csdn\zhaobiao>pip install scrapy
Collecting scrapy…

##2、创建scrapy项目

D:\csdn\zhaobiao>scrapy startproject zhaobiao
New Scrapy project ‘zhaobiao’, using template directory ‘c:\users\thinkpad\appdata\local\programs\python\python37\lib\site-packages\scrapy\templates\project’, created in:
D:\csdn\zhaobiao\zhaobiao

You can start your first spider with:
cd zhaobiao
scrapy genspider example example.com

D:\csdn\zhaobiao>dir
驱动器 D 中的卷是 Data
卷的序列号是 268D-8857

D:\csdn\zhaobiao 的目录

2019/12/13 11:09

.
2019/12/13 11:09 …
2019/12/13 11:09 zhaobiao
0 个文件 0 字节
3 个目录 351,189,250,048 可用字节

D:\csdn\zhaobiao>cd zhaobiao
D:\csdn\zhaobiao\zhaobiao>scrapy genspider bilian 'ebnew’
Created spider ‘bilian’ using template ‘basic’ in module:
zhaobiao.spiders.bilian