python3 scrapy 爬虫环境搭建

最新推荐文章于 2022-12-13 00:49:33 发布

原创最新推荐文章于 2022-12-13 00:49:33 发布 · 242 阅读

0 ·

CC 4.0 BY-SA版权

python 专栏收录该内容

313 篇文章

订阅专栏

本文详细介绍如何使用Python3.7在Windows环境下安装Scrapy框架。包括创建虚拟环境、激活及退出虚拟环境，以及安装一系列依赖库如Twisted、lxml、PyDispatcher等。

mkvirtualenv -p C:\Python37\python.exe py372_64_scrapy

workon py372_64_scrapy

deactivate

pip install scrapy

Successfully built protego PyDispatcher
Installing collected packages: pycparser, cffi, six, cryptography, protego, cssselect, w3lib, lxml, parsel, attrs, pyasn1, pyasn1-modules, service-identity, zope.interface, PyHamcrest, incremental, Au
tomat, idna, hyperlink, constantly, Twisted, queuelib, pyOpenSSL, PyDispatcher, scrapy
Successfully installed Automat-20.2.0 PyDispatcher-2.0.5 PyHamcrest-2.0.2 Twisted-20.3.0 attrs-19.3.0 cffi-1.14.0 constantly-15.1.0 cryptography-2.9.2 cssselect-1.1.0 hyperlink-19.0.0 idna-2.9 increme
ntal-17.5.0 lxml-4.5.0 parsel-1.6.0 protego-0.1.16 pyOpenSSL-19.1.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 queuelib-1.5.0 scrapy-2.1.0 service-identity-18.1.0 six-1.14.0 w3lib-1.22.0 zope.in
terface-5.1.0