anaconda3
切换到spyder环境:activate spyder
下载:pip install srcapy
scrapy:
创建项目:
scrapy startproject 文件名
个人:
学习崔庆财爬虫http://quotes.toscrape.com/
scrapy startproject quotetutorial
进入quotetutorial:cd quotetutorial
创建:scrapy genspider quotes quotes.toscrape.com
打开pycharm查看quotes.py文件:
activate spyder切换到spyder环境运行:
scrapy crawl quotes
将pass改写为print(response.text)可以查看
再次输入:scrapy crawl quotes
运行:
请求成功!
附:
scrapy–command官方