Deepcold的博客

Scrapy顺序执行多个爬虫 使用subprocess按照顺序执行多个爬虫，新建一个start.py文件，输入一下内容， def crawl_work(): subprocess.Popen('scrapy crawl spider1', shell=True).wait() subprocess.Popen('scrapy crawl spider2', shell=True).wait() subprocess.Popen('scrapy crawl spider3', shel

常见反爬及应对措施–思路