Python 爬虫 scrapy 利用splash爬取动态网页
转载自 https://blog.youkuaiyun.com/mouday/article/details/81625830
依赖库:
pip install scrapy-splash
配置settings.py
# splash服务器地址
SPLASH_URL = 'http://localhost:8050'
# 支持cache_args(可选)
SPIDER_MIDDLEWARES = {
...
转载
2018-10-19 20:22:21 ·
518 阅读 ·
1 评论