scrapy设置代理

一、开启中间件下载中间件

#文件：wettings.py
取消以下注释：
SPIDER_MIDDLEWARES = {
'meiziproject.middlewares.MeiziprojectSpiderMiddleware': 543,
}

二、编写中间件代码,添加代理

class MeiziprojectDownloaderMiddleware(object):
    def process_request(self, request, spider):
        request.meta['proxy'] = 'https://113.68.202.10:9999'
        return None