
scrapy框架
文章平均质量分 55
蛊i
▆▆▆▆▆▆▆▆▆▆▆▆▆▆▆ ꧁༺ۣۖ刮开ۣۖ༒ۣۖ有奖ۣۖ༻꧂
展开
-
scrapy 在启动文件进行传值
comment.pyimport scrapyfrom scrapy.http import Requestclass CommentSpider(scrapy.Spider): name = 'comment' def __init__(self,value): self.value=value self.header={ ...原创 2018-06-11 16:35:50 · 896 阅读 · 0 评论 -
scrapy异步存储mysql
piplines.pyclass DuoTestPipeline(object): def __init__(self,db_pool): self.db_pool=db_pool @classmethod #从setting中读取数据 def from_settings(cls, settings): db_params ...原创 2018-12-04 15:12:34 · 649 阅读 · 0 评论 -
scrapy批量插入mysql
spider.pysql='insert into tiebadata(publish_name,publish_time,publish_url,publish_content,comment_content,comment_time,comment_name,keyword,app_name,run_time)VALUES (%s,%s,%s,%s,%s,%s,%s,%s,%s,%s)'...原创 2018-12-04 16:12:59 · 1542 阅读 · 0 评论