<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[DDCooper的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/DDCooper</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; DDCooper]]></copyright><item><title><![CDATA[边学边记(5):pandas，matplotlib处理爬取的爱屋吉屋二手房数据]]></title><link>https://blog.youkuaiyun.com/DDCooper/article/details/79310035</link><guid>https://blog.youkuaiyun.com/DDCooper/article/details/79310035</guid><author>DDCooper</author><pubDate>Tue, 13 Feb 2018 13:43:32 +0800</pubDate><description><![CDATA[之前爬取的爱屋吉屋二手房数据做了下简单的处理，电脑太慢只爬取了2030条。整个过程记录一下首先导入数据：import pymysql as py
import numpy as np
import pandas as pd
import matplotlib.pyplot as plt 
conn=py.connect(host='127.0.0.1',port=3306,user='root',...]]></description><category></category></item><item><title><![CDATA[边学边记(3):scrapy爬取gif图片]]></title><link>https://blog.youkuaiyun.com/DDCooper/article/details/79226809</link><guid>https://blog.youkuaiyun.com/DDCooper/article/details/79226809</guid><author>DDCooper</author><pubDate>Thu, 01 Feb 2018 13:56:48 +0800</pubDate><description><![CDATA[边学边记，记录遇到的坑达成的小目标 。前篇爬取的是静态的图片这次是针对gif。其实无论静态动态用如下的方式都可以爬取。代码如下：（多玩写错了变成douwan）items：import scrapy


class DouwanItem(scrapy.Item):
    # define the fields for your item here like:
    # name = scrapy...]]></description><category></category></item><item><title><![CDATA[边学边记(2):scrapy爬取图片]]></title><link>https://blog.youkuaiyun.com/DDCooper/article/details/79224276</link><guid>https://blog.youkuaiyun.com/DDCooper/article/details/79224276</guid><author>DDCooper</author><pubDate>Thu, 01 Feb 2018 09:48:20 +0800</pubDate><description><![CDATA[边学边记，记录遇到的坑达成的小目标
scrapy下载图片移步scrapy下载项目图片
items：

import scrapy


class PictureItem(scrapy.Item):
    # define the fields for your item here like:
    # name = scrapy.Field()
    image_urls = scr]]></description><category></category></item><item><title><![CDATA[边学边记(1):scrapy初窥门径爬一爬前程无忧职位]]></title><link>https://blog.youkuaiyun.com/DDCooper/article/details/79217499</link><guid>https://blog.youkuaiyun.com/DDCooper/article/details/79217499</guid><author>DDCooper</author><pubDate>Wed, 31 Jan 2018 15:10:32 +0800</pubDate><description><![CDATA[边学边记，记录遇到的坑达成的小目标。先上一张图Scrapy主要包括了以下组件：引擎(Scrapy)用来处理整个系统的数据流处理, 触发事务(框架核心)调度器(Scheduler)用来接受引擎发过来的请求, 压入队列中, 并在引擎再次请求的时候返回. 可以想像成一个URL（抓取网页的网址或者说是链接）的优先队列, 由它来决定下一个要抓取的网址是什么, 同时去除重复的网址下载器(Downloader)...]]></description><category></category></item></channel></rss>