Scrapy

$ Ubuntu 14.04 LTS

安装Scrapy

pip install scrapy

http://scrapy.org/

安装pip

sudo apt-get install python-pip

http://blog.youkuaiyun.com/kingppy/article/details/13080919

测试Scrapy

 1 pip install scrapy
 2 cat > myspider.py <<EOF
 3 
 4 from scrapy import Spider, Item, Field
 5 
 6 class Post(Item):
 7     title = Field()
 8 
 9 class BlogSpider(Spider):
10     name, start_urls = 'blogspider', ['http://blog.scrapinghub.com']
11 
12     def parse(self, response):
13         return [Post(title=e.extract()) for e in response.css("h2 a::text")]
14 
15 EOF
16 scrapy runspider myspider.py

[ERROR]You do not have a working installation of the service_identity module...

http://www.cnblogs.com/QuDump/p/3750447.html

pip install service_identity

Scrapy文档

http://scrapy-chs.readthedocs.org/zh_CN/0.24/

http://doc.scrapy.org/en/0.24/