python

Pythone抓取:抓取大多数情况属于get请求，即直接从对方服务器上获取数据。

Requests：

   

import requests    

response = requests.get(url)    

content = requests.get(url).content  

print "response headers:", response.headers    

print "content:", content

 

Urllib2：

   

import urllib2    

response = urllib2.urlopen(url)    

content = urllib2.urlopen(url).read()    

print "response headers:", response.headers    

print "content:", content

 

Httplib2：    

 

import httplib2    

http = httplib2.Http()    

response_headers, content = http.request(url, 'GET')    

print "response headers:", response_headers    

print "content:", content

 

链接： https://github.com/lining0806/PythonSpiderNotes

 

 

转载于:https://www.cnblogs.com/zhiqng/p/6483464.html