IP代理池和Cookie池简单代码

eval_request

于 2019-11-12 13:40:45 发布

阅读量445

点赞数

CC 4.0 BY-SA版权

分类专栏： python爬取网站文章标签： IP代理

本文链接：https://blog.youkuaiyun.com/eval_request/article/details/103027168

python爬取网站专栏收录该内容

8 篇文章

订阅专栏

import requests

# url="http://httpbin.org/ip"
# # response=requests.get(url=url)
# # print(response.text)
# proxy={
# 	'http':'125.42.148.190:8060'
# }
# response=requests.get(url=url,proxies=proxy)
# print(response.text)

proxy的内容可以在ip代理网站上找

mport requests

url = 'http://www.renren.com/SysHome.do'
data = {"email": '970138074@qq.com', 'password': "pythonspider"}
headers = {
    'User-Agent': "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.70 Safari/537.36"
}
session = requests.Session()
session.post(url, data=data, headers=headers)
response = session.get('http://www.renren.com/880151247/profile')
with open('renren.html', 'w', encoding='utf-8')as p:
    p.write(response.text)

主要应用了:session.post和session.get方法