爬虫练习1：爬知乎关注人信息

最新推荐文章于 2025-06-01 21:09:33 发布

等一只蛙

最新推荐文章于 2025-06-01 21:09:33 发布

阅读量296

点赞数

文章标签： python

本文链接：https://blog.youkuaiyun.com/weixin_43319582/article/details/104725679

版权

记录练习爬虫的过程
爬取知乎关注人信息
学习了requests和pandas

import requests
import pandas as pd

shuju=[]
header={
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36',
    'authority': 'www.zhihu.com'
}
def paichong(page):
    for i in range(page):
        url='https://www.zhihu.com/api/v4/members/Miss.Jiang/followees?include=data%5B*%5D.answer_count%2Carticles_count%2Cgender%2Cfollower_count%2Cis_followed%2Cis_following%2Cbadge%5B%3F(type%3Dbest_answerer)%5D.topics&offset={}&limit=20'.format(i*20)
        response=requests.get(url,headers=header)
        response.encoding='utf-8'
        response=response.json()['data']
        shuju.extend(response)
        print('正在爬取第%s页'%str(i+1))
if __name__ == '__main__':
    paichong(16)
    df=pd.DataFrame.from_dict(shuju)
    df.to_excel('shuju1.xls')