爬虫实战8：爬取微博内容信息

最新推荐文章于 2025-07-06 20:35:28 发布

shifanfashi

最新推荐文章于 2025-07-06 20:35:28 发布

阅读量4.1k

点赞数 5

CC 4.0 BY-SA版权

分类专栏：爬虫实战爬虫实战文章标签：爬虫实战

本文链接：https://blog.youkuaiyun.com/shifanfashi/article/details/90292375

获取微博大V账号的用户基本信息，如：微博昵称、微博地址、微博头像、关注人数、粉丝数、性别、等级等

# -*- coding: utf-8 -*-
import urllib.request
import json

id = '1259110474'
proxy_addr = "122.241.72.191:808"


def use_proxy(url, proxy_addr):
    req = urllib.request.Request(url)
    req.add_header(
        "User-Agent",
        "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.221 Safari/537.36 SE 2.X MetaSr 1.0")
    proxy = urllib.request.ProxyHandler({'http': proxy_addr})
    opener = urllib.request.build_opener(proxy, urllib.request.HTTPHandler)
    urllib.request.install_opener(opener)
    data = urllib.request.urlopen(req).read().decode('utf-8', 'ignore')
    # print(data)
    return data


def get_containerid(url):
    data = use_proxy(url, proxy_addr)
    content = json.loads(data).get('data')
    for data in content.get('tabsInfo').get('tabs'):
        if(data.get('tab_type') == 'weibo'):
            containerid = data.get('containerid')
    ret