python爬虫爬取网易云音乐的热门评论

最新推荐文章于 2024-06-19 11:50:54 发布

段小胖

最新推荐文章于 2024-06-19 11:50:54 发布

阅读量1.5k

点赞数 2

本文链接：https://blog.youkuaiyun.com/dxcve/article/details/81630773

版权

本文介绍如何使用Python爬虫技术，详细解析爬取网易云音乐热门评论的过程，包括请求发送、数据解析及存储等关键步骤。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

import requests
import json
from bs4 import BeautifulSoup

def get_comments(res):
    comments = json.loads(res.text)
    hot_comments = comments['hotComments']
    with open('热门评论.txt','w',encoding='utf-8') as f:
        for each in hot_comments:
            f.write(each['user']['nickname']+':\n')
            f.write(each['content']+'\n\n')

def geturl(url):
    headers = {"Referer": "http//music.163.com","User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.106 Safari/537.36"}
#下面两个参数是网易加密过的，直接在网页元素中复制过来的
    params="K2HjGyPzWSCz2O772ysQLqvidrQlnnjxpnBh/ZjO8j8FLlHKNxNn+VQyMuztFaxMbUcj4pm98zkF6IpQ7RjIcFGMAbrv+C8DP6MaS5JoEx0MtMcizFfcoysQ0vG9RRTqXP0tRvie+7vgFfcSv1zg1u3zjUPswqWXH7dq9AoRL23cAhG4H9jFcUfUzovMlwXP"
    encSecKey="ccbe33dd2f440faf5