爬取cloudmusic歌单

最新推荐文章于 2025-08-12 16:35:09 发布

qq_53743676

最新推荐文章于 2025-08-12 16:35:09 发布

阅读量353

点赞数

CC 4.0 BY-SA版权

文章标签： python 开发语言

本文链接：https://blog.youkuaiyun.com/qq_53743676/article/details/124746698

本文介绍如何使用Python进行网络爬虫，详细解析爬取cloudmusic平台上的歌单信息，包括数据抓取、解析及存储过程。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

代码

# -*- coding: utf-8 -*-
import re
import csv
import json
import time
import pymysql
import requests
from bs4 import BeautifulSoup
from multiprocessing import Pool

# 请求头
headers = {
        'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'
        }

# 歌单类型链接
type_url = "https://music.163.com/discover/playlist"

# 连接数据库
db = pymysql.connect(
    host = "localhost",
    user = "root",
    password = "123456",
    port=3306,
    db = "cloudmusic1"
        )

cursor = db.cursor()


"""获取歌单类型"""
def get_playlist_type(url):
    response = requests.get(url=url, headers=headers)
    html = response.text
    soup = BeautifulSoup(html, 'lxml')
    types = [t.text for t in soup.select("a.s-fc1")][1:]
    return types


"""获取歌单id"""
def get_playlist_id(url):
    response = requests.get(url=url, headers=headers)
    html = response.text
    soup = BeautifulSoup(html, 'lxml')
    ids = [re.sub(r"\D+",