python 爬虫爬去虾米音乐赵雷歌词

最新推荐文章于 2021-02-10 18:25:26 发布

原创最新推荐文章于 2021-02-10 18:25:26 发布 · 1.3k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#python #爬虫学习

python模块专栏收录该内容

4 篇文章

订阅专栏

本文介绍了一个使用Python3从虾米音乐网站爬取赵雷歌曲歌词的方法。通过发送请求获取网页内容，利用BeautifulSoup解析页面并提取歌词部分，最终将歌词保存到本地文件中。

部署运行你感兴趣的模型镜像

#/usr/bin/env python
# *-*coding:utf-8 *-*

#python 3 爬取赵雷歌词

"""

from collections import Counter
from urllib import request
from bs4 import BeautifulSoup as BS
import jieba
import os

songlists = ['http://www.xiami.com/album/465009', 'http://www.xiami.com/album/2100205356', 'http://www.xiami.com/album/2013969781', 'http://www.xiami.com/album/2102413795']
songlist = 'http://www.xiami.com/album/465009'
writefile = '~/Downlaod/赵雷歌词.txt'

class xiamimusic():

def __init__(self):
self.zhaolei = open(writefile, 'w')
self.weburl ='http://www.xiami.com'

def get_html(self,urll):
webheaders = { 'User-Agent':'Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.6) Gecko/20091201 Firefox/3.5.6'}
req = request.Request(url= urll, headers= webheaders)
html = request.urlopen(req).read().decode('utf-8')
return html

def get_lyrics_html(self,urll):

soup = BS(self.get_html(urll), 'html.parser')
for tdtag in soup.find_all('td', class_="song_name"):
for line in tdtag.find_all('a'):
if len(line.get('href')) > 10:
songurl = os.path.join(self.weburl + line.get('href'))

soup = BS(self.get_html(songurl), 'html.parser')
for divtag in soup.find_all('div', class_= 'lrc_main'):
#song_wordset = set(jieba.cut(divtag.get_text(), cut_all= False))
self.zhaolei.write(divtag.get_text())
self.zhaolei.close()

s = xiamimusic()
s.get_lyrics_html(songlist)

还请各位大婶多多指教

您可能感兴趣的与本文相关的镜像