Re 爬取数据

学艺的海盗

于 2022-11-09 16:49:25 发布

阅读量366

点赞数

分类专栏：随笔记文章标签：经验分享

本文链接：https://blog.youkuaiyun.com/qq_41370110/article/details/127773072

版权

随笔记专栏收录该内容

7 篇文章

订阅专栏

import requests
import re
import csv

url = '************'
headers = {
    "User-Agent":
        "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:106.0) Gecko/20100101 Firefox/106.0"
}

req = requests.get(url, headers=headers)
package_conte = req.text

# 数据解析(?P<wahaha>.*?)

obj = re.compile(r' <li>.*?<div class="item">.*? <span class="title">(?P<name>.*?)</span>.*?<div class="bd">.*?'
                 r'<p class="">.*?<br>(?P<year>.*?)&nbsp;.*?<div class="star">.*?<span class="rating_num" property="v:average">'
                 r'(?P<fen>.*?)</span>.*?<span>(?P<num>.*?)</span>', re.S)
a = obj.finditer(package_conte)
f = open('data.csv', mode='w')
csvs = csv.writer(f)
for i in a:
    dic = i.groupdict()
    dic['year'] = dic['year'].strip()
    csvs.writerow(dic.values())
f.close()
print('over!')