requests_正则解析

最新推荐文章于 2025-05-27 22:19:46 发布

i先生

最新推荐文章于 2025-05-27 22:19:46 发布

阅读量312

点赞数

CC 4.0 BY-SA版权

分类专栏：爬虫

本文链接：https://blog.youkuaiyun.com/qq_42815634/article/details/86098865

爬虫专栏收录该内容

7 篇文章

订阅专栏

本文分享了一个使用Python进行百度贴吧图片爬取的实战案例，通过requests库获取网页内容，利用正则表达式解析出图片链接，并下载保存到本地。详细展示了从网页请求到图片下载的完整流程。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

import requests
import re

url = "http://c.tieba.baidu.com/p/5287949986"

html=requests.get(url)
url_list = re.findall(r"http://imgsrc.baidu.com/forum/.*?\.jpg",html.text)

root = ""
file=open(root+"demo.txt","a")
for url in url_list:
     file.write(url+"\n")
file.close()
'''
for i in url_list:
     with open(root+"demo.txt","w")as p:
          p.write(i)
          p.close()
'''
print("url_list download success!")
num=0
failed_count=0
for url in url_list:
    path = root+str(num+1)+".jpg"
    with open(path,"wb") as f:
         try:
             res=requests.get(url,timeout=30)
             f.write(res.content)
             f.close()
             num+=1
         except:
             print("failed")
             failed_count+=1

print("download compelete!\n"+"successful{}\n failed {}".format(num,failed_count))