第一个简单的爬虫：存储数据

FrankHuang888

于 2024-04-23 20:22:27 发布

阅读量532

点赞数 3

文章标签：爬虫

本文链接：https://blog.youkuaiyun.com/qq_33323974/article/details/138137472

版权

本文展示了如何使用Python的requests库发送HTTP请求，并利用BeautifulSoup解析HTML来获取网页的h1标签中的标题，将抓取结果写入文件

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

import requests
from bs4 import BeautifulSoup

link = "http://www.santostang.com"
header = {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36 SE 2.X MetaSr 1.0" }
response  = requests.get(link,headers = header)
# print(response.text)
soup = BeautifulSoup(response.text,"html.parser")
title = soup.find("h1",class_ = "post-title").a.text.strip() #参数class_带下划线
print(title)

with open("ceshi.txt","a+") as f:
    f.write(title)