13、数据处理与可视化：从网页解析到图表绘制

数据处理与可视化：从网页解析到图表绘制

1. BeautifulSoup 解析实时 HTML 网页

1.1 代码示例

以下是使用 BeautifulSoup 解析实时 HTML 网页的代码示例：

from bs4 import BeautifulSoup
import re
import requests

URL = "https://www.yahoo.com"
page = requests.get(URL)
soup = BeautifulSoup(page.content, 'html.parser')

print("------------------------")
print("page before:")
print(page.text)
print("------------------------")
print()

divs = soup.find('div')
print("------------------------")
print("<div> elements:")
print(divs)
print("------------------------")
print()

tables = soup.find('tables')
print("------------------------")
print("table elements:")
print(tables)
print("------------------------")
print()

#links = soup.find('html/head/links')
links = soup.fi