Python自动化（二）使用Beautifu Soup爬取电影下载链接

爬取电影信息

最新推荐文章于 2025-04-22 15:26:15 发布

原创最新推荐文章于 2025-04-22 15:26:15 发布 · 置顶 · 647 阅读

2 ·

CC 4.0 BY-SA版权

文章标签：

#python #自动化

Python 专栏收录该内容

25 篇文章

订阅专栏

本文介绍了一个使用Python的BeautifulSoup库从指定网站爬取电影名称及其迅雷下载链接的方法。通过发送HTTP请求获取网页内容，解析HTML文档并提取所需的电影名称及下载链接。

#coding:utf-8
from bs4 import BeautifulSoup
import requests
import codecs
host = "http://www.poxiao.com"
url = "http://www.poxiao.com/mtype5.html"
html_doc = requests.get(url).content.decode("GBK")
with codecs.open("poxiao.html","w",encoding="GBK") as f:
    f.write(html_doc)
poxiao = BeautifulSoup(html_doc,"lxml")
div_content = poxiao.find(name="div",attrs={"class":"content"})
movies = div_content.find_all("h3")
for movie in movies:
    print movie.text
    movie_url = host+movie.a.get("href")
    movie_content = requests.get(movie_url).content
    movie_soup = BeautifulSoup(movie_content,"lxml")
    try:
        thunder_link = movie_soup.find("input",attrs={"name":"checkbox2"})
        print thunder_link.get("value")
    except:
        print "获取链接失败"