实际案例解决RuntimeError: An attempt has been made to start a new process before the current pr

最新推荐文章于 2025-03-16 09:30:25 发布

spiritLHL

最新推荐文章于 2025-03-16 09:30:25 发布

阅读量1.3k

点赞数 3

分类专栏： python爬虫文章标签： python

本文链接：https://blog.youkuaiyun.com/spiritLHL/article/details/105869848

版权

import requests
from bs4 import BeautifulSoup
import re
from multiprocessing import Pool



def get_video_data(dic):
    headers = {
   
        'User-Agent': "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.122 Safari/537.36"
    }
    #使用线程池对视频数据进行请求（较为耗时的堵塞操作）
    url = dic['url']
    print(dic['name'], '正在下载')
    data = requests.get(url=url