lierwang的博客

多线程爬取某网站歌手、MV及歌曲信息，解析网页元素；实现异步下载图片及记录入库操作 爬虫脚本 # -*- coding: utf-8 -*- import os import re import sys import ssl import time import _thread import requests import pymysql import threading import difflib import asyncio import aiomysql from bs4 import Bea

# -*- coding: utf-8 -*- import os import requests import pymysql import _thread #import threading # 自定义下载目录 path = 'F:/Reptilian/ysj/' # 线程锁 #lock = threading.Lock() # 线程树 threadNum = 50 # 请求头定义 ...