xpath练习

做个不一样的小丑

于 2021-03-16 19:33:55 发布

阅读量742

点赞数

CC 4.0 BY-SA版权

分类专栏： python基础 Python爬虫文章标签： python 买家秀斗图网

本文链接：https://blog.youkuaiyun.com/hmh4640219/article/details/114896135

买家秀

http://www.tbqq.net/
爬取图片与名字

import requests
import os
from lxml import etree
from urllib import request
import threading

def maijiaxiu(url,page):
    res = requests.get(url=url,headers=headers)
    # print(res.text)
    content = res.text
    tree = etree.HTML(content)
    li_list = tree.xpath('//li[@class="deanactions fadeInUp"]')
    # print(len(li_list))
    path = f'maijiaxiu{page}'
    if not os.path.exists(path):
        os.mkdir(path)
    for li in li_list:
        # forum.php?mod=image&aid=8329&size=280x350&key=52eae99ad14ec1b8
        # 匹配到的src没有对应的后缀