正则表达式之爬取妹子图

最新推荐文章于 2020-12-10 22:03:43 发布

原创最新推荐文章于 2020-12-10 22:03:43 发布 · 563 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#爬虫

re模块确实好用啊
finfall方法;
findall(string[, pos[, endpos]]) / re.findall(pattern, string[, flags]):

返回所有匹配的List

以列表形式返回全部能匹配的字串。

import re 
p = re.compile(r'\d+') 
print p.findall('one1two2three3four4') 
### output ### 
# ['1', '2', '3', '4']

利用正则表达式对百度贴吧妹子图的爬取
话不多说，上代码

import urllib.request
import re

def open_url(url):
    req = urllib.request.Request(url)
    req.add_header('User-Agent','Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36')
    page = urllib.request.urlopen(req)
    html = page.read().decode("utf-8")
    return html
def get_img(html):
    response = r'<img class="BDE_Image" src="([^"]+\.jpg)"'
    imglist = re.findall(response,html)
    '''
    for each in imglist:
        print(each)
    '''
    for each in imglist:
        filename = each.split("/")[-1]
        urllib.request.urlretrieve(each,filename,None)

if __name__ == '__main__':
    url = 'https://tieba.baidu.com/p/5911493826'
    get_img(open_url(url))