贴吧爬虫入门

转载于 2019-06-23 21:04:20 发布 · 333 阅读

0 ·

CC 4.0 BY-SA版权

原文链接：http://www.cnblogs.com/sinbad-li/p/5484803.html

文章标签：

#爬虫

此博客为转载内容，转载自https://www.cnblogs.com/sinbad-li/p/5484803.html ，原内容可能与爬虫相关。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

#saved the baidu tieba webpage

import string, urllib2

def baidu_tieba(url,begin_page,end_page):
    for i in range(begin_page,end_page+1,50):
        sName=string.zfill(i,5)+'.html'
        print 'You are downloading the No: ' +str(i)+' web page,and will be saved as '+sName+'.....'
        f=open(sName,'w+')# New open the file with 'w'
        m=urllib2.urlopen(url+str(i)).read()#open the web page and read it
        f.write(m)#write the web page to new file
        f.close()#cloase file


bdurl=str(raw_input(u'please input tieba site, delete pn=number:\n'))
begin_page=int(raw_input('enter start page number:\n'))
end_page=int(raw_input('enter end page number:\n'))

baidu_tieba(bdurl,begin_page,end_page)

转载于:https://www.cnblogs.com/sinbad-li/p/5484803.html