qq_38904449的博客

基于web scraping with python的学习笔记 代码示例,练习:https://github.com/REMitchell/python-scraping

简单请求: from urllib.request import urlopen html = urlopen("http://pythonscraping.com/pages/page1.html") print(html) print(html.read()) 使用BeautifulSoup解析: from urllib.request import urlopen from b...

遍历单个域名 获取一个页面的所有链接 from urllib.request import urlopen from bs4 import BeautifulSoup html = urlopen("http://en.wikipedia.org/wiki/Kevin_Bacon") bs_obj = BeautifulSoup(html, "html.parser") for link i...