4 使用xpath解析豆瓣短评

建议用xpath不用beatifulsoup

第二种手写xpath

---

完整代码

import requests

from lxml import etree

url ='https://movie.douban.com/subject/6874741/comments?status=P'

r = requests.get(url).text

s=etree.HTML(r)

#print(s.xpath('//*[@id="comments"]/div/div[2]/p/text()')) #浏览器复制

print(s.xpath('//div[@class="comment"]/p/text()')) #手写

---

答题中心

解析：在所有元素中找，只有class='name'这个类的元素都给找出来

//*[@id="paper"]/a/div[2]/text() b答案错在[@id="paper"]

---

简书当页所有书面代码

import requests

from lxml import etree

url ='http://www.jianshu.com/publications'

r = requests.get(url).text

s=etree.HTML(r)

#print(s.xpath('//*[@id="comments"]/div/div[2]/p/text()')) #浏览器复制

print(s.xpath(' //*[@class="name"]/text()')) #手写

---

糗百所有博主昵称完整代码

import requests

from lxml import etree

url ='https://www.qiushibaike.com/text/'

r = requests.get(url).text

s=etree.HTML(r)

#print(s.xpath('//*[@id="comments"]/div/div[2]/p/text()')) #浏览器复制

print(s.xpath('//*[@id="content-left"]/div/div[1]/a[2]/h2/text()')) #手写

运行结果示例：

---

---

图片链接代码

import requests

from lxml import etree

url ='https://www.jianshu.com/publications#paper'

r = requests.get(url).text

s=etree.HTML(r)

#print(s.xpath('//*[@id="comments"]/div/div[2]/p/text()')) #浏览器复制

print(s.xpath('//*[@id="paper"]/a[1]/div[1]/img/@src')) #手写

---