python爬虫selenium+firefox抓取京东商品评论

最新推荐文章于 2025-03-18 17:15:50 发布

原创最新推荐文章于 2025-03-18 17:15:50 发布 · 1.6k 阅读

5 ·

CC 4.0 BY-SA版权

python爬虫专栏收录该内容

27 篇文章

订阅专栏

本文介绍如何利用Python的Selenium库抓取京东网站上特定商品的多页用户评论信息，包括设置Firefox浏览器配置、实现翻页功能等关键技术点。

部署运行你感兴趣的模型镜像

from selenium import webdriver
from selenium.webdriver.firefox.firefox_binary import FirefoxBinary

caps=webdriver.DesiredCapabilities().FIREFOX
caps['marionette']=True
binary=FirefoxBinary(r'D:\Program Files\Firefox\firefox.exe')
driver=webdriver.Firefox(firefox_binary=binary,capabilities=caps)
driver.get('https://item.jd.com/5725260.html?jd_pop=12a9a276-18c3\
           -4502-b324-738b240534c4&abt=0#comment')
''' 
#单页评论  
com=driver.find_elements_by_css_selector('p.comment-con')
for each_com in com:
    coms=each_com.text
    print(coms)
'''

#多页评论
import time
for x in range(0,2):
    com=driver.find_elements_by_css_selector('p.comment-con')
    for each_com in com:
        coms=each_com.text
        print(coms)
    try:
        next_page=driver.find_element_by_class_name('ui-pager-next')
        next_page.click()
        time.sleep(5)
    except:
        break

'''
com=driver.find_elements_by_css_selector('div.comment-item')
for each_com in com:
    coms=each_com.text
    print(coms)#所有信息
'''
'''
com=driver.find_elements_by_css_selector('div.comment-item')
for each_com in com:
    coms=each_com.find_elements_by_css_selector('div.order-info')[0]
    print(coms.text)#所有信息中某类信息
'''

您可能感兴趣的与本文相关的镜像