selenium 模拟登陆

最新推荐文章于 2025-07-05 02:44:17 发布

qq_42052864

最新推荐文章于 2025-07-05 02:44:17 发布

阅读量275

点赞数

分类专栏：爬虫文章标签：爬虫 selenium 模拟登陆

爬虫专栏收录该内容

13 篇文章

订阅专栏

本文通过实例演示了如何使用Selenium与PhantomJS进行网页自动化操作，包括登录豆瓣网站及抓取简书文章的详细信息，如作者、发表日期、字数、浏览量、评论数和喜欢数。

#Selnium 和 PhantomJS的配合使用
#模拟浏览器操作
from selenium import webdriver
driver = webdriver.PhantomJS()
driver.get('https://www.douban.com/')
driver.implicitly_wait(5)
driver.find_element_by_id('form_email').clear()
driver.find_element_by_id('form_email').send_keys('xxxxxxxxx')
driver.find_element_by_id('form_password').clear()
driver.find_element_by_id('form_password').send_keys('xxxxxxxxxx')
driver.find_element_by_class_name('bn-submit').click()
print(driver.page_source)
with open('hello.html', 'w', encoding='utf-8') as f:
    f.write(driver.page_source)

#获取异步加载数据

from selenium import webdriver
driver = webdriver.PhantomJS()
driver.get('https://www.jianshu.com/p/aa4a1829840f')
include_title = []
driver.implicitly_wait(20)
author = driver.find_element_by_xpath('//span[@class="name"]/a').text
date = driver.find_element_by_xpath('//span[@class="publish-time"]').text
word = driver.find_element_by_xpath('//span[@class="wordage"]').text
view = driver.find_element_by_xpath('//span[@class="views-count"]').text
comment = driver.find_element_by_xpath('//span[@class="comments-count"]').text
like = driver.find_element_by_xpath('//span[@class="likes-count"]').text
included_names = driver.find_elements_by_xpath('//div[@class="include-collection"]/a/div')
for i in included_names:
    include_title.append(i.text)
print(author, date, word, view, comment, like, include_title)