selenium 模擬click 抓取page data

最新推荐文章于 2025-07-31 16:58:05 发布

MyFreeIT

最新推荐文章于 2025-07-31 16:58:05 发布

阅读量176

点赞数 2

CC 4.0 BY-SA版权

分类专栏： Script 文章标签： selenium 测试工具 webdriver

创作源自于MyFreeIT

本文链接：https://blog.youkuaiyun.com/MyFreeIT/article/details/141145819

一個更好用的crawler，完全模仿人為操作。

也可以用於自動化網頁測試。

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.common.by import By
import xlsxwriter

workbook   = xlsxwriter.Workbook('abc.xlsx')
worksheet = workbook.add_worksheet('contract')
driver = webdriver.Firefox()

for page in range(1, 10):
    driver.get("https://www.abc.com="+str(page))
    elem = driver.find_element(By.CLASS_NAME, "result")
    rows = elem.find_elements(By.CLASS_NAME,"row")
    rowNum = 0
    for row in rows:
        rowNum = rowNum+1
        if page >1 and rowNum ==1 :
            continue
        rowNumTotal = (page-1)*10+rowNum
        colNum = 0
        cols = row.find_elements(By.CLASS_NAME,"col")
        for col in cols:
            colNum= colNum+1
            if colNum<7:
                worksheet.write(rowNumTotal-1, colNum-1, col.text)
            elif colNum==7:
                print(col.text)
                all_a = col.fin