Python抓大乐透和双色球号码

最新推荐文章于 2024-08-23 09:32:52 发布

圆滚滚大西瓜

最新推荐文章于 2024-08-23 09:32:52 发布

阅读量1.7k

点赞数

CC 4.0 BY-SA版权

分类专栏： Python 文章标签： Python爬虫入门

本文链接：https://blog.youkuaiyun.com/qq_42078244/article/details/86696076

最近一直买大乐透和双色球,就想着抓取近几年的大乐透和双色球数据,找到网上Demo学习,下面开始教程:
工具:python3 pip3 安装requests-html
电脑:MacBook

import requests
from requests.exceptions import RequestException
from lxml import etree
count = 0
f = open('/Volumes/TF/daletoutest.txt', 'a+')
f.seek(0)


def main(num):
    url = 'http://caipiao.163.com/t/award/dlt/{}.html'.format(str(num))
    html = get_page(url)
    parse_page(html,num)


def get_page(url):
    try:
        headers = {
            'user-agent': 'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36',
            'accept-language': 'zh-CN,zh;q=0.9',
            'cache-control': 'max-age=0',
            'accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8'
        }
        response = requests.get(url=url, headers=headers)
        # 更改编码方式，否则会出现乱码的情况
        response.encoding = "utf-8"
        if response.status_code == 200