aiohttp异步爬虫的AJ3算法指纹反爬

Python 键盘上的舞者

于 2021-09-02 13:39:57 发布

阅读量758

点赞数 1

分类专栏：经验分享文章标签：算法 python 异步爬虫 aiohttp AJ3

本文链接：https://blog.youkuaiyun.com/Python_DJ/article/details/120059391

版权

经验分享专栏收录该内容

52 篇文章

订阅专栏

本文介绍如何使用Python的aiohttp库定制SSL连接，通过shuffling和限制cipher suite，提高网络请求的安全性和性能。作者展示了如何创建一个自定义SSL Factory实例并应用于HTTP请求中。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

import asyncio
import random
import ssl

# ssl._create_default_https_context = ssl._create_unverified_context
import aiohttp

ORIGIN_CIPHERS = ('ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:'
                  'DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES')


class SSLFactory:
    def __init__(self):
        self.ciphers = ORIGIN_CIPHERS.split(":")

    def __call__(self, *args, **kwargs) -> ssl.SSLContext:
        random.shuffle(self.ciphers)
        ciphers = ":".join(self.ciphers)
        ciphers = ciphers + ":!aNULL:!eNULL:!MD5"

        context = ssl.create_default_context()
        context.set_ciphers(ciphers)
        return context


async def main():
    sslgen = SSLFactory()
    async with aiohttp.ClientSession() as session:
        for _ in range(5):
            async with session.get("https://ja3er.com/json", headers={}, ssl=sslgen()) as response:
                data = await response.json()
            print(data)


if __name__ == '__main__':
    asyncio.get_event_loop().run_until_complete(main())