常见爬虫技术要点

˚天霸动霸Tua

于 2018-11-30 14:55:42 发布

阅读量630

点赞数

分类专栏： python 文章标签：爬虫 python 反爬

本文链接：https://blog.youkuaiyun.com/kaikai0803/article/details/84644593

版权

本文探讨了爬虫技术的关键点，包括设置User Agent和Headers、使用Cookies、下载延迟策略、处理Ajax接口、对付数据懒加载、识别隐藏标签、正则表达式应用、Selenium模拟浏览器以及如何解析特殊字体。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

常见爬虫技术要点

UA
headers > cookies
Dowmload Delay
Ajax接口
数据懒加载
隐藏标签
re
selenium模拟
IP代理
特殊字体解析

字体解析示例

# 字体文件base64编码
base_str = 'AAEAAAALAIAAAwAwR1NVQiCLJXoAAAE4AAAAVE9TLzL4XQjtAAABjAAAAFZjbWFwq8B/ZwAAAhAAAAIuZ2x5ZuWIN0cAAARYAAADdGhlYWQT0/1vAAAA4AAAADZoaGVhCtADIwAAALwAAAAkaG10eC7qAAAAAAHkAAAALGxvY2ED7gSyAAAEQAAAABhtYXhwARgANgAAARgAAAAgbmFtZTd6VP8AAAfMAAACanBvc3QFRAYqAAAKOAAAAEUAAQAABmb+ZgAABLEAAAAABGgAAQAAAAAAAAAAAAAAAAAAAAsAAQAAAAEAAOs9nqhfDzz1AAsIAAAAAADYJlkvAAAAANgmWS8AAP/mBGgGLgAAAAgAAgAAAAAAAAABAAAACwAqAAMAAAAAAAIAAAAKAAoAAAD/AAAAAAAAAAEAAAAKADAAPgACREZMVAAObGF0bgAaAAQAAAAAAAAAAQAAAAQAAAAAAAAAAQAAAAFsaWdhAAgAAAABAAAAAQAEAAQAAAABAAgAAQAGAAAAAQAAAAEERAGQAAUAAAUTBZkAAAEeBRMFmQAAA9cAZAIQAAACAAUDAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFBmRWQAQJR2n6UGZv5mALgGZgGaAAAAAQAAAAAAAAAAAAAEsQAABLEAAASxAAAEsQAABLEAAASxAAAEsQAABLEAAASxAAAEsQAAAAAAB

最低0.47元/天解锁文章