python 爬虫学习笔记

最新推荐文章于 2025-06-16 11:55:48 发布

平凡的我944

最新推荐文章于 2025-06-16 11:55:48 发布

阅读量2.3k

点赞数 3

CC 4.0 BY-SA版权

分类专栏： python 爬虫文章标签： 1024程序员节

本文链接：https://blog.youkuaiyun.com/qq_59421560/article/details/120937481

本文详细记录了使用Python爬虫抓取东方财富网的资金流向数据的过程，包括获取数据、数据清洗、数据转换，并最终将数据保存为Excel文件和导入到MySQL数据库的操作。涉及到的库有requests、re、pandas和pymysql。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

爬取东方财富网的资金流向数据

获取数据

图1

只需要红框内的表格数据
按F12进入开发者界面
图2
在这里插入图片描述
再按Ctrl+R重新运行当前界面
图3

这个文件中包含我们想要的数据
点击Headers
图4

复制url
http://push2.eastmoney.com/api/qt/clist/get?cb=jQuery112304931261550818704_1635070090942&fid=f62&po=1&pz=50&pn=1&np=1&fltt=2&invt=2&ut=b2884a393a59ad64002292a3e90d46a5&fs=m%3A0%2Bt%3A6%2Bf%3A!2%2Cm%3A0%2Bt%3A13%2Bf%3A!2%2Cm%3A0%2Bt%3A80%2Bf%3A!2%2Cm%3A1%2Bt%3A2%2Bf%3A!2%2Cm%3A1%2Bt%3A23%2Bf%3A!2%2Cm%3A0%2Bt%3A7%2Bf%3A!2%2Cm%3A1%2Bt%3A3%2Bf%3A!2&fields=f12%2Cf14%2Cf2%2Cf3%2Cf62%2Cf184%2Cf66%2Cf69%2Cf72%2Cf75%2Cf78%2Cf81%2Cf84%2Cf87%2Cf204%2Cf205%2Cf124%2Cf1%2Cf13
在python中requests模块可以用get获取

import requests
url = 'http://push2.eastmoney.com/api/qt/clist/get?cb=jQuery112301936958418195105_1634991380727&fid=f62&po=1&pz=50&pn=1&np=1&fltt=2&invt=2&ut=b2884a393a59ad64002292a3e90d46a5&fs=m%3A0%2Bt%3A6%2Bf%3A!2%2Cm%3A0%2Bt%3A13%2Bf%3A!2%2Cm%3A0%2Bt%3A80%2Bf%3A!2%2Cm%3A1%2Bt%3A2%2Bf%3A!2%2Cm%3A1%2Bt%3A23%2Bf%3A!2%2Cm%3A0%2Bt%3A7%2Bf%3A!2%2Cm%3A1%2Bt%3A3%2Bf%3A!2&fields=f12%2Cf14%2Cf2%2Cf3%2Cf62%2Cf184%2Cf66%2Cf69%2Cf72%2Cf75%2Cf78%2Cf81%2Cf84%2Cf87%2Cf204%2Cf205%2Cf124%2Cf1%2Cf13'
r = requests.get(url).text
print(r)

图5