Python-爬取2010-2018和讯年度社会责任报告_爬取社会责任报告-优快云博客

本文链接：https://blog.youkuaiyun.com/ginkgo1219/article/details/104819882

本想直接json.loads()，结果网页json试了几种方法就是转不了格式，也不知道为啥。而且得到的数据也不怎么会存储，等找到更好地方法来更新。

# -*- coding: utf-8 -*-
from time import sleep
from pyquery import PyQuery as pq
import re,requests,argparse,csv
import pandas as pd
import numpy as np

def getdate(url):
	headers = {
   
		'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.132 Safari/537.36',
		'Cookie': 'UM_distinctid=170b8aa056f144-074c1185d12ebb-4313f6a-e1000-170b8aa05703b4; ASL=18329,0000z,2404b15f; ADVC=38432d7145211e; vjuids=9096406ec.170b8aa0ade.0.1eb47072712f5; vjlast=1583646117.1583646117.30; hexunATC=hexun,1676,19791,19947,1583646189348,https%3A%2F%2Fh01hxsame.hexun.com%2Fs%3Fz%3Dhexun%26c%3D1676%26op%3D1; cn_1263247791_dplus=%7B%22distinct_id%22%3A%20%22170b8aa056f144-074c1185d12ebb-4313f6a-e1000-170b8aa05703b4%22%2C%22userFirstDate%22%3A%20%2220200308%22%2C%22userID%22%3A%20%22%22%2C%22userName%22%3A%20%22%22%2C%22userType%22%3A%20%22nologinuser%22%2C%22userLoginDate%22%3A%20%2220200308%22%7D; __jsluid_h=642d73b511ae9253ac0724519b48614d; Hm_lvt_cb1b8b99a89c43761f616e8565c9107f=1583646202; HexunTrack=SID=20200308134154013aab19d532e4540798c07f2d877a151a7&CITY=34&TOWN=340100&#