python爬虫/笔记（一）

最新推荐文章于 2021-10-24 13:08:37 发布

g_fllower

最新推荐文章于 2021-10-24 13:08:37 发布

阅读量849

点赞数

CC 4.0 BY-SA版权

分类专栏： python 文章标签： python

本文链接：https://blog.youkuaiyun.com/g_fllower/article/details/81984316

一、准备

1、爬取url：http://www.7724.com/new-hot.html 页面上的排名前13个游戏名称与图片，并把图片下载到电脑本地

2、使用的python版本为3.6

二、代码

#-*-coding:utf-8-*-
import requests,time,re,urllib
from lxml import html
from lxml import etree
from bs4 import BeautifulSoup

def resolveXpath(xpathGet):
    for index in range(len(xpathGet)):
        if (index % 2) == 0:
            tagGet = xpathGet[index].tag
            attribGet = xpathGet[index].attrib
            text = xpathGet[index].text
    return tagGet, attribGet, text

ticks = time.time()
imgBase = 'D:/imgSave/'

url = 'http://www.7724.com/new-hot.html'

cookie = {}
raw_cookie = 'Cookie: aliyungf_tc=AQAAADgU4VdCvggAnkHidOrA7UvoNOqm; PHPSESSID=d25a29dd4c960b85916b80eaa2671b34; qqes_c_t_diuu=d3cbab9bb6443f72b6167daa7413374c; referer_host=www.7724.com; uid=6291849; username=w2844398290; sign=a76ff3933f9f307e6630f13e31418c84; nickname=g_follower; headimg=http%3A%2F%2Ftvax3.sinaimg.cn%2Fcrop.0.0.996.9