<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[DragonASDASD的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/DragonASDASD</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; DragonASDASD]]></copyright><item><title><![CDATA[程序打包遇到的问题]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/105710195</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/105710195</guid><author>DragonASDASD</author><pubDate>Thu, 23 Apr 2020 16:06:15 +0800</pubDate><description><![CDATA[将依赖文件放在程序目录下



a = Analysis(['trip_popu.py'],
             pathex=['E:\\GitHub\\Zone\\Zone'],
             binaries=[],
             datas=[('abc.txt', '.')],
             hiddenimports=[],
         ...]]></description><category></category></item><item><title><![CDATA[firefox]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/105575132</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/105575132</guid><author>DragonASDASD</author><pubDate>Fri, 17 Apr 2020 10:45:34 +0800</pubDate><description><![CDATA[firefox_profile = webdriver.FirefoxProfile()
firefox_profile.set_preference('permissions.default.image', 2)#某些firefox只需要这个
firefox_profile.set_preference('browser.migration.version', 9001)#部分需要加上这个
禁...]]></description><category></category></item><item><title><![CDATA[解压和压缩]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/99970725</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/99970725</guid><author>DragonASDASD</author><pubDate>Wed, 21 Aug 2019 16:07:26 +0800</pubDate><description><![CDATA[import os
import time
import shutil


a='D:/7-Zip/7z.exe'                        #7zip.exe路径
b=''        #待解压文件路径
c=''           #指定解压路径
d=''       #指定新的压缩路径




def jieya(zip_exe_path,file_path,unzip...]]></description><category></category></item><item><title><![CDATA[输出当前日期及之后一段日期]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/97799834</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/97799834</guid><author>DragonASDASD</author><pubDate>Tue, 30 Jul 2019 17:15:20 +0800</pubDate><description><![CDATA[import datetime   

arr=[]
# 现在的时间
now = datetime.datetime.now()
arr.append((str(now.strftime('%Y-%m-%d'))))
# 递增的时间
delta = datetime.timedelta(days=1)

endnow = now + datetime.timedelta(days=15)

end...]]></description><category></category></item><item><title><![CDATA[把图片改名并分别存入不同的文件夹]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/97799440</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/97799440</guid><author>DragonASDASD</author><pubDate>Tue, 30 Jul 2019 17:12:24 +0800</pubDate><description><![CDATA[import os
from PIL import Image

spath=""
d_path1=""+"\\"
d_path2=""+"\\"
d_path3=""+"\\"
for maindir, subdir, file_name_list in os.walk(spath):
    # print("1:",maindir) #当前主目录
    # print("2:",subdi...]]></description><category></category></item><item><title><![CDATA[scrapy爬取奇书网]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90488581</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90488581</guid><author>DragonASDASD</author><pubDate>Thu, 23 May 2019 21:40:28 +0800</pubDate><description><![CDATA[spiders.py
# -*- coding: utf-8 -*-
import scrapy
# 引入item
from ..items import BooksItem

class BooksSpider(scrapy.Spider):
    name = 'books'
    allowed_domains = ['qishu.cc']
    start_urls = ['http...]]></description><category></category></item><item><title><![CDATA[scrapy爬取 素材网]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90488463</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90488463</guid><author>DragonASDASD</author><pubDate>Thu, 23 May 2019 21:33:57 +0800</pubDate><description><![CDATA[spiders.py
# -*- coding: utf-8 -*-
import scrapy
# 引入数据模型类
from ..items import ImgItem

class SucaiSpider(scrapy.Spider):
    name = 'sucai'
    allowed_domains = ['sc.chinaz.com']
    start_urls = ['...]]></description><category></category></item><item><title><![CDATA[scrapy爬取 51job]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90488263</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90488263</guid><author>DragonASDASD</author><pubDate>Thu, 23 May 2019 21:22:42 +0800</pubDate><description><![CDATA[spider.py
# -*- coding: utf-8 -*-
import scrapy
# .. 上级目录  .当前目录
# 从上级目录中的items文件中引入JobSpidererItem数据模型类
from ..items import JobSpidererItem

class JobsSpider(scrapy.Spider):
    name = 'jobs'
    all...]]></description><category></category></item><item><title><![CDATA[爬取淘宝美食]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90340154</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90340154</guid><author>DragonASDASD</author><pubDate>Sun, 19 May 2019 10:54:50 +0800</pubDate><description><![CDATA[spider.py
import re

from selenium import webdriver
from selenium.common.exceptions import TimeoutException
from selenium.webdriver.common.by import  By
from selenium.webdriver.support.ui import WebDr...]]></description><category></category></item><item><title><![CDATA[scrapy框架爬取电影天堂内容]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90319008</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90319008</guid><author>DragonASDASD</author><pubDate>Sat, 18 May 2019 18:54:44 +0800</pubDate><description><![CDATA[dytt.py
# -*- coding: utf-8 -*-
import scrapy

class DyttSpider(scrapy.Spider):
    # 爬虫的名称：必须是唯一的
    name = 'dytt'
    # 规定了可以爬取的域名
    allowed_domains = ['ygdy8.net']
    # 指定要爬取的第一个网址
    start_ur...]]></description><category></category></item><item><title><![CDATA[爬取天猫top100]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90318913</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90318913</guid><author>DragonASDASD</author><pubDate>Sat, 18 May 2019 18:44:30 +0800</pubDate><description><![CDATA[# encoding:utf-8
import requests

import re

import json

from multiprocessing import Pool  # 多线程模块


# 获取网页源代码

def get_one_page(url):
    # 添加头信息

    headers = {'User-Agent': 'Mozilla/5.0 (Windows ...]]></description><category></category></item><item><title><![CDATA[存到mangoDB]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90106814</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90106814</guid><author>DragonASDASD</author><pubDate>Sat, 11 May 2019 10:48:53 +0800</pubDate><description><![CDATA[import requests
import datetime
from bs4 import BeautifulSoup
from pymongo import MongoClient
client = MongoClient('localhost',27017)
db = client.blog_database
collection = db.blog

link = "....."    ...]]></description><category></category></item><item><title><![CDATA[爬取数据存到mysql数据库]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90106722</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90106722</guid><author>DragonASDASD</author><pubDate>Sat, 11 May 2019 10:41:00 +0800</pubDate><description><![CDATA[import requests
from bs4 import BeautifulSoup
import MySQLdb
    
conn= MySQLdb.connect(host='localhost' , user='root', passwd='root', db ='scraping')
cur = conn.cursor()


link = "http://www.santosta...]]></description><category></category></item><item><title><![CDATA[人工处理验证码]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90106552</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90106552</guid><author>DragonASDASD</author><pubDate>Sat, 11 May 2019 10:28:48 +0800</pubDate><description><![CDATA[1.获取验证码动态匹配码。我们可以定义一个get_si_code()函数，它会进入注册页面，从HTML代码中用re.search方法获取si_code_reg的值，最后返回这个值。
def get_si_code():
        # si_code是一个动态变化的参数
        index_url = 'http://www.santostang.com/wp-login.php? a...]]></description><category></category></item><item><title><![CDATA[beautifulsoup实践：房屋价格数据]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90083990</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90083990</guid><author>DragonASDASD</author><pubDate>Sat, 11 May 2019 10:18:16 +0800</pubDate><description><![CDATA[import requests
from bs4 import BeautifulSoup
import time
    
    headers = {'User-Agent' : 'Mozilla/5.0 (Windows NT 6.1; WOW64)
AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.98
Safari/537....]]></description><category></category></item><item><title><![CDATA[电影天堂数据爬取]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081336</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081336</guid><author>DragonASDASD</author><pubDate>Fri, 10 May 2019 17:52:19 +0800</pubDate><description><![CDATA[# coding: utf-8
import requests
from lxml import etree
import xlwt
headers = {
    'User-Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Firefox/52.0'
}
# 1.url
url = 'http://www....]]></description><category></category></item><item><title><![CDATA[xpath的运用]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081302</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081302</guid><author>DragonASDASD</author><pubDate>Fri, 10 May 2019 17:51:04 +0800</pubDate><description><![CDATA[# coding: utf-8
import requests

lxml 包 专门用处理一些html和xml的  打开cmd命令   输入pip install lxml
引入etree模块
from lxml import etree

xpath  一组特定的规则，可以根据特殊的语法结构，匹配网页中的数据
// 从当前的标签开始查找
@ 表示获取属性或者根据属性查找
//a[@class=“...]]></description><category></category></item><item><title><![CDATA[jd_spider]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081260</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081260</guid><author>DragonASDASD</author><pubDate>Fri, 10 May 2019 17:49:22 +0800</pubDate><description><![CDATA[# coding: utf-8 
from selenium import webdriver import time


driver = webdriver.Firefox()

driver.get('https://www.jd.com')

time.sleep(2)

driver.find_element_by_id('key').send_keys(u'笔记本电脑') ele = ...]]></description><category></category></item><item><title><![CDATA[selenium]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081047</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081047</guid><author>DragonASDASD</author><pubDate>Fri, 10 May 2019 17:40:00 +0800</pubDate><description><![CDATA[# coding: utf-8

# 打开cmd命令行  输入pip install selenium 下载包
# 从selenium中引入webdriver
from selenium import webdriver
# 引入时间模块
import time
# 1.创建浏览器对象，并打开浏览器
driver = webdriver.Firefox()
# 2.在浏览器中访问网址
driver...]]></description><category></category></item><item><title><![CDATA[爬取招聘网站]]></title><link>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081007</link><guid>https://blog.youkuaiyun.com/DragonASDASD/article/details/90081007</guid><author>DragonASDASD</author><pubDate>Fri, 10 May 2019 17:38:12 +0800</pubDate><description><![CDATA[# coding: utf-8

import requests
import re
import xlwt



class ZLZP(object):

'''
http://sou.zhaopin.com/jobs/searchresult.ashx?jl=北京%2B上海%2B广州%2B深圳%2B杭州&amp;kw=python
'''

def __init__(self):
    se...]]></description><category></category></item></channel></rss>