<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[yx_ming的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/yx_ming</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; yx_ming]]></copyright><item><title><![CDATA[封装 python爬虫 爬取妹子图到mysql数据库]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81951895</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81951895</guid><author>yx_ming</author><pubDate>Wed, 22 Aug 2018 22:01:48 +0800</pubDate><description><![CDATA[import requests
from lxml import etree
from mysql import MYSQL

1. 声明一个lianjia函数



def lianjia(url,headers):

    # 2.给于url路径

    # url = 'http://bj.lianjia.com/ershoufang/pg2/'

    for i in range(...]]></description><category></category></item><item><title><![CDATA[BeautifulSoup作用]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81951291</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81951291</guid><author>yx_ming</author><pubDate>Wed, 22 Aug 2018 21:18:30 +0800</pubDate><description><![CDATA[功能

BeautifulSoup是用来从HTML或XML中提取数据的Python库。 
对于不具备良好格式的 HTML 内容，lxml 提供了两个有用的包：lxml.html 模块和 BeautifulSoup 解析器。

导入

使用方法：  
from bs4 import BeautifulSoup  
soup = BeautifulSoup(html)

pycharm内导入Beaut...]]></description><category></category></item><item><title><![CDATA[简单实现webdriver网页驱动 百度搜索、简书测试]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81916672</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81916672</guid><author>yx_ming</author><pubDate>Tue, 21 Aug 2018 23:57:45 +0800</pubDate><description><![CDATA[Ⅰ、百度搜索 webdriver网页驱动测试

# 导入 selenium 下的 webdriver(网页内驱动模块)
from selenium import webdriver

# 导入 time 时间模块
import time



# websriver(网页内驱动)Chrome(谷歌浏览器)
driver = webdriver.Chrome()

# time.sleep（睡眠等待...]]></description><category></category></item><item><title><![CDATA[什么是 Selenium 和 WebDriver?]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81916491</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81916491</guid><author>yx_ming</author><pubDate>Tue, 21 Aug 2018 23:32:38 +0800</pubDate><description><![CDATA[Selenium是一个浏览器自动化操作框架。selenium主要由三种工具组成。 
1.第一个工具——SeleniumIDE，是Firefox的扩展插件，支持用户录制和回访测试。录制/回访模式存在局限性，对许多用户来说并不适合。

2.因此第二个工具——Selenium WebDriver提供了各种语言环境的API来支持更多控制权和编写符合标准软件开发实践的应用程序。

3.最后一个工具——Sel...]]></description><category></category></item><item><title><![CDATA[python基础链家网爬虫实战]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81879590</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81879590</guid><author>yx_ming</author><pubDate>Mon, 20 Aug 2018 23:20:12 +0800</pubDate><description><![CDATA[封装一个与数据库连接的MySQL类



文件命名为 mysql.py

#导入pyMySQL包
import pymysql

class MYSQL(object):
    def __init__(self):
        self.db=pymysql.connect(host='127.0.0.1',user='root',password='123456',port=3306,d...]]></description><category></category></item><item><title><![CDATA[python爬取 xueqiu网 数据 存入MySQL数据库中]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81751148</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81751148</guid><author>yx_ming</author><pubDate>Fri, 17 Aug 2018 00:37:45 +0800</pubDate><description><![CDATA[#导入包

from urllib import request 
import json 
import pymysql



#声名一个class类



class mysql_connect(object):
    # 初始化的构造函数
    def __init__(self):
        self.db = pymysql.connect(host='127.0.0.1',u...]]></description><category></category></item><item><title><![CDATA[基础反爬虫 cookie反爬  post / get 方法 函数封装]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81675897</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81675897</guid><author>yx_ming</author><pubDate>Tue, 14 Aug 2018 22:28:53 +0800</pubDate><description><![CDATA[from urllib import request,parse
from urllib.error import HTTPError,URLError



保存cookie



from http import cookiejar

class session(object):
    def __init__(self):
        cookie_object = cookiejar...]]></description><category></category></item><item><title><![CDATA[python爬虫人人网登陆]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81675776</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81675776</guid><author>yx_ming</author><pubDate>Tue, 14 Aug 2018 22:20:06 +0800</pubDate><description><![CDATA[Day1:人人网登录第一种方式

#导入模块



from urllib import request,parse 
from http import cookiejar

#保存cookie，实例化cookie

cookie = cookiejar.CookieJar() 
handler = request.HTTPCookieProcessor(cookie) 
opener = req...]]></description><category></category></item><item><title><![CDATA[python爬虫基础函数的封装]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81638298</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81638298</guid><author>yx_ming</author><pubDate>Mon, 13 Aug 2018 22:25:46 +0800</pubDate><description><![CDATA[from urllib import request,parse 
from urllib.error import HTTPError,URLError 
import json



封装get（）请求

def get(url,headers=None): 
    return  urlrequests(url,headers=headers)

封装post（）请求

def post(...]]></description><category></category></item><item><title><![CDATA[session 和 cookie的区别, 他们都是什么？]]></title><link>https://blog.youkuaiyun.com/yx_ming/article/details/81636601</link><guid>https://blog.youkuaiyun.com/yx_ming/article/details/81636601</guid><author>yx_ming</author><pubDate>Mon, 13 Aug 2018 20:45:33 +0800</pubDate><description><![CDATA[什么是Session？

1.由于HTTP协议是无状态的协议，所以服务端需要记录用户的状态时，就需要用某种机制来识具体的用户，这个机制就是Session. 
2.Session用于标识这个用户，并且跟踪用户，Session是保存在服务端的，有一个唯一标识。在服务端保存Session的方法很多，内存、数据库、文件都有。 
3.大型的网站，一般会有专门的Session服务器集群，用来保存用户会话，这个...]]></description><category></category></item></channel></rss>