<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[susu4513的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/susu4513</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; susu4513]]></copyright><item><title><![CDATA[爬虫学习笔记-实战爬取快代理]]></title><link>https://blog.youkuaiyun.com/susu4513/article/details/121201545</link><guid>https://blog.youkuaiyun.com/susu4513/article/details/121201545</guid><author>susu4513</author><pubDate>Mon, 08 Nov 2021 09:28:04 +0800</pubDate><description><![CDATA[爬取快代理网站内容

二话不说，码来！！！





















完整代码如下：


import requests
from bs4 import BeautifulSoup
import time


headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36'
]]></description><category></category></item><item><title><![CDATA[爬虫学习笔记-实战爬取豆瓣TOP250（慎重）]]></title><link>https://blog.youkuaiyun.com/susu4513/article/details/121192315</link><guid>https://blog.youkuaiyun.com/susu4513/article/details/121192315</guid><author>susu4513</author><pubDate>Sun, 07 Nov 2021 15:45:26 +0800</pubDate><description><![CDATA[使用reques库和BeautifuSoup库

注意爬取数量，楼主把内容全爬导致IP被检测了。。。。。

二话不说，码来！















完整代码如下：


import requests
from bs4 import BeautifulSoup


headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/9]]></description><category></category></item><item><title><![CDATA[爬虫学习笔记-xpth实战项目]]></title><link>https://blog.youkuaiyun.com/susu4513/article/details/121174962</link><guid>https://blog.youkuaiyun.com/susu4513/article/details/121174962</guid><author>susu4513</author><pubDate>Sat, 06 Nov 2021 10:00:01 +0800</pubDate><description><![CDATA[ZOL笑话大全网爬取笑话标题和笑话内容文字。

二话不说，码来！

完整代码如下：


import requests
from lxml import etree
import time
import json


headers = {
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36'
]]></description><category></category></item><item><title><![CDATA[爬虫学习笔记-xpath]]></title><link>https://blog.youkuaiyun.com/susu4513/article/details/121174302</link><guid>https://blog.youkuaiyun.com/susu4513/article/details/121174302</guid><author>susu4513</author><pubDate>Sat, 06 Nov 2021 09:00:32 +0800</pubDate><description><![CDATA[Xpath使用

使用//获取整个页面当中的元素，然后写标签名，然后再写谓词进行提取，比如：//title[@lang='en']


//ul[@class="article-list"]/li[@class="article-summary"]//a[@class="all-read"]/@href

注意：
1./和//的区别：/代表只获取子节点，//获取子孙节点，一般//用的比较多，视情况而定
2.contains:有时候某个属性中包含了多个属性值，那么可以使用constains函数，如：//t..]]></description><category></category></item></channel></rss>