<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[D18346的博客]]></title><description><![CDATA[]]></description><link>https://blog.youkuaiyun.com/D18346</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; D18346]]></copyright><item><title><![CDATA[Scrapy框架原理与使用流程]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143168595</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143168595</guid><author>D18346</author><pubDate>Tue, 22 Oct 2024 22:02:07 +0800</pubDate><description><![CDATA[在数据管道处理的第一步中，我们定义一个继承自`scrapy.Item`的类，这个类通过使用`scrapy.Field()`定义字段，来存储我们需要爬取的数据。`scrapy.Item`，这个类通过使用`scrapy.Field()`定义字段，来存储我们需要爬取的数据。我们需要存几个字段的数据就定义几个字段的值， 字段名= scrapy.Field()]]></description><category></category></item><item><title><![CDATA[Selenium处理验证码]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143167438</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143167438</guid><author>D18346</author><pubDate>Tue, 22 Oct 2024 20:54:56 +0800</pubDate><description><![CDATA[防止恶意破解密码、刷票、论坛灌水、刷页。有效防止某个黑客对某一个特定注册用户用特定程序暴力破解方式进行不断的登录尝试，现在也用于反爬虫 风控这块。]]></description><category></category></item><item><title><![CDATA[selenium与request的区别]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143135366</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143135366</guid><author>D18346</author><pubDate>Mon, 21 Oct 2024 22:42:28 +0800</pubDate><description><![CDATA[selenium自动化一般可打开好几个网址，模拟登录自动化脚本。request一般只访问一个网址。]]></description><category></category></item><item><title><![CDATA[Selenium进阶:动作链＋窗口切换＋元素等待]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143133207</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143133207</guid><author>D18346</author><pubDate>Mon, 21 Oct 2024 22:36:50 +0800</pubDate><description><![CDATA[抛出异常 隐式等待是全局性的 只需要设置一次 即运行过程中，如果元素可以定位到，它不会影响代码运行，但如果定位不到，则它会以轮询的方式不断地访问元素直到元素被找到，若超过指定时间，则抛出异常。显式等待利用`WebDriverWait`配合条件判断（`until`或`until_not`）进行元素定位，只有当元素出现或满足指定条件时才执行后续操作，若超时未满足条件则抛出异常。method：指定预期条件的判断方法，在等待期间，每隔一段时间调用该方法，判断元素是否存在，直到元素出现。（2）使用无界面模式。]]></description><category></category></item><item><title><![CDATA[使用selenium 爬取苏宁任意关键字的商品]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143132480</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143132480</guid><author>D18346</author><pubDate>Mon, 21 Oct 2024 20:50:51 +0800</pubDate><description><![CDATA[【代码】使用selenium 爬取苏宁任意关键字的商品。]]></description><category></category></item><item><title><![CDATA[Selenium自动化测试工具]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143123377</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143123377</guid><author>D18346</author><pubDate>Mon, 21 Oct 2024 20:48:48 +0800</pubDate><description><![CDATA[Selenium的核心功能之一是测试软件在不同浏览器和操作系统上的兼容性，确保软件功能与用户需求的一致性，提升用户体验。]]></description><category></category></item><item><title><![CDATA[爬彼岸图网]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143121365</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143121365</guid><author>D18346</author><pubDate>Mon, 21 Oct 2024 18:38:02 +0800</pubDate><description><![CDATA[【代码】爬彼岸图网。]]></description><category></category></item><item><title><![CDATA[图片爬取实例]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143117583</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143117583</guid><author>D18346</author><pubDate>Mon, 21 Oct 2024 17:18:36 +0800</pubDate><description><![CDATA[【代码】图片爬取实例。]]></description><category></category></item><item><title><![CDATA[代理与模拟登录]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143099789</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143099789</guid><author>D18346</author><pubDate>Sun, 20 Oct 2024 22:56:31 +0800</pubDate><description><![CDATA[我们用程序访问人家网站，请求次数一下很多 不像人在访问，有些网站就会封掉你的IP 封了以后，当前的IP就不能访问这个网站，爬不了这个数据。]]></description><category></category></item><item><title><![CDATA[爬虫之数据存储====Mysql]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143079332</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143079332</guid><author>D18346</author><pubDate>Sat, 19 Oct 2024 15:33:02 +0800</pubDate><description><![CDATA[【代码】爬虫之数据存储====Mysql。]]></description><category></category></item><item><title><![CDATA[爬虫之数据存储====Excel]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143030419</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143030419</guid><author>D18346</author><pubDate>Thu, 17 Oct 2024 23:09:16 +0800</pubDate><description><![CDATA[【代码】爬虫之数据存储====Excel。]]></description><category></category></item><item><title><![CDATA[爬取链家100页租房字段：标题，价格，房屋介绍，房屋标签，房屋位置]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/143029811</link><guid>https://blog.youkuaiyun.com/D18346/article/details/143029811</guid><author>D18346</author><pubDate>Thu, 17 Oct 2024 22:16:18 +0800</pubDate><description><![CDATA[若爬取100页出现人机认证。]]></description><category></category></item><item><title><![CDATA[爬取安居客 所有条数的租房字段数据 使用xpath取出标题 价格 标签 地址 房屋信息]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/142770916</link><guid>https://blog.youkuaiyun.com/D18346/article/details/142770916</guid><author>D18346</author><pubDate>Wed, 16 Oct 2024 22:25:15 +0800</pubDate><description><![CDATA[1.确定目标url：‘https。2.发起请求，获得响应。]]></description><category></category></item><item><title><![CDATA[爬虫之数据解析====xpath]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/142769484</link><guid>https://blog.youkuaiyun.com/D18346/article/details/142769484</guid><author>D18346</author><pubDate>Tue, 08 Oct 2024 21:58:53 +0800</pubDate><description><![CDATA[xpath方法 返回的是列表 列表的数据 默认是Elementprint('/html/body/div/ul/li')) #获取这所有的liprint('body/div/ul/li')) #获取这所有的liprint('//li')) #获取这所有的li。]]></description><category></category></item><item><title><![CDATA[爬取 番组计划 每一条图书字段的值]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/142765092</link><guid>https://blog.youkuaiyun.com/D18346/article/details/142765092</guid><author>D18346</author><pubDate>Tue, 08 Oct 2024 20:44:44 +0800</pubDate><description><![CDATA[1.用CTRL＋F查询检索运行结果。2.如查不到可能是因为乱码了。meta标签→charset。]]></description><category></category></item><item><title><![CDATA[爬虫之数据处理（HTML）----bs4（css选择器）]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/142714045</link><guid>https://blog.youkuaiyun.com/D18346/article/details/142714045</guid><author>D18346</author><pubDate>Tue, 08 Oct 2024 17:22:19 +0800</pubDate><description><![CDATA[BeautifulSoup用来解析HTML比较简单，API非常热人性化，支持css选择器，python标准库中的HTML解释器，也支持lxml的xml解释器。BeautifulSoup是一个可以从HTML或XML文件中提取数据的python库。.   →   class选择器。>   →   子代后代选择器。#   →   id选择器。]]></description><category></category></item><item><title><![CDATA[爬虫之数据解析----jsonpath]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/142713890</link><guid>https://blog.youkuaiyun.com/D18346/article/details/142713890</guid><author>D18346</author><pubDate>Sat, 05 Oct 2024 13:58:04 +0800</pubDate><description><![CDATA[【代码】爬虫之数据解析----jsonpath。]]></description><category></category></item><item><title><![CDATA[腾讯招聘爬取10页（练习翻页）]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/142713707</link><guid>https://blog.youkuaiyun.com/D18346/article/details/142713707</guid><author>D18346</author><pubDate>Sat, 05 Oct 2024 13:37:53 +0800</pubDate><description><![CDATA[【代码】腾讯招聘爬取10页（练习翻页）]]></description><category></category></item><item><title><![CDATA[爬虫之数据解析----JSON]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/142709626</link><guid>https://blog.youkuaiyun.com/D18346/article/details/142709626</guid><author>D18346</author><pubDate>Sat, 05 Oct 2024 02:46:38 +0800</pubDate><description><![CDATA[JSON是一种轻量级的数据交换格式，他使人们更容易的进行阅读和编写。同时也方便了机器进行解析和生成。适用于进行数据交互的场景，比如网站前台与后台之间的数据交互。前端（JS,HTML,CSS)   →JSON   →   后端（python）后端（python）   →   JSON   →   前端（JS,HTML,CSS)]]></description><category></category></item><item><title><![CDATA[将爬取的内容实现一一对应输出]]></title><link>https://blog.youkuaiyun.com/D18346/article/details/142707862</link><guid>https://blog.youkuaiyun.com/D18346/article/details/142707862</guid><author>D18346</author><pubDate>Fri, 04 Oct 2024 21:45:28 +0800</pubDate><description><![CDATA[【代码】将爬取的内容实现一一对应输出。]]></description><category></category></item></channel></rss>