<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[Hepburn_li的博客]]></title><description><![CDATA[保持长远眼光，富有冒险精神]]></description><link>https://blog.youkuaiyun.com/Hepburn_li</link><language>zh-cn</language><generator>https://blog.youkuaiyun.com/</generator><copyright><![CDATA[Copyright &copy; Hepburn_li]]></copyright><item><title><![CDATA[使用crontab执行定时任务时加flock独占锁防止进程堆积]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/104542257</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/104542257</guid><author>Hepburn_li</author><pubDate>Thu, 27 Feb 2020 18:31:58 +0800</pubDate><description><![CDATA[使用crontab执行定时任务,此处为每分钟执行一次,加flock独占锁防止进程堆积。注意给/var/run/读写权限，或者放到一个有读写权限的文件夹。
*/1 * * * * flock -xn /var/run/test.lock -c /home/mikasa/test.sh &gt;&gt; /home/mikasa/test_sh_log.log 2&gt;&amp;1

test.sh...]]></description><category></category></item><item><title><![CDATA[pyppeteer文档]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/103904495</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/103904495</guid><author>Hepburn_li</author><pubDate>Thu, 09 Jan 2020 11:16:01 +0800</pubDate><description><![CDATA[https://miyakogi.github.io/pyppeteer/reference.html

]]></description><category></category></item><item><title><![CDATA[定时拷贝删除文件命令]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/103894190</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/103894190</guid><author>Hepburn_li</author><pubDate>Wed, 08 Jan 2020 16:45:08 +0800</pubDate><description><![CDATA[拷贝文件夹，会把这个文件夹下的文件拷贝到oss的img文件夹下要加/，不然会重命名为img的文件，而不拷贝iiimg文件夹本身
./ossutil64 cp /home/leite/iiimg/ oss://elatemall/img/ -rf
./ossutil64 cp /home/leite/iiimg/ oss://elatemall/img/ -rf --update 增量上传
./os...]]></description><category></category></item><item><title><![CDATA[linux后台运行进程方法]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/103648018</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/103648018</guid><author>Hepburn_li</author><pubDate>Sat, 21 Dec 2019 20:23:00 +0800</pubDate><description><![CDATA[后台运行进程方法
# 安装screen
sudo apt install screen
# 执行命令
screen
# 按enter打开新的窗口，输入要执行的命令，比如appium
appium
# 返回出界面
ctrl+a+d
# 查看子界面
screen -ls
# 回到子界面
screen –r [子页面序号]

也可以使用：
# 进入文件目录
nohup python3 -u name.p...]]></description><category></category></item><item><title><![CDATA[ubuntu18.04搭建appium环境]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/103647993</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/103647993</guid><author>Hepburn_li</author><pubDate>Sat, 21 Dec 2019 20:20:03 +0800</pubDate><description><![CDATA[ubuntu18.04搭建appium环境
一、安装nodejs和npm
``
# 首先更新源及工具
sudo apt-get update
sudo apt-get upgrade
# 执行命令，此方法安装的版本比较老旧
sudo apt-get install nodejs
sudo apt-get install npm
# 升级nodejs
# 清除node缓存
sudo npm cach...]]></description><category></category></item><item><title><![CDATA[ubuntu安装配置nginx]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/102866210</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/102866210</guid><author>Hepburn_li</author><pubDate>Fri, 01 Nov 2019 23:15:03 +0800</pubDate><description><![CDATA[安装配置nginx
更新源
apt-get update
依赖包安装
sudo apt-get ``install openssl libssl-dev
wget  http://www.zlib.net/zlib-1.2.11.tar.gz
tar  zxvf  zlib-1.2.11.tar.gz
cd zlib-1.2.11
① ./configure         //在解压软件目录内部...]]></description><category></category></item><item><title><![CDATA[Python抓取实时变化的 WebSocket 数据]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/102498428</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/102498428</guid><author>Hepburn_li</author><pubDate>Fri, 11 Oct 2019 11:43:51 +0800</pubDate><description><![CDATA[参考一下文章
https://mp.weixin.qq.com/s?__biz=MzIzNzA4NDk3Nw==&amp;mid=2457737214&amp;idx=1&amp;sn=36e1446625ec643f765d9cf8e7dd3170&amp;chksm=ff44bfa0c83336b60c5334ddb2ec954def04c3c37f989ae3b1945a200c0a87e3...]]></description><category></category></item><item><title><![CDATA[python一行代码获取前一个月，前一天时间]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/93890786</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/93890786</guid><author>Hepburn_li</author><pubDate>Thu, 27 Jun 2019 17:12:08 +0800</pubDate><description><![CDATA[https://www.jb51.net/article/146561.htm

]]></description><category></category></item><item><title><![CDATA[mysql查询时间戳和日期的转换及查询当天插入记录]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/91889121</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/91889121</guid><author>Hepburn_li</author><pubDate>Thu, 13 Jun 2019 19:45:25 +0800</pubDate><description><![CDATA[mysql提供了两个函数:
 from_unixtime(time_stamp)   -&gt;  将时间戳转换为日期
 
 unix_timestamp(date)   -&gt;  将指定的日期或者日期字符串转换为时间戳

如果要查询当天的订单的记录:
select count(*) from b_order Where  date_format(from_unixtime(create_ti...]]></description><category></category></item><item><title><![CDATA[python删除redis数据库中的键]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/91447313</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/91447313</guid><author>Hepburn_li</author><pubDate>Tue, 11 Jun 2019 16:45:07 +0800</pubDate><description><![CDATA[from redis import Redis
redis_db = Redis(host=REDIS_HOST, port=REDIS_PORT, db=REDIS_DB)
redis_db.delete(key, )


]]></description><category></category></item><item><title><![CDATA[python文件设置日志]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/91412488</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/91412488</guid><author>Hepburn_li</author><pubDate>Tue, 11 Jun 2019 09:54:39 +0800</pubDate><description><![CDATA[# 导入模块
import logging
# 配置输出格式
log_format = "%(asctime)s - %(levelname)s - %(message)s"  # 日志输出格式
logging.basicConfig(filename='tracklog.log', filemode='a', level=logging.DEBUG, format=log_format)
 # ...]]></description><category></category></item><item><title><![CDATA[scrapy使用selenium时爬虫关闭浏览器的方法]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/91039747</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/91039747</guid><author>Hepburn_li</author><pubDate>Thu, 06 Jun 2019 10:16:05 +0800</pubDate><description><![CDATA[这里是官方提供的最新的方法
from scrapy import signals
# 此为官方推荐的信号使用方法，用来关闭浏览器
@classmethod
def from_crawler(cls, crawler, *args, **kwargs):

   spider = super(YourSpider, cls).from_crawler(crawler, *args, **kwargs...]]></description><category></category></item><item><title><![CDATA[scrapy.Request构造请求时，无法得到数据]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/91039572</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/91039572</guid><author>Hepburn_li</author><pubDate>Thu, 06 Jun 2019 10:08:27 +0800</pubDate><description><![CDATA[这可能是因为没有数据的链接被过滤，会影响下边数据的获取。
可尝试在参数中添加
dont_filter=True
scrapy.Request(url, self.parse, dont_filter=True)

启用不过滤

]]></description><category></category></item><item><title><![CDATA[twisted.internet.error.TimeoutError错误的解决方法]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/90814471</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/90814471</guid><author>Hepburn_li</author><pubDate>Tue, 04 Jun 2019 22:19:27 +0800</pubDate><description><![CDATA[少数链接会出现请求超时，当出现请求超时时，爬虫会自动重试三次，若超过180s且三次后仍没有得到数据，就会放弃请求出现twisted.internet.error.TimeoutError 错误。此时就出现了爬取失败的情况。
原因：当网络无法满足在180s内下载完所有的请求数量，就会出现此类错误。
解决办法：这里做个示例，具体情况具体分析
1、降低同时请求的数量
CONCURRENT_REQUEST...]]></description><category></category></item><item><title><![CDATA[Python requests 设置verify=False移除SSL认证时，解决InsecureRequestWarning警告。]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/90672714</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/90672714</guid><author>Hepburn_li</author><pubDate>Wed, 29 May 2019 16:01:15 +0800</pubDate><description><![CDATA[添加 requests.packages.urllib3.disable_warnings()
requests.packages.urllib3.disable_warnings()
content = requests.get(url, verify=False)


]]></description><category></category></item><item><title><![CDATA[Linux统计文件夹、文件数量的命令]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/90641615</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/90641615</guid><author>Hepburn_li</author><pubDate>Tue, 28 May 2019 16:17:27 +0800</pubDate><description><![CDATA[查看当前目录下的文件数量（不包含子目录中的文件）

ls -l|grep "^-"| wc -l
查看当前目录下的文件数量（包含子目录中的文件） 注意：R，代表子目录

ls -lR|grep "^-"| wc -l
查看当前目录下的文件夹目录个数（不包含子目录中的目录），同上述理，如果需要查看子目录的，加上R

ls -l|grep "^d"| wc -l
查询当前路径下的指定前缀名的目录下的所...]]></description><category></category></item><item><title><![CDATA[使用pip安装时出现pip._vendor.requests.exceptions.HTTPError: 404 Client Error: Not Found for url:的解决方法]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/90513791</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/90513791</guid><author>Hepburn_li</author><pubDate>Fri, 24 May 2019 11:43:54 +0800</pubDate><description><![CDATA[solution:
实际上是pkg-resoures中还有没有完全同步的资源.可以修改pip.conf为国外的源, 先备份, 更新后再备份过来. 以unbuntu 为例:
mv /root/.pip/pip.conf  /root/.pip/pip.conf.bk
vi /root/.pip/pip.conf 

修改如下:
[global]
#index-url=http://mirrors.a...]]></description><category></category></item><item><title><![CDATA[ubuntu安装chrome]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/90482340</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/90482340</guid><author>Hepburn_li</author><pubDate>Thu, 23 May 2019 16:04:17 +0800</pubDate><description><![CDATA[又在网上搜索，下面方法可行：
复制代码 代码如下:
Download google chrome for ubuntu from terminal with the following command:
For the 32-bit version of Google Chrome, use this command below.
wget https://dl.google.com/linux/...]]></description><category></category></item><item><title><![CDATA[python函数内说明文档使用]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/90443360</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/90443360</guid><author>Hepburn_li</author><pubDate>Wed, 22 May 2019 14:28:43 +0800</pubDate><description><![CDATA[示例如下：
def func(self):
        '''
        它的首行简述函数功能，第二行空行，第三行为函数的具体描述。

        此函数的具体描述在这里
        '''
        print(abc)
print(func.__doc__)  # 与def对齐,__是双下划线，获取上边的说明文档
 


...]]></description><category></category></item><item><title><![CDATA[python往mysql存入数据时可能会断开连接的解决方法]]></title><link>https://blog.youkuaiyun.com/Hepburn_li/article/details/90379162</link><guid>https://blog.youkuaiyun.com/Hepburn_li/article/details/90379162</guid><author>Hepburn_li</author><pubDate>Mon, 20 May 2019 17:38:19 +0800</pubDate><description><![CDATA[执行sql语句前先执行这个代码
    self.conn.ping(reconnect=True)  # 若mysql连接失败就重连


]]></description><category></category></item></channel></rss>