u014775723的博客

使用Join时出现错误TypeError: sequence item 1: expected str instance, int found原因是：应该将list转为string即使用str()result3 = join(str(['',1,3,4]))

1.urlparse,urljoin库python2import urlparseurl = urlparse.urlparse('https://mp.youkuaiyun.com/postlist')url2 = urlparse.urljoin('https://www.cnblogs.com/itlqs/p/6055365.html', 'aaaaaaa')python3fro...

转载自https://blog.youkuaiyun.com/u010138758/article/details/80152151

若图1当中的sinaSpider想要导入图二上层目录的cookies文件，则图1图2from .cookies import cookies

简述Item在Spider中被收集后，会传入Item pipeline中进行处理。Item pipeline当中的类负责接收Item，并对item执行一些操作（清理，丢弃，验证，去重，存数据库等）。在setting.py文件中进行配置# mongodb数据库相关连接MONGO_DB_URI = '127.0.0.1'MONGO_DB_PORT = 27017MONGO_DB_N...

准备工作：1.python安装好pymongopip install pymongo2.本机安装mongoDB详情见参考文章：https://blog.youkuaiyun.com/u014705021/article/details/51777123https://www.cnblogs.com/melonjiang/p/6536876.html连接mongoDBfrom...

Centos环境中：除了安装openssl，还要安装动态库和相关头文件openssl-develyum -y install opensslyum -y install openssl-develubuntu环境中：sudo apt-get install libssl-devsudo apt-get install openssl...

运行scrapy spider时，出现Forbidden by robots.txt错误原因：在settings.py文件里有个ROBOTSTXT_OBEY参数，默认为True。False为拒绝遵守robot协议，True为遵守robot协议解决：将settings.py文件里的ROBOTSTXT_OBEY参数，设为False.。即ROBOTSTXT_OBEY = False...

使用datetime.datetime.now()报错原因是：from datetime import datetime此时命名空间是已经是datetime.datetime因此应该直接使用datetime.now()或者import datetime

python2：try:..............except Exception, e:.........python3:try:..............except Exception as e:.........