gxk1992的博客

request => response =>html json等解析 => 保存指定格式 自动模拟selenium&&webdriver || splash || PyV8、Ghost.py 保存数据：纯文本||关系型数据库||非关系型数据库||二进制文件 HTTP请求测试网站http://httpbin.org/from selenium import webdriverdrive

search.pyfrom selenium import webdriverfrom selenium.common.exceptions import TimeoutExceptionfrom selenium.webdriver.common.by import Byfrom selenium.webdriver.support.ui import WebDriverWai

抓取索引页内容这里写代码片代理设置这里写代码片分析详情页内容这里写代码片将数据保存到数据库完整代码import requestsfrom urllib.parse import urlencodefrom pyquery import PyQuery as pqfrom setting import *import pymy

wheellxml (http://www.lfd.uci.edu/~gohlke/pythonlibs/#lxml)PyOpenssl(https://pypi.python.org/pypi/pyOpenSSL#downloads)Twisted(http://www.lfd.uci.edu/~gohlke/pythonlibs/#twisted)Pywen32(https://sou