爬虫
YWF331
这个作者很懒,什么都没留下…
展开
专栏收录文章
- 默认排序
- 最新发布
- 最早发布
- 最多阅读
- 最少阅读
-
爬虫-下载网页
from urllib.request import urlopen from urllib.error import URLError,HTTPError url = 'http://sou.zhaopin.com/jobs/searchresult.ashx?jl=%E8%A5%BF%E5%AE%89&kw=python&sm=0&p=1' #url = 'http:/...原创 2018-03-21 01:25:32 · 1071 阅读 · 0 评论 -
爬虫-用户代理
from urllib.request import urlopen,Request from urllib.error import URLError,HTTPError pcUserAgent = { "safari 5.1 – MAC":"User-Agent:Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_6_8; en-us) AppleWeb...原创 2018-03-21 13:22:51 · 1270 阅读 · 0 评论 -
爬虫-ip代理
from urllib.request import urlopen,Request,ProxyHandler,build_opener,install_opener url = 'http://ip.chinaz.com/getip.aspx' #局部代理 # handler = ProxyHandler({'http':'115.223.215.51:9000'}) # opener = ...原创 2018-03-21 14:00:31 · 491 阅读 · 0 评论 -
爬虫-链接深度
from urllib.request import urlopen from urllib.error import URLError,HTTPError import re import time #url = 'http://sou.zhaopin.com/jobs/searchresult.ashx?jl=%E8%A5%BF%E5%AE%89&kw=python&sm=0...原创 2018-03-25 17:59:05 · 554 阅读 · 0 评论 -
爬虫-限速
from urllib.request import urlopen,urlparse from urllib.error import URLError,HTTPError import re import time from datetime import datetime #url = 'http://sou.zhaopin.com/jobs/searchresult.ashx?jl=%E...原创 2018-03-25 19:36:55 · 1090 阅读 · 0 评论 -
爬虫-requests,微信公众号推送
去掉了time和bs4,不好用 #!/usr/bin/env python3 # -*- coding:utf-8 -*- import re,sys,time,json,requests import urllib from datetime import date,timedelta # 获取页面链接信息 class PageHelperInfo(object): def pag...原创 2018-07-09 13:43:12 · 868 阅读 · 0 评论 -
爬虫-
from selenium import webdriver from selenium.webdriver.support.ui import Select from datetime import date,timedelta from re import findall today = str(date.today()) yesterday = str(date.today() - tim...原创 2018-07-11 09:36:36 · 313 阅读 · 0 评论 -
爬虫-招标信息()
这个写的很舒服 #!/usr/bin/env python3 # -*- coding: utf-8 -*- import requests import re import json import random from time import sleep from datetime import date from functools import reduce class Prov...原创 2018-07-17 15:31:49 · 3949 阅读 · 0 评论 -
爬虫-上版优化
目的:减少点击量 #!/usr/bin/env python3 # -*- coding:utf-8 -*- from time import sleep from selenium import webdriver from selenium.webdriver.chrome.options import Options from selenium.webdriver.support.ui ...原创 2018-07-12 13:14:53 · 501 阅读 · 0 评论 -
爬虫-最终版
#!/usr/bin/env python3 # -*- coding:utf-8 -*- from time import sleep from selenium import webdriver from selenium.webdriver.chrome.options import Options from selenium.webdriver.support.ui import Sel...原创 2018-07-12 15:49:54 · 465 阅读 · 0 评论 -
beautiful soup用法
python beautiful soup库的超详细用法: https://cuiqingcai.com/1319.html https://blog.youkuaiyun.com/love666666shen/article/details/77512353转载 2018-11-21 10:47:19 · 358 阅读 · 0 评论
分享