python3 spider 02 获取html的url、 head、 status

编码的三叔

于 2018-11-09 00:46:40 发布

阅读量330

点赞数

CC 4.0 BY-SA版权

分类专栏：爬虫文章标签： spider

本文链接：https://blog.youkuaiyun.com/ppwwp/article/details/83870897

爬虫专栏收录该内容

1 篇文章

订阅专栏

本文介绍如何使用Python的urllib库来获取指定网站的URL、头部信息和响应码。通过实例演示了发送请求并解析返回的数据，包括读取URL、获取服务器信息、检查HTTP状态码等关键步骤。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

#coding:utf-8
from urllib import request
import chardet

if __name__=='__main__':
	req = request.Request('http://www.youkuaiyun.com')
	response = request.urlopen(req)
	#读取url信息
	url = response.geturl();
	print(url)
	#读取头信息
	info = response.info()
	print(info)
	code = response.getcode()
	print(code)

打印结果

---------- run python ----------
https://www.youkuaiyun.com/


Server: openresty
Date: Thu, 08 Nov 2018 16:38:59 GMT
Content-Type: text/html; charset=UTF-8
Transfer-Encoding: chunked
Connection: close
Vary: Accept-Encoding
Set-Cookie: uuid_tt_dd=10_37029271700-1541695139580-132031; Expires=Thu, 01 Jan 2025 00:00:00 GMT; Path=/; Domain=.youkuaiyun.com;
Set-Cookie: dc_session_id=10_1541695139580.760940; Expires=Thu, 01 Jan 2025 00:00:00 GMT; Path=/; Domain=.youkuaiyun.com;
Vary: Accept-Encoding
Set-Cookie: uuid_tt_dd=9797795953525243556_20181109; expires=Sun, 05-Nov-2028 16:38:59 GMT; Max-Age=315360000; path=/; domain=youkuaiyun.com
Strict-Transport-Security: max-age=864000


200

Output completed (1 sec consumed) - Normal Termination