HttpWebRequest 下载html

最新推荐文章于 2022-03-04 01:47:29 发布

原创最新推荐文章于 2022-03-04 01:47:29 发布 · 1.3k 阅读

0 ·

CC 4.0 BY-SA版权

.NET 专栏收录该内容

201 篇文章

订阅专栏

本文介绍了一个使用C#编写的简单程序，该程序可以获取指定URL的网页源代码，并将其保存到本地文件中。通过设置HTTP请求头模拟浏览器行为，确保能够顺利获取目标网页的内容。

public static void GetHtmlSourceCode(string url)
{
var uri = new Uri(url);
HttpWebRequest webrequest = (HttpWebRequest)WebRequest.Create(uri);
webrequest.KeepAlive = true;
webrequest.Method = "GET";
webrequest.ContentType = "text/html";
webrequest.Headers.Add("Accept-Language", "en-US,en;q=0.5");
webrequest.UserAgent = "Mozilla/5.0 (Windows NT 6.1; rv:18.0) Gecko/20100101 Firefox/18.0";

HttpWebResponse webresponse = (HttpWebResponse)webrequest.GetResponse();

Console.Write(webresponse.StatusCode);
Stream receiveStream = webresponse.GetResponseStream();
Encoding enc = System.Text.Encoding.UTF8;
StreamReader loResponseStream = new
StreamReader(receiveStream, enc);

string Response = loResponseStream.ReadToEnd();

using (StreamWriter sw = File.CreateText("a.txt"))
{
sw.WriteLine(Response);
}

loResponseStream.Close();
webresponse.Close();
}