利用.Net的HttpWebRequest获取HTML

最新推荐文章于 2024-11-10 18:14:12 发布

weixin_30410999

最新推荐文章于 2024-11-10 18:14:12 发布

阅读量168

点赞数

CC 4.0 BY-SA版权

原文链接：http://www.cnblogs.com/dancer/archive/2010/05/05/1728150.html

本文介绍了一个使用C#编写的静态方法，该方法通过HTTP请求从指定URL获取HTML内容，并支持gzip压缩。文中详细展示了如何设置HTTP请求参数，处理响应内容，并在必要时进行解压。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

static string GetHtml(string url, Encoding encoding)
    {
        HttpWebRequest request = null;
        HttpWebResponse response = null;
        StreamReader reader = null;
        try
        {
            request = (HttpWebRequest)WebRequest.Create(url);
            request.Timeout = 20000;
            request.AllowAutoRedirect = false;

            response = (HttpWebResponse)request.GetResponse();
            if (response.StatusCode == HttpStatusCode.OK && response.ContentLength < 1024 * 1024)
            {
                if (response.ContentEncoding != null && response.ContentEncoding.Equals("gzip", StringComparison.InvariantCultureIgnoreCase))
                    reader = new StreamReader(new GZipStream(response.GetResponseStream(), CompressionMode.Decompress), encoding);
                else
                    reader = new StreamReader(response.GetResponseStream(), encoding);
                string html = reader.ReadToEnd();

                return html;
            }
        }
        catch
        {
        }
        finally
        {

            if (response != null)
            {
                response.Close();
                response = null;
            }
            if (reader != null)
                reader.Close();

if (request != null)
request = null;

}

return string.Empty;
}

转载于:https://www.cnblogs.com/dancer/archive/2010/05/05/1728150.html