asp.net C# 获取网页源码的几种方式

最新推荐文章于 2021-06-03 13:30:24 发布

Summer_Dream_Journey

最新推荐文章于 2021-06-03 13:30:24 发布

阅读量1.4k

点赞数 1

文章标签： webbrowser 源码 c# asp.net

本文链接：https://blog.youkuaiyun.com/Summer_Dream_Journey/article/details/34077649

版权

本文介绍了两种在ASP.NET C#中获取网页源码的常见方法，包括使用WebBrowser控件和HTTP请求的方式，详细阐述了各自的操作步骤和应用场景。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

1 方法

               System.Net.WebClient aWebClient = new System.Net.WebClient();
               aWebClient.Encoding = System.Text.Encoding.Default;
               Byte[] pageData = aWebClient.DownloadData(url);
           
               string nhtml = Encoding.GetEncoding("utf-8").GetString(pageData);

2方法

                System.Net.WebClient aWebClient = new System.Net.WebClient();
                aWebClient.Encoding = System.Text.Encoding.Default;
                string nhtml = aWebClient.DownloadString(goodstidurl);

3方法

               WebBrowser webbrowser = new WebBrowser();
                StreamReader sr = new StreamReader(this.webBTaobao.DocumentStream, Encoding.Default);
                html = sr.ReadToEnd();
                html = html.Replace("\r\n", "");
                html = html.Replace("\n", "");
                html = html.Replace("  ", "");
                html = html.Replace("(", "");
                html = html.Replace(")", "");
                string nurl = Regex.Match(html, "(?<=data-url=\").*?(?=\")").Value;
                //新建一个WebBrowser
                WebBrowser webAddress = new WebBrowser();
                webAddress.Navigate(nurl);
                //等待加载完成
                while (webAddress.ReadyState < WebBrowserReadyState.Complete) Application.DoEvents();
                StreamReader sraddress = new StreamReader(webAddress.DocumentStream, Encoding.Default);
                jsonaddress = sraddress.ReadToEnd();

4方法

            WebRequest hwr = WebRequest.Create(@"http://item.taobao.com/item.htm?id=" + row["urlId"].ToString());//向指定Url发出请求 
            HttpWebResponse hwp = hwr.GetResponse() as HttpWebResponse;//将hwr对HTTP的请求 
            string text;
            StreamReader sr;
            string code = hwp.ContentType;//请求响应得到的内容类型 
            //得到编码了 
            code = code.Split('=')[1];
            Stream rep = hwp.GetResponseStream();//将请求得到的内容以流的形式读出 
            sr = new StreamReader(rep, Encoding.GetEncoding(code));//用指定的字符编码为指定的流初始化