当前位置: 首页>>代码示例>>C#>>正文


C# HtmlAgilityPack.Load方法代码示例

本文整理汇总了C#中HtmlAgilityPack.Load方法的典型用法代码示例。如果您正苦于以下问题:C# HtmlAgilityPack.Load方法的具体用法?C# HtmlAgilityPack.Load怎么用?C# HtmlAgilityPack.Load使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在HtmlAgilityPack的用法示例。


在下文中一共展示了HtmlAgilityPack.Load方法的1个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的C#代码示例。

示例1: parsecontent

		private static void parsecontent(HttpClient httpClient, string folderpath, HtmlAgilityPack.HtmlDocument htmlDoc, List<string> lstImgurl, string link)
		{
			int a = link.LastIndexOf("/");
			var name = link.Substring(a + 1);
			var b = name.IndexOf(".");
			name = name.Substring(0, b);

			string urlPageName = name;
			string resname = Path.Combine(folderpath, urlPageName);
			string contenturl = baseurl + link;

			string txtfullname = resname + ".txt";
			if (File.Exists(txtfullname))
			{
				Console.WriteLine("page {0} has download =>{1}", link, urlPageName);
				return;
			}

			try
			{
				var taskget = httpClient.GetStreamAsync(contenturl);
				htmlDoc.Load(taskget.Result, Encoding.UTF8);

				Console.WriteLine("load html " + contenturl);
			}
			catch (Exception ex)
			{
				Console.WriteLine("load html error: " + ex.Message);
				return;
			}
			var contentNode = htmlDoc.GetElementbyId("read_tpc");


			var content = contentNode.InnerHtml;
			try
			{
				FileStream fs = File.OpenWrite(txtfullname);
				byte[] torbytes = Encoding.UTF8.GetBytes(content);
				fs.Write(torbytes, 0, torbytes.Count());
				fs.Flush();
				fs.Close();
				fs.Dispose();
			}
			catch (Exception ex)
			{
				Console.WriteLine("get torrent failed! " + ex.Message);
			}

			int imgIndex = 0;
			contentNode.Elements("img").ToList().ForEach(e =>
			{
				try
				{
					var imgurl = e.Attributes["src"].Value;
					var imgstream = httpClient.GetStreamAsync(imgurl);



					var downImgname = resname + "-" + (++imgIndex) + ".jpg";

					lstImgurl.Add(imgurl);
					FileStream fsimg = File.OpenWrite(downImgname);


					imgstream.Result.CopyTo(fsimg);

					if (fsimg.Length < 100)
					{
						return;

					}

					fsimg.Flush();
					fsimg.Close();
					fsimg.Dispose();

					Console.WriteLine("save img => " + downImgname);
				}
				catch (Exception ex)
				{
					Console.WriteLine("get img {0} failed! {1} ", lstImgurl, ex.Message);

				}
			});
		}
开发者ID:szlfwolf,项目名称:spider,代码行数:85,代码来源:Program.cs


注:本文中的HtmlAgilityPack.Load方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。