ECON: An Approach to Extract Content from Web News Page

最新推荐文章于 2024-12-01 16:19:43 发布

最新推荐文章于 2024-12-01 16:19:43 发布 · 97 阅读

本文介绍了一种名为ECON的有效方法，用于全自动地从网页新闻中提取内容。ECON利用DOM树来表示新闻页面，并利用DOM树的特征进行内容识别与噪声去除。实验表明，ECON能够实现高精度的抽取且适用于多种语言的新闻页面。

Title：ECON: An Approach to Extract Content from Web News Page

Authors：Yan Guo, Huifeng Tang, Linhai Song, Yu Wang, Guodong Ding

Conference：The 12th International Asia-Pacific Web Conference (APWEB 2010)

Abstract：This paper provides a simple but effective approach, named ECON, to fully-automatically extract content from Web news page. ECON uses a DOM tree to represent the Web news page and leverages the substantial features of the DOM tree. ECON finds a snippet-node by which a part of the content of news is wrapped firstly, then backtracks from the snippet-node until a summary-node is found, and the entire content of news is wrapped by the summary-node. During the process of backtracking, ECON removes noise. Experimental results showed that ECON can achieve high accuracy and fully satisfy the requirements for scalable extraction. Moreover, ECON can be applied to Web news page written in many popular languages such as Chinese, English, French, German, Italian, Japanese, Portuguese, Russian, Spanish, Arabic. ECON can be implemented much easily.