本文探讨了在信息检索中使用停用词的利弊。停用词如theand等常见词汇，在建立索引前通常会被过滤掉，以减少噪音并提升检索效率。然而，完全依赖停用词可能影响检索质量。文章分析了停用词对检索性能的影响，并提出了一种策略，即将查询字符串中的词汇分为更重要的低频词汇和较不重要的高频词汇，以提高检索的精确度。
The default English stopwords
These stopwords can usually be filtered out before indexing with little negative impact on retrieval.
But is is a good idea to do so?
Pros and Cons of Stopwords
the primary advantage
Using Stopwords
Stopwords and the Standard Analyzer
Maintaining Positions
The output from the analyze API is quite interesting:
Specifying Stopwords
Using the stop Token Filter
Updating Stopwords
Stopwords and Performance
minimum_should_match
Divide and Conquer
The terms in a query string can be divided into more important(low-frequency) and less-important(high-frequency) terms.
Documents that match only the less important terms are probably of very little interest. Really, we want document that match as many of the important terms as possible.
Controlling Precision
Only High-Frequency Terms
Index Options
Stopwords
扫一扫
8488
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
