Using scrolls in java

最新推荐文章于 2025-07-03 13:33:17 发布

原创最新推荐文章于 2025-07-03 13:33:17 发布 · 286 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#elasticsearch

elk 专栏收录该内容

59 篇文章

订阅专栏

本文介绍如何使用Elasticsearch的滚动搜索功能来高效检索大量数据。通过设置查询条件及滚动参数，可以实现按顺序获取所有匹配文档，即使跨越多个分片也能确保数据完整返回。

import static org.elasticsearch.index.query.QueryBuilders.*;

QueryBuilder qb = termQuery("multi", "test");

SearchResponse scrollResp = client.prepareSearch(test)
        .addSort(SortParseElement.DOC_FIELD_NAME, SortOrder.ASC)
        .setScroll(new TimeValue(60000))
        .setQuery(qb)
        .setSize(100).execute().actionGet(); //100 hits per shard will be returned for each scroll
//Scroll until no hits are returned
while (true) {

    for (SearchHit hit : scrollResp.getHits().getHits()) {
        //Handle the hit...
    }
    scrollResp = client.prepareSearchScroll(scrollResp.getScrollId()).setScroll(new TimeValue(60000)).execute().actionGet();
    //Break condition: No hits are returned
    if (scrollResp.getHits().getHits().length == 0) {
        break;
    }
}

The size-parameter is per shard, so if you run a query against multiple indices (leading to many shards being involved in the query) the result might be more documents per execution of the scroll than you would expect!