elasticsearch批量index,update,delete——Bulk Helpers

最新推荐文章于 2025-06-05 00:15:44 发布

原创最新推荐文章于 2025-06-05 00:15:44 发布 · 8.7k 阅读

1 ·

CC 4.0 BY-SA版权

elasticsearch 专栏收录该内容

5 篇文章

订阅专栏

本文介绍了如何在Elasticsearch中进行高效的批量操作，包括批量建立索引、批量删除及批量更新文档的具体实现方法。通过使用Python的elasticsearch.helpers模块，可以有效地提高数据处理效率并减少网络延迟。

1. 批量建索引

for i in range(0,1000):

newDic = {"key":"value"}

action = {"_index": IndexName, "_type": TypeName, "_id": _id, "_source": newDic}
actions.append(action)

#--------------bukl index actions
if len(actions)>0:
finished = False
while not finished:
try:
# bulk create index
helpers.bulk(es, actions, chunk_size=1000, request_timeout=30)
finished = True
except ConnectionTimeout:
s = traceback.format_exc()
print s
del actions[:]

2. 批量删除

action = {
'_op_type': 'delete',
'_index': 'index-name',
'_type': 'document',
'_id': 42,
}

actions.append(action)

3. 批量更新
action = {
'_op_type': 'update',
'_index': 'index-name',
'_type': 'document',
'_id': 42,
'doc': {'question': 'The life, universe and everything.'}
}

actions.append(action)