记elasticdump 备份数据导出导入

最新推荐文章于 2024-10-09 17:55:47 发布

weixin_34227447

最新推荐文章于 2024-10-09 17:55:47 发布

阅读量702

点赞数

CC 4.0 BY-SA版权

文章标签： json 大数据运维

原文链接：https://my.oschina.net/kcw/blog/1856964

本文详细记录了使用elasticdump工具在不同环境下迁移Elasticsearch数据的过程，包括从生产环境导出索引到测试环境的具体步骤，以及解决迁移中遇到的字段不支持问题的解决方案。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

为什么80%的码农都做不了架构师？>>>

版本：

elasticsearch 5.5.2

elasticdump 2.2

系统 CentOS7.3

因项目需求从生产导出一份索引到测试

帮助文档 https://github.com/taskrabbit/elasticsearch-dump?utm_source=dbweekly&utm_medium=email

安装 yum install elasticdump

elasticdump --input=http://localhost:9200 --output=abc.json --type=data Sun, 25 Sep 2016 13:07:15 GMT | starting dump Sun, 25 Sep 2016 13:07:15 GMT | Error Emitted => {"error":{"root_cause":[{"type":"parsing_exception","reason":"The field [fields] is no longer supported, please use [stored_fields] to retrieve stored fields or _source filtering if the field is not stored","line":1,"col":36}],"type":"parsing_exception","reason":"The field [fields] is no longer supported, please use [stored_fields] to retrieve stored fields or _source filtering if the field is not stored","line":1,"col":36},"status":400} Sun, 25 Sep 2016 13:07:15 GMT | Total Writes: 0 Sun, 25 Sep 2016 13:07:15 GMT | dump ended with error (get phase) => Error: {"error":{"root_cause":[{"type":"parsing_exception","reason":"The field [fields] is no longer supported, please use [stored_fields] to retrieve stored fields or _source filtering if the field is not stored","line":1,"col":36}],"type":"parsing_exception","reason":"The field [fields] is no longer supported, please use [stored_fields] to retrieve stored fields or _source filtering if the field is not stored","line":1,"col":36},"status":400}

As a workaround, the following works:

elasticdump --input=http://9.11.8.51:9200/apm --output=apm.json --type=data --searchBody '{"query": { "match_all": {} }, "stored_fields": ["*"], "_source": true }'

elasticdump --input=apm.json --output=http://9.1.8.234:9200/apm --type=data --searchBody '{"query": { "match_all": {} }, "stored_fields": ["*"], "_source": true }'

elasticdump --input=http://9.11.8.52:9200/metric --output=/data/metric.json --type=data --limit=1000 --searchBody '{"query":{"term":{"timestamp": "2018-09-28"}}}' https://github.com/taskrabbit/elasticsearch-dump

转载于:https://my.oschina.net/kcw/blog/1856964