EFS and SOLR Cloud Backup(2)Snapshot and Restore SOLR

最新推荐文章于 2025-05-16 09:45:40 发布

原创最新推荐文章于 2025-05-16 09:45:40 发布 · 129 阅读

0 ·

CC 4.0 BY-SA版权

Distributed 专栏收录该内容

160 篇文章

订阅专栏

本文介绍了一种使用EFS和SOLR Cloud进行数据备份及恢复的方法，包括备份集群数据到EFS目录、在新集群上恢复数据、添加副本以确保所有节点都有副本、删除旧集合以及创建别名等步骤。还提供了相关的SOLR操作命令。

EFS and SOLR Cloud Backup(2)Snapshot and Restore SOLR

We have about 100G data, we tested with about 47G data. The steps we did is as follow:
#1 backup the collection allJobs from allJobsTest cluster to EFS directory with name allJobsBackup
#2 restore on new cluster allJobsTest2 with a different collection name allJobs2 (why allJobs2, because we use script to create the cluster, there is already a collection named allJobs after creation)
#3 Add replica to the new cluster multiple times to enable all nodes to have the replica
#4 delete old collection in the new cluster allJobsTest2
#5 on the new cluster, make an alias from the new collection allJobs2 to old collection name allJobs

After that, we found that between steps #2, we can delete the old collection first, then we can directly restore the backup to the original collection name, so we do not need alias #5 step.

Here are some related commands.

SOLR Cluster Operation
Backup Cluster
name - backup file name
collection - original collection name
location - network share disk space which can be seen by all the nodes
async - one manual input ID which can retrieve the status later
http://alljobstest.us-east-1.elasticbeanstalk.com/solr/admin/collections?action=BACKUP&name=allJobsBackup&collection=allJobs&location=/efs&async=123

Status Check
requestid - the manual input ID when we do something async, we can get the status back for that action
http://alljobstest.us-east-1.elasticbeanstalk.com/solr/admin/collections?action=REQUESTSTATUS&requestid=123

Restore Cluster
name - backup cluster name
collection - collection name we restore back
location - efs location
async - manual input ID
http://alljobstest2.us-east-1.elasticbeanstalk.com/solr/admin/collections?action=RESTORE&name=allJobsBackup&collection=allJobs&location=/efs&async=234

Add Replica to the Cloud
http://alljobstest2.us-east-1.elasticbeanstalk.com/solr/admin/collections?action=ADDREPLICA&collection=allJobs&shard=shard1

Create Alias
http://alljobstest2.us-east-1.elasticbeanstalk.com/solr/admin/collections?action=CREATEALIAS&name=allJobs&collections=allJobsBackup

Delete Alias
http://alljobstest2.us-east-1.elasticbeanstalk.com/solr/admin/collections?action=DELETEALIAS&name=allJobs

Delete Collection
http://alljobstest2.us-east-1.elasticbeanstalk.com/solr/admin/collections?action=DELETE&name=allJobs

References:
http://sillycat.iteye.com/blog/2407536