Offline Migration
Offline Migration transfers all existing data from a source cluster to a target cluster. This method supports migrations both within the same organization and across different organizations. It is ideal for scenarios where temporary write interruptions are acceptable, such as during planned maintenance or smaller-scale database transitions. For migrations that require uninterrupted write operations, refer to Zero Downtime Migration.
Before you start
-
The source Zilliz Cloud cluster is accessible from the public internet.
-
You have been granted the Organization Owner or Project Admin role. If you do not have the necessary permissions, contact your Zilliz Cloud administrator.
Zilliz Cloud also provides RESTful API endpoints for you to migrate data across clusters programmatically. For details, refer to Migrate to Existing Cluster and Migrate to New Dedicated Cluster.
Migrate data within the same organization
You can migrate data to either a new or existing cluster within the same organization.
-
Log in to the Zilliz Cloud console.
-
Go to the target project and select Migrations > In Current Organization.
-
In the dialog box that appears, configure the source cluster and database and the target cluster:
-
Source Cluster: Choose a source cluster and a database within it.
-
Migrate to: Choose Existing Cluster or New Cluster as the target.
-
Existing Cluster: Select a previously created cluster within the organization.
-
New Cluster: Create a new cluster for the migration.
-
-
Migration Type: Choose Offline Migration.
-
-
Click Next to proceed.
-
If migrating to an existing cluster, you’ll be redirected to the Migrate to an Existing Cluster page to select a target project and target cluster.
-
If migrating to a new cluster, you’ll be redirected to the cluster creation page to set up a new cluster.
-
-
Click Migrate to complete.
Monitor the migration process
Once you click Migrate, a migration job will be generated. You can check the migration progress on the Jobs page. When the job status switches from In Progress to Successful, the migration is complete.
Post-migration
After the migration job is completed, note the following:
-
Index Creation: The migration process automatically creates AUTOINDEX for the migrated collections.
-
Manual Loading Required: Despite automatic indexing, the migrated collections are not immediately available for search or query operations. You must manually load the collections in Zilliz Cloud to enable search and query functionalities. For details, refer to Load & Release.
Once your collection is loaded, verify that the number of collections and entities in the target cluster matches the data source. If discrepancies are found, delete the collections with missing entities and re-migrate them.
Cancel migration job
If the migration process encounters any issues, you can take the following steps to troubleshoot and resume the migration:
-
On the Jobs page, identify the failed migration job and cancel it.
-
Click View Details in the Actions column to access the error log.