Skip to main content
Version: User Guides (Cloud)

Migrate from Milvus to Zilliz Cloud Via Endpoint

Zilliz Cloud offers Milvus as a fully managed, cloud-hosted solution for users who want to use the Milvus vector database without the need to manage the infrastructure themselves. To enable smooth migration, you can migrate data from Milvus to Zilliz Cloud in these ways - connecting to source Milvus via database endpoint or uploading backup files directly.

This topic describes how to migrate from Milvus via the database endpoint. For information on how to upload backup files, refer to Via Backup Files.

Before you start​

  • The source Milvus instance is running version 2.3.6 or later and is accessible from the public internet.

  • If you have an allowlist configured in your network environment, ensure that Zilliz Cloud IP addresses are added to it. For more information, refer to Zilliz Cloud IPs.

  • If authentication has been enabled for the source Milvus, make sure you have obtained necessary connection credentials. For details, refer to Authenticate User Access.

  • You have been granted the Organization Owner or Project Admin role. If you do not have the necessary permissions, contact your Zilliz Cloud administrator.

  • Make sure the CU size can of the target cluster can accommodate your source data. To estimate the required CU size, use the calculator.

Migrate from Milvus via database endpoint​

You can migrate one or more collections from a single Milvus database at a time.

  1. Log in to the Zilliz Cloud console.

  2. Go to the target project and select Migrations > Milvus > Via Endpoint.

  3. In the Cluster Endpoint field of the Connect to Data Source step, enter the server address of the source Milvus. If authentication has been enabled for the source Milvus, enter Username and Password as access credentials. Then, click Next.

    D2R5bHXGJoi7PSxMfxScbYdEnA5

  4. In the Select Source and Target step, configure settings for the source Milvus and target Zilliz Cloud cluster. Then, click Next.

    ZpTrbReOKoaGe4xY1xPc5DRNnFf

  5. In the Configure Schema step, set up field mappings between Milvus and Zilliz Cloud.

    IEHEbdHi9o7IDsx5fKGcVQXSnDb

    1. Verify primary key & vector field mappings:

      • Primary key: The source collection’s primary key becomes the primary key in the target collection. You can enable Auto ID to generate new primary key values. If you do so, the original primary key values from your source index will be discarded.

      • Vector fields: Migrated unchanged. The vector dimension is fixed and cannot be edited.

    2. Handle scalar fields:

      For scalar fields, configure the following attributes:

      • Nullable: Decide whether a field can accept null values. This feature is enabled by default. For details, refer to Nullable & Default.

      • Default Value: Specify a default value for a field. For details, refer to Nullable & Default.

      • Partition Key: Optionally designate an INT64 or VARCHAR field as the partition key. Note: Each collection supports only one partition key, and the selected field cannot be nullable. For details, refer to Use Partition Key.

    3. Enable dynamic field:

      • Dynamic fields are enabled by default for the target collection.

      • If you disable dynamic fields for your target collection, the dynamic fields from your source collection will not be migrated.

    4. (Optional) Adjust shards:

      • Click Advanced Settings to configure the number of shards for your target collection.

      • For datasets of around 100 million rows, a single shard is typically sufficient.

      • If your dataset exceeds 1 billion rows, contact us to discuss optimal shard configuration for your use case.

  6. Click Migrate.

Monitor the migration process​

Once you click Migrate, a migration job will be generated. You can check the migration progress on the Jobs page. When the job status switches from In Progress to Successful, the migration is complete.

RGsvb7oFpo7uzbxjSSFc6owNn0c

Post-migration​

After the migration job is completed, note the following:

  • Index Creation: The migration process automatically creates AUTOINDEX for the migrated collections.

  • Manual Loading Required: Despite automatic indexing, the migrated collections are not immediately available for search or query operations. You must manually load the collections in Zilliz Cloud to enable search and query functionalities. For details, refer to Load & Release.

📘Notes

Once your collection is loaded, verify that the number of collections and entities in the target cluster matches the data source. If discrepancies are found, delete the collections with missing entities and re-migrate them.

Cancel migration job​

If the migration process encounters any issues, you can take the following steps to troubleshoot and resume the migration:

  1. On the Jobs page, identify the failed migration job and cancel it.

  2. Click View Details in the Actions column to access the error log.