Skip to main content
Version: User Guides (Cloud)

Migrate from Milvus

Zilliz Cloud provides a cutting-edge data infrastructure for optimized search across vector embeddings, making it easy to bring your AI applications to life. If you are using Milvus and wish to leverage this advanced infrastructure, migrating your data to Zilliz Cloud is a recommended step.

This guide will walk you through the process of preparing the migration data, performing the migration, and verifying the results.

Prepare migration data​

To prepare migration data for Milvus 2.x, do as follows:

  1. Download milvus-backup. Always use the latest release.

  2. Create a configs folder side by side with the downloaded binary, and download backup.yaml into the configs folder.

    Once the step is done, the structure of your workspace folder should look like this:

    workspace
    ├── milvus-backup
    └── configs
         └── backup.yaml

  3. Customize backup.yaml.

    In normal cases, you do not need to customize this file. But before going on, check whether the following configuration items are correct:

    • milvus.address

    • mivlus.port

    • minio.address

    • minio.port

    • minio.bucketName

    • minio.backupBucketName

    • rootPath

    📘Notes

    • For a Milvus instance installed using Docker Compose, minio.bucketName defaults to a-bucket and rootPath defaults to files.

    • For a Milvus instance installed on Kubernetes, minio.bucketName defaults to milvus-bucket and rootPath defaults to file.

  4. Create a backup of your Milvus installation.

    ./milvus-backup --config backup.yaml create -n my_backup

  5. Get the backup file.

    ./milvus-backup --config backup.yaml get -n my_backup

  6. Check the backup files.

    • If you set minio.address and minio.port to an S3 bucket, your backup file are already in the S3 bucket.

    • If you set minio.address and minio.port to a Minio bucket, you can download them using Minio Console or the mc client.

      • To download from Minio Console, log into Minio Console, locate the bucket specified in minio.address, select the files in the bucket, and click Download to download them.

      • If you prefer the mc client, do as follows:

        # configure a Minio host
        mc alias set my_minio https://<minio_endpoint> <accessKey> <secretKey>

        # List the available buckets
        mc ls my_minio

        # Download a file from the bucket
        mc cp --recursive my_minio/<your-bucket-path> <local_dir_path>

  7. Decompress the downloaded archive and upload only the content of the backup folder to Zilliz Cloud.

Migrate data to Zilliz Cloud​

Once the migration data is ready, upload it to Zilliz Cloud.

migration_procedure

If you have uploaded the prepared migration data to a personal S3 block storage bucket, select Import a folder from S3 and fill in the folder path and authentication credentials.

To upload a local folder to Zilliz Cloud, select Import a local folder and drag the folder to the drop zone. Note that you can upload a local folder of no more than 1 GB to Zilliz Cloud.

Verify the migration results​

Once you click Migrate, a migration job will be generated. You can check the migration progress on the Jobs page. When the job status switches from IN PROGRESS to SUCCESSFUL, the migration is complete.

verify_collection

Note that Zilliz Cloud exclusively supports AUTOINDEX for optimized indexing, and will automatically index your migrated collection using this algorithm.

Once the collections are loaded, you are free to interact with them using your preferred method.