Skip to main content

Migrate from Pinecone to Zilliz Cloud

This topic describes how Zilliz Cloud handles data type mapping, field conversion, namespace processing, and collection naming rules when migrating from Pinecone.

Prerequisites

Before starting your Pinecone to Zilliz Cloud migration, ensure you meet these requirements:

Pinecone requirements

RequirementDetails
Index typeSupports migrating from Pinecone Serverless indexes only
API accessPinecone API key with access permissions
Data availabilitySource indexes from Pinecone must contain data. Empty indexes cannot be migrated.
Vector dimensionDimension must be > 1. Single-dimension vectors will cause migration failure

Zilliz Cloud requirements

RequirementDetails
User roleOrganization Owner or Project Admin
Cluster capacitySufficient storage and compute resources (use the CU calculator to estimate CU size)
Network accessAdd Zilliz Cloud IPs to allowlists if using network restrictions

Data type mapping

Understanding how Pinecone data types map to Zilliz Cloud is crucial for planning your migration:

Pinecone Field TypeZilliz Cloud Field TypeNotes
Primary keyVARCHAR (primary key)Automatically mapped. Enable Auto ID to generate new IDs (original values will be discarded).
Dense vectorFLOAT_VECTORDimensions preserved exactly, no modifications needed
Sparse vectorSPARSE_FLOAT_VECTOROnly mapped if non-empty in sample data.
MetadataDynamic fieldsMapped as dynamic schema by default; can be converted to fixed fields.
Refer to Dynamic Field for more details.
NamespacePartition key / partitionRecommended for performance optimization.
Refer to Namespace processing for more details.

Metadata field conversion

📘Notes

Zilliz Cloud samples 100 rows to detect metadata schema. You can manually add additional fields if needed.

Pinecone metadata is initially mapped to Zilliz Cloud's dynamic schema for maximum flexibility. You can optionally convert metadata fields to fixed fields to gain:

  • Enforced data types for stronger validation

  • Optimized indexing for better query performance

  • Structured schema for consistent data management

When converting metadata to fixed fields:

Pinecone Metadata TypeZilliz Fixed Field TypeNotes
StringVARCHARMaximum 65,535 bytes supported
Number (int/float)DOUBLEAll numeric types become DOUBLE
BooleanBOOLDirect mapping
List of stringsARRAY<VARCHAR>Nested arrays supported

For metadata fields converted to fixed fields, you can configure additional attributes:

  • Nullable: Decide whether a field can accept null values. This feature is enabled by default. For details, refer to Nullable attribute.

  • Default Value: Set fallback values when data is missing. For details, refer to Default values.

Pinecone-specific handling rules

Namespace processing

Pinecone namespaces can be migrated using two strategies:

StrategyImplementationPerformance ImpactUse Case
Namespace as Partition Key (Recommended)Namespaces become values in a partition key fieldAutomatic optimization for search performanceMost scenarios with multiple namespaces
Namespace as PartitionEach namespace becomes a separate partitionManual partition management requiredSimple scenarios with few, stable namespaces
📘Notes

Pinecone's default namespace handling:

  • As Partition: Becomes _default partition in Zilliz Cloud

  • As Partition Key: Becomes empty string "" value

For more information on partition and partition key concepts, refer to Manage Partitions and Use Partition Key.

Collection naming rules

Pinecone index names are automatically processed for Zilliz Cloud compatibility:

Pinecone Index NameZilliz Cloud Collection NameRule Applied
my-vector-indexmy_vector_indexHyphens (-) converted to underscores (_) to comply with Zilliz Cloud collection naming conventions
product_searchproduct_searchNo change needed

Naming conflicts: If a collection with the same name already exists in the target database, you must:

  • Delete the existing collection, or

  • Choose a different target database, or

  • Rename the target collection during migration configuration

Ctrl I