Manage Collections (Console)
This guide provides step-by-step instructions for creating and managing collections in Zilliz Cloud. It is intended for users who prefer a visual interface. If you are familiar with SDKs, you can also create and manage collections through them. For more information, refer to Collection.
Create collection
Zilliz Cloud offers three methods to create a collection, each catering to different needs:
-
Use Your Own Data: Ideal for users who desire full control. You'll have the autonomy to define the schema and the index parameters according to your dataset and specific needs.
-
Use Example Data: Ideal for users who are new to Zilliz Cloud seeking a quick setup. Zilliz Cloud offers a sample collection with a schema matching the example dataset. This method is hassle-free, but it does not allow configuration modifications.
-
Clone Existing Collection: Suitable for duplicating existing collections within the cluster, saving time and effort in setup.
Method 1: Use your own data
For complete control over your collection, follow these steps.
-
On the Create Collection page, define the schema of your collection.
Config
Description
Field Name
The name of the field. Each collection has the unique primary key and at least one vector field (up to 4).
In default schema design, Zilliz Cloud reserves the primary field (
primary_key
) and a float vector (vector
). You can customize their settings as needed.Field Type
The data type of the field. Fields supported by Zilliz Cloud fall into these main categories: primary key, vector field, and scalar field. The data types supported for different fields vary based on the field types.
Primary field:
INT64
,VARCHAR
Vector field:
FLOAT_VECTOR
,BINARY_VECTOR
,FLOAT16_VECTOR
,BFLOAT16_VECTOR
,SPARSE_FLOAT_VECTOR
.Scalar field:
INT64
,VARCHAR
,INT8
,INT16
,INT32
,FLOAT
,DOUBLE
,BOOL
,JSON
,ARRAY
.For details, refer to Schema Explained.
Index
Whether to index the field for better search performance. Once enabled, Zilliz Cloud creates an AUTOINDEX for your field. For details, refer to AUTOINDEX Explained.
Metric Type
The type of metric used to measure the similarity between vectors. This parameter is configurable only for a vector field. For details, refer to Metric Types.
Default Value
Whether to set a default value for the field. This parameter is configurable only for a scalar field (excluding the primary field). For details, refer to Nullable & Default.
Nullable
Whether to allow null values for the field. This parameter is configurable only for a scalar field (excluding the primary field). For details, refer to Nullable & Default.
Mmap
Whether to enable MMAP. This parameter is configurable only for a scalar field (excluding the primary field). For details, refer to Use mmap.
Description
Optional. The description of the field.
Auto ID
Whether to enable Auto ID for the primary field. Once enabled, Zilliz Cloud automatically generates unique IDs for the primary key, without the need to manually assign or manage them during data insertion.
-
(Optional) In Advanced Settings, consider dynamic fields and partition keys for advanced configurations.
-
Dynamic Field: Allow the insertion of new fields beyond the predefined schema. For more information, refer to Schema Explained.
-
Partition Key: Improve query efficiency by grouping data into partitions. For more information, refer to Use Partition Key.
-
-
Click Create Collection. Then, you can insert data into your collection.
Method 2: Use example data
Select Load Sample Data, review the preset collection, and confirm creation.
When you create a sample collection, Zilliz Cloud takes care of all the details, but does not allow configuration adjustments.
Method 3: Clone existing collection
Choose Clone Collection from the Actions menu.
-
Enter the new collection's name and description.
-
Select the scope of the clone action. You can either clone both the schema and existing data of a collection or just the collection schema without data in the current cluster.
-
Click Clone.
-
You can check the clone progress on the Jobs page. When the job status switches from IN PROGRESS to SUCCESSFUL, a new collection with the specified attributes is created in the current cluster.
📘NotesA job record will be generated only if you choose clone collection with both data and schema. Cloning a collection with schema only will not trigger a job record.
View collections
You can view the list of all existing collections created in your cluster, or click the name of a collection to view its details.
Load & release collection
In Zilliz Cloud, all search and query operations are performed in memory. Thus, loading a collection involves writing its data into memory, which is essential for these operations. Conversely, releasing a collection frees up memory space.
Move collection to another database
You can move a collection from one database to another.
Drop collection
Dropping a collection is a permanent action used when a collection is no longer required. It helps in saving resources but needs to be done cautiously.
Dropping a collection irreversibly deletes all data within it.
Limits on collections
Cluster Type | Max Number | Remarks |
---|---|---|
Free cluster | 5 | You can create up to 5 collections. |
Serverless cluster | 100 | You can create up to 100 collections. |
Dedicated cluster | 64 per CU, and <= 4096 | You can create up to 64 collections per CU used in a dedicated cluster and no more than 4,096 collections in the cluster. |
In addition to the limits on the number of collections per cluster, Zilliz Cloud also applies limits on consumed capacity, which indicates the physical resources consumed by your cluster. The following table lists the limits on the general capacity of a cluster.
Number of CUs | General Capacity |
---|---|
1-8 CUs | <= 4,096 |
12+ CUs | Min(512 x Number of CUs, 65536) |
For details on the calculation of general and consumed capacity, refer to Zilliz Cloud Limits.