FAQ: Data Import

This topic lists the possible issues that you may encounter while you import data on Zilliz Cloud and the corresponding solution.

Contents

• Can I use short-term credentials when importing data from an object storage service?
• Can I bulk insert data into the Zilliz Cloud vector databases?
• What can I do if I receive ECONNRESET errors when importing data to or querying Zilliz Cloud clusters with Node.js SDK?

FAQs

Can I use short-term credentials when importing data from an object storage service?

Yes. Based on your data security requirements, you can use session tokens when importing data from an object storage service.

1. Generate a session token.

   • Amazon S3: Using temporary credentials with AWS resources.

   • Google Cloud Storage: Create short-lived credentials for a service account

   • Azure Blog Storage: Create SAS tokens for storage containers

2. Input the following session token information during data import.

   • Amazon S3: accessKeyId, secretAccessKey, sessionToken

   • Google Cloud Storage: accessToken

   • Azure Blog Storage: sasToken

Can I bulk insert data into the Zilliz Cloud vector databases?

Yes. Please refer to Import for more information.

What can I do if I receive ECONNRESET errors when importing data to or querying Zilliz Cloud clusters with Node.js SDK?

To solve this problem, please follow the steps below.

1. Upgrade to the latest version of Milvus NodeJS SDK which supports channelOptions.

2. Add channelOptions manually.

   javascript

   const channelOptions: ChannelOptions = {
   
   // Send keepalive pings every 10 seconds, default is 2 hours.
   
   'grpc.keepalive_time_ms': 10 * 1000,
   
   // Keepalive ping timeout after 5 seconds, default is 20 seconds.
   
   'grpc.keepalive_timeout_ms': 5 * 1000,
   
   // Allow keepalive pings when there are no gRPC calls.
   
   'grpc.keepalive_permit_without_calls': 1,
   
   };

3. Initialize the client with the channelOptions.

   javascript

   import { MilvusClient, DataType } from '@zilliz/milvus2-sdk-node';
   
   new MilvusClient({
     address: 'your-zilliz-cloud-address',
     ssl: true,
     username: 'username',
     password: 'your-pass',
     channelOptions: channel options
   })