FAQ: Data Import
This topic lists the possible issues that you may encounter while you import data on Zilliz Cloud and the corresponding solution.
Contents
- Can I use short-term credentials when importing data from an object storage service?
- Can I bulk insert data into the Zilliz Cloud vector databases?
- What can I do if I receive
ECONNRESET
errors when importing data to or querying Zilliz Cloud clusters with Node.js SDK?
FAQs
Can I use short-term credentials when importing data from an object storage service?
Yes. Based on your data security requirements, you can use session tokens when importing data from an object storage service.
-
Generate a session token.
-
Amazon S3: Using temporary credentials with AWS resources.
-
Google Cloud Storage: Create short-lived credentials for a service account
-
Azure Blog Storage: Create SAS tokens for storage containers
-
-
Input the following session token information during data import.
-
Amazon S3:
accessKeyId
,secretAccessKey
,sessionToken
-
Google Cloud Storage:
accessToken
-
Azure Blog Storage:
sasToken
-
Can I bulk insert data into the Zilliz Cloud vector databases?
Yes. Please refer to Data Import for more information.
What can I do if I receive ECONNRESET
errors when importing data to or querying Zilliz Cloud clusters with Node.js SDK?
To solve this problem, please follow the steps below.
-
Upgrade to the latest version of Milvus NodeJS SDK which supports channelOptions.
-
Add channelOptions manually.
const channelOptions: ChannelOptions = {
// Send keepalive pings every 10 seconds, default is 2 hours.
'grpc.keepalive_time_ms': 10 * 1000,
// Keepalive ping timeout after 5 seconds, default is 20 seconds.
'grpc.keepalive_timeout_ms': 5 * 1000,
// Allow keepalive pings when there are no gRPC calls.
'grpc.keepalive_permit_without_calls': 1,
}; -
Initialize the client with the channelOptions.
import { MilvusClient, DataType } from '@zilliz/milvus2-sdk-node';
new MilvusClient({
address: 'your-zilliz-cloud-address',
ssl: true,
username: 'username',
password: 'your-pass',
channelOptions: channel options
})