FAQ: Data Import
This topic lists the possible issues that you may encounter while you import data on Zilliz Cloud and the corresponding solution.
Contents
- Can I use session tokens when importing data from an object storage service?
- Can I bulk insert data into the Zilliz Cloud vector databases?
- What can I do if I receive
ECONNRESET
errors when importing data to or querying Zilliz Cloud clusters with Node.js SDK?
FAQs
Can I use session tokens when importing data from an object storage service?
Yes. Based on your data security requirements, you can use session tokens when importing data from an object storage service.
-
Generate a session token.
-
Amazon S3: Using temporary credentials with AWS resources.
-
Google Cloud Storage: Create short-lived credentials for a service account
-
Azure Blog Storage: Create SAS tokens for storage containers
-
-
Input the following session token information during data import.
-
Amazon S3:
accessKeyId
,secretAccessKey
,sessionToken
-
Google Cloud Storage:
accessToken
-
Azure Blog Storage:
sasToken
-
Can I bulk insert data into the Zilliz Cloud vector databases?
Yes. Please refer to Data Import for more information.
What can I do if I receive ECONNRESET
errors when importing data to or querying Zilliz Cloud clusters with Node.js SDK?
To solve this problem, please follow the steps below.
-
Upgrade to the latest version of Milvus NodeJS SDK which supports channelOptions.
-
Add channelOptions manually.
const channelOptions: ChannelOptions = {
// Send keepalive pings every 10 seconds, default is 2 hours.
'grpc.keepalive_time_ms': 10 * 1000,
// Keepalive ping timeout after 5 seconds, default is 20 seconds.
'grpc.keepalive_timeout_ms': 5 * 1000,
// Allow keepalive pings when there are no gRPC calls.
'grpc.keepalive_permit_without_calls': 1,
}; -
Initialize the client with the channelOptions.
import { MilvusClient, DataType } from '@zilliz/milvus2-sdk-node';
new MilvusClient({
address: 'your-zilliz-cloud-address',
ssl: true,
username: 'username',
password: 'your-pass',
channelOptions: channel options
})