Storage Options
Before importing data, it's important to understand the supported cloud storage options and their corresponding URL formats. This ensures that your requests can be properly processed without undergoing validation errors.
AWS Simple Storage Service (S3)
-
Object access URIs
URI Style
URI Format
AWS Object URL, virtual-hosted–style
https://<bucket_name>.s3.<region-code>.amazonaws.com/<object_name>
AWS Object URL, path-style
https://s3.<region-code>.amazonaws.com/<bucket_name>/<object_name>
AWS S3 URI
s3://<bucket_name>/<object_name>
For more details, see Methods for accessing a bucket.
-
Required permissions
-
s3:GetObject
-
s3:ListBucket
-
s3:GetBucketLocation
-
-
Credential acquisition
Based on your data security requirements, you can use either long-term credentials or session tokens during data import:
-
If you prefer to authenticate with long-term credentials, read Authenticate using long-term credentials for details.
-
If you prefer to authenticate with short-term credentials, refer to this FAQ.
-
Google Cloud Storage
-
Object access URIs
URI Style
URI Format
GSC public URL
https://storage.cloud.google.com/<bucket_name>/<object_name>
GSC gsutil URI
gs://<bucket_name>/<object_name>
For more details, see Share the object.
-
Required permissions
-
storage.objects.get
-
storage.objects.list
-
-
Credential acquisition
Based on your data security requirements, you can use either long-term credentials or session tokens during data import:
-
If you prefer to authenticate with long-term credentials, read Manage HMAC keys for service accounts for details.
-
If you prefer to authenticate with short-term credentials, refer to this FAQ.
-
Azure Blob Storage
-
Object access URIs
URI Style
URI Format
Azure storage blob URI
https://<storage_account>.blob.core.windows.net/<container>/<blob>
For more details, see Resource URI Syntax.
-
Credential acquisition
Based on your data security requirements, you can use either long-term credentials or session tokens during data import:
-
If you prefer to authenticate with long-term credentials, read View account access keys for details
-
If you prefer to authenticate with short-term credentials, refer to this FAQ.
-