The name that will be used to identify the Storage Provider Connection while performing operations on it.
Examples
-
s3-prod_conn -
hf-source-conn -
gcs-storage-dev
Creates a new Remote Storage Provider Connection.
flexai storage create <storage_provider_connection_name> [( --provider --access-key-id --endpoint --secret-access-key-name )] [( --provider gcs --service-account-file-name )] [( --provider s3 --region <region> )] [( --provider huggingface --hf-token-name <hf_token_name> )]The name that will be used to identify the Storage Provider Connection while performing operations on it.
s3-prod_conn hf-source-conn gcs-storage-dev S3-compatible storage Access Key ID.
--access-key-id AKIAIOSFODNN7AAF89GU S3-compatible storage endpoint.
Only required when using the s3 provider.
--endpoint s3.us-east-2.amazonaws.com --endpoint https://s3.us-west-004.backblazeb2.com Displays this help page.
Name of the FlexAI Secret containing the Hugging Face Access token.
To create a Hugging Face Access Token, follow these steps:
We recommend you keep the "Save your Access Token" prompt open until you've securely stored your token as a FlexAI Secret, as you won't be able to view it again.
Create a FlexAI Secret for your Hugging Face Access Token
To securely store your Hugging Face Access Token, you need to create a FlexAI Secret. Follow the instructions below based on your preferred method:
Create a Secret by using the flexai secret create command, which will receive the name of the secret as its only argument. In this case we will use hf_token to store a Hugging Face Access Token.
flexai secret create hf_tokenYou will be prompted to enter the value for the secret. You can either type in the value directly or paste it. In any case, the value will not be displayed in the terminal.
flexai secret create hf_tokenSecret Value: █Storage provider to use for this connection. One of:
s3 (Amazon S3 and compatible services)gcs (Google Cloud Storage)huggingface (Hugging Face Hub)minio (MinIO)r2 (Cloudflare R2)--provider s3 --provider gcs --provider huggingface S3-compatible storage Region where the target Storage Bucket is located.
Only required when using the s3 provider.
Name of the FlexAI Secret (See flexai secret list) containing the S3-compatible storage Secret Access Key.
--secret-access-key-name aws-secret-access-key-eu --secret-access-key-name SAK_AWS_2 Name of the FlexAI Secret (See flexai secret list) containing a the GCP Service Account JSON file.
This must have been stored using the flexai secret create —value-stdin <gcs_service_account_file_path.json>.
--service-account-file-name gcp-sa-dev --service-account-file-name gcs-service-account__diego Creates a new Remote Storage Provider Connection.