Step by step: Uploading a Dataset From a Remote Storage Provider

To upload Datasets from Amazon S3 to FlexAI, you first need to create a Storage Provider Connection that holds the necessary information to connect to your Amazon S3 bucket.You will find this entry from the AWS Security Blog useful: How to quickly find and update your access keys […].You will need the following:

Your Amazon S3 Secret Access Key
Your Amazon S3 Access Key ID
The Amazon S3 region
The endpoint URL associated with your Amazon S3 region

To upload Datasets from Google Cloud Storage (GCS) to FlexAI, you first need to create a Storage Provider Connection that holds the necessary information to connect to your GCS bucket. Setting up a Storage Provider Connection for GCS leverages Google Cloud Platform’s Service Account JSON key file.You can find more information on how to create a Service Account JSON key file in the Google Cloud documentation (Pick the Console tab for instructions on how to obtain it using the GCP web console).You will need the following:

A Google Cloud Service Account JSON key file with sufficient permissions to access the target GCS bucket.

To upload Datasets from Hugging Face Hub to FlexAI, you first need to create a Storage Provider Connection that holds the necessary information to connect to your Hugging Face Hub account.Setting up a Storage Provider Connection for Hugging Face Hub requires a Hugging Face Access Token.You can find more information on how to create a Hugging Face Access Token in the Hugging Face documentation.

Getting Started

Inference

Fine-tuning

Training

Platform Services

Interactive Development

CLI

Console

Best Practices

FAQ

Blueprints

Step by step: Uploading a Dataset From a Remote Storage Provider