> ## Documentation Index
> Fetch the complete documentation index at: https://docs.flex.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Remote Storage Connection Manager

The FlexAI Remote Storage Connection Manager enables seamless integration with cloud storage providers, facilitating efficient data transfer and access without the need for local downloads and re-uploads.

Create secure connections to your cloud storage and move data directly between their servers and the FlexAI platform.

## Overview

The Remote Storage Connection Manager enables you to:

* **Connect to cloud storage** providers like AWS S3, Google Cloud Storage, and Cloudflare R2
* **Transfer data efficiently** with server-to-server connections
* **Manage credentials securely** using the FlexAI Secret Manager
* **Upload datasets directly** from a third party Cloud Storage Provider to FlexAI
* **Export checkpoints** To your preferred storage destinations

## Supported Storage Providers

<CardGroup cols={2}>
  <Card title="Amazon S3" icon="aws" href="/platform-services/remote-storage-connections-manager/create/">
    Native support for AWS S3 buckets with regional endpoint configuration
  </Card>

  <Card title="Google Cloud Storage" icon="google" href="/platform-services/remote-storage-connections-manager/create/">
    Direct integration with GCS buckets using Service Account authentication
  </Card>

  <Card title="Cloudflare R2" icon="cloud" href="/platform-services/remote-storage-connections-manager/create/">
    S3-compatible interface for Cloudflare R2 storage
  </Card>

  <Card title="Hugging Face Hub" icon="face-smile" href="/platform-services/remote-storage-connections-manager/create/">
    Direct access to datasets and models from Hugging Face repositories
  </Card>

  <Card title="MinIO" icon="server">
    Self-hosted S3-compatible storage for on-premises deployments
  </Card>
</CardGroup>

## Common Data Transfer Operations

### Dataset Upload Workflows

Efficiently move Datasets from a Cloud Storage Provider to FlexAI:

1. **Direct transfer** - Server-to-server transfer without local downloads
2. **Resource optimization** - FlexAI handles these data transfers without using compute resources
3. **Dataset structure preservation** - Your file and directory structure is kept intact

### Checkpoint Export Workflows

Upload model Checkpoints to a Cloud Storage Provider:

1. **Flexible destinations** - Export to any\* connected storage provider
2. **Custom paths** - Specify exact destination locations
3. **Metadata preservation** - Maintain checkpoint metadata and versioning

> Note: Exporting to the Hugging Face Hub is not currently supported.

### Model Checkpoint Import Workflows

Upload model Checkpoints from a Cloud Storage Provider:

1. **Flexible sources** - Import base models or custom checkpoints of your Remote Storage Providers, like the Hugging Face Hub
2. **Metadata recognition** - FlexAI recognizes checkpoint metadata and versioning
3. **Resume Training** - Continue Training or Fine-tuning your imported Checkpoints
4. **Serve Models** - Deploy Inference Endpoints from imported Checkpoints

## Cost Optimization

Minimize data transfer costs with smart routing:

* **Regional optimization** - Use storage regions close to FlexAI infrastructure
* **Direct transfers** - Avoid egress fees from intermediate downloads
* **Efficient data transfers** - Avoid fetching Datasets during runtime

## Compliance

* **Data residency** - Choose storage regions that meet compliance requirements
* **Encryption at rest** - Leverage cloud provider encryption capabilities
* **Access logging** - Maintain detailed logs for compliance auditing
* **Data lifecycle** - Implement appropriate data retention and deletion policies

## Getting Started

Ready to connect your cloud storage? Explore these resources:

<CardGroup>
  <Card title="Storage Commands" icon="star" href="/cli/reference/storage/">
    Complete CLI reference for storage connections
  </Card>

  <Card title="Dataset Upload" icon="upload" href="/platform-services/dataset-manager/from-remote/">
    Upload datasets from cloud storage
  </Card>

  <Card title="Checkpoint Export" icon="download" href="/cli/reference/checkpoint/export/">
    Export checkpoints to cloud storage
  </Card>

  <Card title="Secret Management" icon="lock" href="/cli/reference/secret/">
    Manage storage credentials securely
  </Card>
</CardGroup>