Dataset Lifecycle
Dataset Lifecycle
Section titled “Dataset Lifecycle”Creation and Upload
Section titled “Creation and Upload”- Prepare data - Organize files locally or identify cloud storage locations
- Upload Dataset - Use either the FlexAI Console or CLI to upload the Dataset
- Verify completion - Check upload status progress until it reaches the
availablestatus - Ready for training - Dataset becomes available for Training or Fine jobs
Statuses
Section titled “Statuses”Monitor Dataset lifecycle with clear status indicators:
| Status | Source | Description |
|---|---|---|
uploading | Host | Dataset files are being transferred from a host machine |
syncing | Remote Storage Provider | Dataset files are being synchronized from a Remote Storage Provider |
pending | Host or Remote Storage Provider | The Dataset is being processed by FlexAI |
available | Host or Remote Storage Provider | The Dataset is ready for use in Training or Fine-tuning Jobs |
error | Host or Remote Storage Provider | The upload process failed. Inspecting its details can provide more information: flexai dataset inspect <dataset_name> |
Dataset lifecycle
Section titled “Dataset lifecycle”You will notice that the Dataset lifecycle follows a clear progression through its statuses, with the only difference being the source of the upload:
