Ephemeral Instances

Ephemeral instances have a temporary boot disk that does not persist between instance stop and start. Ephemeral instances are well-suited for stateless worker nodes on inference clusters.

Create a Ephemeral Instance

CLI

Use the fluidctl instances create command with the --ephemeral flag to create a ephemeral instance. For example:

fluidctl instances create --name example --type cpu.8x --ephemeral

• --name: The name of the instance.
• --type: The instance type (e.g., cpu.8x, h100-hgx-80gb.8x).
• --ephemeral: Indicates that the instance is ephemeral.

API

To create a ephemeral instance via the REST API, send a POST request to the /instances endpoint with the ephemeral field set to true:

POST /instances HTTP/1.1
Host: <your-cluster-url>
Authorization: Bearer <your-auth-token>
Content-Type: application/json

{
  "name": "example",
  "type": "cpu.8x",
  "ephemeral": true,
}