Durable Disks

Durable disks give a container its own persistent storage on the local disk of the machine it runs on. Reads and writes go straight to local storage, and the contents survive across container restarts and redeployments. Use a durable disk when one process owns the data and needs fast, POSIX-complete access to it: a Postgres or Redis instance, a SQLite database, a vector index, a build cache, or a message queue.

If several containers need to read and write the same files at the same time, use a Volume instead. Volumes are shared, distributed storage. Disks are attached to one running container at a time.

Choosing Between Storage Types

	Volumes	Cloud Buckets	Durable Disks
Backed by	Beam’s distributed file system	Your S3-compatible bucket	Local SSD on the worker node, snapshotted to object storage
Shared between containers	Yes	Yes	One writer at a time (any number of read-only mounts)
Best for	Model weights, datasets, shared outputs	Data you already keep in S3	Databases, caches, and other single-writer state
Consistency	Visibility is subject to filesystem caching	Depends on the provider; no appends	Local disk semantics inside the container

Attaching a Disk

Declare a DurableDisk with a name, a size, and the path where it should appear inside the container, then pass it to your app with the disks parameter.

from beam import DurableDisk, function

disk = DurableDisk(name="app-data", size="10Gi", mount_path="/data")


@function(cpu=0.25, memory=128, disks=[disk])
def append_and_read():
    with open("/data/runs.log", "a") as f:
        f.write("container ran\n")

    with open("/data/runs.log") as f:
        return f.read()


if __name__ == "__main__":
    print(append_and_read.remote())

Run it, wait for the container to exit, and run it again. The second run returns two lines: the first one was written by a container that no longer exists. The disks parameter is accepted by Pod, function, endpoint, task_queue, and Sandbox. If a disk with that name does not exist in your workspace yet, Beam creates it the first time you run or deploy the app. You can also create disks ahead of time from the CLI.

Running a Database on a Disk

Use managed databases for Postgres, Redis, MySQL, or MongoDB with generated credentials and an attached durable disk:

beam db postgres create app-db
beam db postgres connect app-db --psql

For a custom stateful service, mount a disk in a Service or Pod and configure the database’s own authentication before exposing it.

Parameters

string

required

The name of the disk. Names are unique within your workspace, so two apps that declare the same name share the same disk.

string

required

The declared size of the disk, for example "10Gi" or "500Mi". The size is recorded on the disk and shown in the CLI; it is not changed by redeclaring the disk with a different value.

string

required

The absolute path where the disk is mounted inside the container. A disk without a mount path is not attached.

string

default:"ext4"

The filesystem requested when creating the disk. Its effect depends on the storage driver.

boolean

default:"False"

Mount the disk read-only. Read-only disks can be attached to any number of containers at once. See Read-Only Disks.

Snapshots

When a container starts, Beam reuses its disk on the same node or restores the latest snapshot on a new node. You can list the snapshots of a disk with the CLI:

beam disk snapshots redis-data

  Disk Name    Status      Format          Generation            Logical Size   Stored Size   Created At
 ───────────────────────────────────────────────────────────────────────────────────────────────────────────
  redis-data   available   redis.aof.v1    1783980128619331915   234.00 B       234.00 B      Jul 13 2026
  redis-data   available   redis.aof.v1    1783979768654042369   340.00 B       340.00 B      Jul 13 2026

  2 snapshots

Generation is a timestamp assigned when the snapshot is taken. The highest generation is the most recent snapshot and is the one used for restores.
Logical Size is the total size of the files in the snapshot. Stored Size is the size of the object storage chunks the snapshot references.
Format describes how the directory was captured. dir.v1 is the general format. Beam’s managed databases use postgres.wal.v1 and redis.aof.v1, which recognize Postgres write-ahead log segments and Redis append-only files: when one of those files has grown since the last snapshot, only the newly appended tail is uploaded.

Snapshots are kept until you delete them. Deleting a disk does not delete its snapshots.

Read-Only Disks

Only one container can have a writable mount of a given disk at a time. Deploying an app that mounts a writable disk with an autoscaler that allows more than one container is rejected:

✗ writable durable disks support one container; set max containers to 1 or mark the disk read_only

Set read_only=True to mount a disk without write access. Read-only mounts are exempt from the single-writer rule, so you can attach the same disk to a horizontally scaled endpoint. A typical pattern is one writer that prepares data, such as a nightly job that builds an index, and many readers that serve it:

from beam import DurableDisk, QueueDepthAutoscaler, endpoint

index = DurableDisk(name="search-index", size="20Gi", mount_path="/index", read_only=True)


@endpoint(
    name="search",
    disks=[index],
    autoscaler=QueueDepthAutoscaler(max_containers=10),
)
def search(query: str):
    ...

Readers start from the disk’s latest snapshot, so a new snapshot only reaches them the next time their containers start.

Limits and Caveats

One writer. A writable disk can be mounted by one container at a time. Scale-out requires read_only=True.
Durability follows snapshot publication. Changes since the last successfully published snapshot can be lost if the worker is lost. Inspect snapshot status and lifecycle errors.
Size is fixed at creation. Declaring an existing disk with a different size returns the existing disk unchanged.
Deleting is soft. beam disk delete removes the disk from your workspace but leaves its snapshots in place. Apps that still reference the name will recreate the disk record and, on their next start, restore from the latest snapshot.
Mount path is required. A DurableDisk without a mount_path is ignored.
Leave the marker file alone. Every disk contains a small .beta9-durable-disk file at its root that Beam uses to track snapshot state.

Managed Databases

Beam’s managed Postgres, Redis, MySQL, and MongoDB services are built on durable disks. beam db postgres create <name> deploys a Postgres container with a <name>-data disk mounted at /var/lib/postgresql/data, and beam db redis create <name> does the same with a disk at /data. The disks show up in beam disk list alongside any you create yourself.

beam db postgres create mydb
beam db postgres connect mydb --psql

CLI Management Commands

List Disks

beam disk list

  Name          Size   Filesystem   Mount Path   Created At    Workspace Name
 ───────────────────────────────────────────────────────────────────────────────
  redis-data    5Gi    ext4         /data        Jul 13 2026   85cfa7
  app-data      10Gi   ext4         /data        Sep 13 2026   85cfa7

  2 disks

Add --format json to get the full record, including the disk id and driver.

Create a Disk

beam disk create [DISK-NAME] --size 10Gi --mount-path /data

--size defaults to 10Gi. --mount-path sets the disk’s default mount path, which is shown in beam disk list; the mount_path you set in code is what determines where the disk is mounted. If a disk with that name already exists, the command returns it unchanged.

List Snapshots

beam disk snapshots [DISK-NAME]

Omit the name to list snapshots for every disk in the workspace.

Delete a Disk

beam disk delete [DISK-NAME]

Any apps or services (functions, endpoints, databases, etc) that
refer to this disk should be updated before it is deleted.
Are you sure? [y/N]: y

✓ Deleted disk: app-data

Pass -y to skip the confirmation.

Start Here

Sandboxes

Inference

Building Blocks

Container Images

Data and Storage

Scaling

Operations

Run in Your Cloud

Advanced Topics

Resources

Security

Durable Disks

Choosing Between Storage Types

Attaching a Disk

Running a Database on a Disk

Parameters

Snapshots

Read-Only Disks

Limits and Caveats

Managed Databases

CLI Management Commands

List Disks

Create a Disk

List Snapshots

Delete a Disk

​Choosing Between Storage Types

​Attaching a Disk

​Running a Database on a Disk

​Parameters

​Snapshots

​Read-Only Disks

​Limits and Caveats

​Managed Databases

​CLI Management Commands

​List Disks

​Create a Disk

​List Snapshots

​Delete a Disk

Choosing Between Storage Types

Attaching a Disk

Running a Database on a Disk

Parameters

Snapshots

Read-Only Disks

Limits and Caveats

Managed Databases

CLI Management Commands

List Disks

Create a Disk

List Snapshots

Delete a Disk