Features

Fixes

Slack Community

Github

Twitter

Beam

Examples

Reference

Releases

Dashboard

Try Open Source

October 21, 2024

Deploy inference endpoints, train AI models, and autoscale to hundreds of GPUs, without managing infrastructure.

Introduction

Installation

A beginner's guide to running highly performant inference workloads on Beam.

Quickstart

API Reference

CLI Reference

SDK Reference

Container Images

Remote vs. Local Environment

GPU Acceleration

How to store secrets and environment variables in Beam

Storing Secrets

Working in Jupyter Notebooks

Attach distributed storage volumes to your apps

Distributed Storage Volumes

Mounting S3 Buckets

Storing ephemeral files for images, audio files, and more.

Ephemeral Files and Images

Deploying and invoking web endpoints on Beam

Creating a Web Endpoint

Hosting a Web Server

This guide shows how you can optimize performance by pre-loading models when your container first starts.

Pre-Loading Models

Control how long your apps stay running before shutting down.

Keeping Containers Warm

Versioning

Sending file payloads to Endpoints and Web Servers

Sending File Payloads

Running Async Tasks

Querying Task Status

This guide will show you how to run powerful cloud functions with Beam.

Run any Python Remotely

Scheduled Jobs

Scaling out

Using Beam's distributed Queue to coordinate between tasks

Queues

Maps

Autoscaling Containers

Run an OpenAI-Compatible vLLM Server

Stable Diffusion with LoRAs

Fine-tuning Gemma with LoRA

Web Scraping with Beam Functions

Faster Whisper

LLaMA 3.1 8B

You can integrate Beam into an existing CI/CD process to deploy your code automatically.

Integrate into CI/CD

Timeouts

Public Endpoints

Setup a callback to your server when a task finishes running

Task Callbacks

Send Events Between Apps

Accessing information about the runtime while running tasks

Runtime Variables

Cold Start Performance

Beta9 is the open source project that powers Beam

Overview

Learn how to deploy Beam OSS (Beta9) to your local machine.

Local Machine

Learn how to deploy Beam OSS (Beta9) to Amazon EKS.

Amazon Web Services

Pricing and Billing

This is an ongoing list of issues people sometimes encounter while using Beam. If you're having an issue, check this list first.

This tutorial will show you how to migrate a Cog [Hello World](https://github.com/replicate/cog-examples/blob/main/hello-world/predict.py) app to Beam.

Releases

​Features

​Fixes

Features

Fixes