Slack Community

Github

Twitter

Beam

Examples

Reference

Changelog

Dashboard

Learn how to self-host Beam in the cloud provider of your choice.

Adding GPU Providers

Say goodbye to AWS, Docker, and Terraform. Beam is a new way of running code on the cloud.

Introduction

Installation

Quickstart

Core Concepts

SDK Reference

CLI Reference

API Reference

Node SDK

GPU Acceleration

CPU and RAM

Container Images

How to store secrets and environment variables in Beam

Storing Secrets

Attach distributed storage volumes to your apps

Distributed Storage Volumes

Mounting S3 Buckets

Storing ephemeral files for images, audio files, and more.

Ephemeral Files and Images

Scaling Out

Concurrent Inputs

Parallelizing Functions

Deploying and invoking web endpoints on Beam

Creating a Web Endpoint

Hosting a Web Server

Realtime and Streaming

This guide shows how you can optimize performance by pre-loading models when your container first starts.

Pre-Loading Models

Control how long your apps stay running before shutting down.

Keeping Containers Warm

Versioning

Sending file payloads to Endpoints and Web Servers

Sending File Payloads

Running Async Tasks

Querying Task Status

This guide will show you how to run powerful cloud functions with Beam.

Run any Python Remotely

Scheduled Jobs

Using Beam's distributed Queue to coordinate between tasks

Queues

Maps

Run an OpenAI-Compatible vLLM Server

Serverless ComfyUI API

Stable Diffusion with LoRAs

Fine-tuning Gemma with LoRA

A beginner's guide to running highly performant inference workloads on Beam.

High-Performance ML Inference

Web Scraping with Beam Functions

Faster Whisper

LLaMA 3.1 8B

Mochi 1 Preview

Parler TTS API Example

Beam is launching a new type of agent framework that is stateful and has concurrency built-in. 

Building AI Agents

Example: Research Assistant

You can integrate Beam into an existing CI/CD process to deploy your code automatically.

Integrate into CI/CD

Timeouts

Public Endpoints

Setup a callback to your server when a task finishes running

Task Callbacks

Send Events Between Apps

Accessing information about the runtime while running tasks

Runtime Variables

Cold Start Performance

Working in Jupyter Notebooks

Remote vs. Local Environment

Beta9 is the open source project that powers Beam

Overview

Learn how to deploy Beam OSS (Beta9) to your local machine.

Local Machine

Learn how to deploy Beam OSS (Beta9) to Amazon EKS.

Amazon Web Services

Pricing and Billing

This is an ongoing list of issues people sometimes encounter while using Beam. If you're having an issue, check this list first.

This tutorial will show you how to migrate a Cog [Hello World](https://github.com/replicate/cog-examples/blob/main/hello-world/predict.py) app to Beam.

Migrate from Cog

December 20, 2024

December 19, 2024

December 18, 2024

December 16, 2024

December 12, 2024

December 11, 2024

December 10, 2024

December 6, 2024

December 4, 2024

December 3, 2024

November 30, 2024

November 27, 2024

November 25, 2024

November 23, 2024

November 22, 2024

November 21, 2024

November 19, 2024

November 18, 2024

November 14, 2024

November 13, 2024

November 12, 2024

November 11, 2024

November 7, 2024

November 4, 2024

November 3, 2024

November 1, 2024

October 31, 2024

October 30, 2024

October 29, 2024

October 28, 2024

October 24, 2024

October 22, 2024

October 21, 2024

October 18, 2024

October 17, 2024

October 16, 2024

October 15, 2024

October 12, 2024

October 11, 2024

October 9, 2024

October 8, 2024

October 7, 2024

September 23, 2024

September 4, 2024

August 8, 2024

July 22, 2024

July 11, 2024

July 2, 2024

June 24, 2024

June 14, 2024

Beam V2 Guide & FAQ

These are the terms the Beam Machine Learning Platform is provided under.

Terms and Conditions

Privacy Policy

Start Here

Customizing the Environment

Managing Data

Autoscaling and Concurrency

Endpoints and Web Servers

Task Queues

Serverless Functions

Agents (New)

Other Topics

Self-Hosting

Resources

Security

Adding GPU Providers