Slack Community

Beam

Tutorials

Changelog

Start a new project

Dashboard

Managing Apps

Run GPU inference and training jobs on serverless infrastructure that scales with you.

Introduction

Beam consists of a CLI executable and a Python package.

Installation

A beginner's guide to running highly performant inference workloads on Beam.

Quickstart

API Reference

CLI Reference

SDK Reference

A short guide on using Beam to run one-off functions in the cloud

Running Tasks

Setup a callback to your server when a task finishes running

Task Callbacks

Querying Task Status

Cancelling Tasks

Custom Images

GPU Acceleration

How to store secrets and environment variables in Beam

Storing Secrets

This guide shows how you can optimize performance by pre-loading models when your container first starts.

Pre-Loading Models

Use autoscaling strategies to add concurrency to your workloads

Autoscaling and Concurrency

Control how long your apps stay running before shutting down.

Configuring Keep Warm

Storage Volumes

Access files created during task executions

Task Outputs

A short guide on deploying serverless REST APIs using Beam

REST API

Task Queue

A short guide on using Beam to run functions on a schedule

Scheduled Job

ASGI Apps

Live-reload your code changes on a remote container.

Deployment Previews

Calling the API

Versioning

You can integrate Beam into an existing CI/CD process to deploy your code automatically.

Integrate into CI/CD

Streaming Deployment Logs

Fine-Tune an LLM

Llama 2 Inference

Pygmalion 6B

LangChain Chatbot

Hosting a Gradio Frontend

A short tutorial on using pre-trained Huggingface models

Deploying Huggingface Models

Building an API to generate images with stable diffusion.   

Stable Diffusion API

AI Avatars with DreamBooth

Removing Text from Images

Deploying Whisper as a REST API to transcribe YouTube videos

Whisper Video Transcription

Get Top Reddit Posts

Connecting an S3 Bucket

Let's build a simple web scraper which extracts headlines from The New York Times and uses a BERT model from Huggingface to detect the sentiment of each.

Running a Web Scraper

API Keys

Adding Users

Pricing and Billing

This is an ongoing list of issues people sometimes encounter while using Beam. If you're having an issue, check this list first.

Getting Started

Tasks

Customizing the Environment

Data

Web Endpoints

Account

Resources

Security