Deployment Logs

Traffic Metrics

Slack Community

Github

Twitter

Beam

Tutorials

Releases

Try Open Source

Dashboard

After deploying your app, you can view traffic and container logs in the dashboard.

Logging and Monitoring

Run GPU inference and training jobs on serverless infrastructure that scales with you.

Introduction

Installation

This guide will show you how to run powerful cloud functions with Beam.

Quickstart

API Reference

CLI Reference

SDK Reference

Beam consists of a CLI executable and a Python package.

A beginner's guide to running highly performant inference workloads on Beam.

Custom Images

GPU Acceleration

How to store secrets and environment variables in Beam

Storing Secrets

This guide shows how you can optimize performance by pre-loading models when your container first starts.

Pre-Loading Models

Use autoscaling strategies to add concurrency to your workloads

Autoscaling and Concurrency

Control how long your apps stay running before shutting down.

Configuring Keep Warm

Remote vs. Local Environment

Creating a Web Endpoint

Versioning

Example: Huggingface Inference

Running Async Tasks

Querying Task Status

A short guide on using Beam to run one-off functions in the cloud

Running Functions Remotely

Scaling out

Sharing State

Attach cloud storage volumes to your apps

Mounting Storage Volumes

Uploading Files

How to access the files in storage volumes

Reading and Writing Data

Configuring Autoscaling

Deploying Stable Diffusion with custom LoRAs on Beam

Stable Diffusion with LoRAs

Sending Events Between Apps

Timeouts

Public Endpoints

Setup a callback to your server when a task finishes running

Task Callbacks

Learn how to self-host Beam on your own cloud account

Hosting in your cloud

Learn how to self-host Beta9 in your own AWS account.

Deploying on AWS

Storage Volumes

Access files created during task executions

Task Outputs

A short guide on deploying serverless REST APIs using Beam

REST API

Task Queue

A short guide on using Beam to run functions on a schedule

Scheduled Job

ASGI Apps

Live-reload your code changes on a remote container.

Deployment Previews

Calling the API

You can integrate Beam into an existing CI/CD process to deploy your code automatically.

Integrate into CI/CD

Streaming Deployment Logs

Running Tasks

Cancelling Tasks

Fine-Tune an LLM

Llama 2 Inference

Pygmalion 6B

LangChain Chatbot

Hosting a Gradio Frontend

A short tutorial on using pre-trained Huggingface models

Deploying Huggingface Models

Building an API to generate images with stable diffusion.   

Stable Diffusion API

AI Avatars with DreamBooth

Removing Text from Images

Deploying Whisper as a REST API to transcribe YouTube videos

Whisper Video Transcription

Get Top Reddit Posts

Connecting an S3 Bucket

Let's build a simple web scraper which extracts headlines from The New York Times and uses a BERT model from Huggingface to detect the sentiment of each.

Running a Web Scraper

February 9, 2024

January 3, 2024

November 4, 2023

October 4, 2023

August 31, 2023

July 27, 2023

API Keys

Managing Apps

Adding Users

Pricing and Billing

This is an ongoing list of issues people sometimes encounter while using Beam. If you're having an issue, check this list first.

This tutorial will show you how to migrate a Cog [Hello World](https://github.com/replicate/cog-examples/blob/main/hello-world/predict.py) app to Beam.

Getting Started

Customizing the Environment

Endpoint

Task Queue

Function

Volume

Autoscaling and Concurrency

Guides

Other Topics

Self-Hosting

Resources

Security

Logging and Monitoring

Deployment Logs

Traffic Metrics

Getting Started

Customizing the Environment

Endpoint

Task Queue

Function

Volume

Autoscaling and Concurrency

Guides

Other Topics

Self-Hosting

Resources

Security

​Deployment Logs

​Traffic Metrics

Deployment Logs

Traffic Metrics