Beam V2 Guide & FAQ
Beam V1 will be deprecated and all data and deployments will be deleted on
September 16, 2024If you have any data in V1 and haven’t migrated yet, make sure you’ve done so before the deadline.
What is V2?
V2 is the next-generation version of Beam.How is V1 different from V2?
From a user perspective, it’s different in a few ways:- Several subtle changes to the SDK
- More control over the CLI
- The dashboard URL is now platform.beam.cloud
- The SDK is now
beam-client - Powered by open source. You can see exactly how Beam works and make PRs with the improvements that you want.
What are the benefits of using V2?
- A100, H100, and A6000 GPUs (and many more GPU types coming soon)
- New abstractions for running functions on Beam (
.map(),.remote(),.local()) - A better experience for moving files around volumes
- A new CLI that gives you more control over your containers and deployments (for example, now you can stop containers in the CLI, or list all deployments that are running)
Why did you decide to make a new dashboard, CLI, etc?
We have grown a lot over the past 12 months, and we ran into problems that prevented us from scaling to support our new users. In addition, there were other gaps in V1 that we’ve closed in V2:- Not enough GPUs – very few A100s, and only had T4s and A10Gs
- Using outputs required you to write callback logic
- No 1:1 mapping between dashboard and CLI (can’t create secrets or stop containers in CLI, etc.)
- Very specific to inference and not really optimized for other workflows like data processing or model training
What about reliability?
V2 is already powering production workloads for our largest customers. We have run load tests on all customer apps before deploying them to production in V2. Reliability remains our highest priority to you as your infrastructure provider.How do I migrate?
Create an account here and message us on Slack so we can migrate your volumes from V1 to V2. While we can help you refactor your code, we recommend refactoring your apps yourself in order to familiarize yourself with the new workflow.It sounds like a lot of stuff is changing. What isn’t changing?
- Fast cold starts
- Reliability
- Developer experience
- White-glove customer support whenever you have questions about using Beam