Ray Spotlight Series: Multitenant Serve Applications with Runtime Envs as Containers
- Type
- Blogs
- Website
- anyscale.com
- Listed
- 19 September 2026
- Updated
- 20 September 2026
- Author
- Sam Chan
- Publisher
- Anyscale
- Published
- 13 June 2024
In this Ray Spotlight Series interview, Sam Chan and Cindy Zhang discuss multi-application support on Ray Serve, which allows different applications to run on the same cluster using runtime environments as containers. This approach helps manage resources more effectively and reduces operational complexity, as applications can be upgraded independently. Previously, multi-application support launched last summer enabled serving multiple independent applications on a single Ray cluster, but users who preferred not to install dependencies at runtime had to bundle all model dependencies into one.