News

User Story

Engineering

Culture

Christopher Chou

Austin Kuo

Richard Liaw

Richard Liaw headshot

Edward Oakes

Chris Sivanich

Anyscale speeds up scale-up time, leading to up to 5.1x faster autoscaling for Meta-Llama-3-70B-Instruct on the Anyscale platform vs KubeRay on Amazon EKS.

image4

Autoscaling Large AI Models up to 5.1x Faster on Anyscale

Akshay Malik

Phi Nguyen

Learn how Ray Serve & Anyscale solves common challenges of serving AI in production - improving time to market, reducing cost, and ensuring reliability.

ray-serve-ga-blog

Tackling the Cost & Complexity of Serving AI in Production

Ray Serve: Tackling the cost and complexity of serving AI in production

Jiao Dong

Shreyas Krishnaswamy

Simon Mo

Simon Mo headshot

blog-deployment-graph-api-thumb

blog-recommended-content-code-dark

Multi-model composition with Ray Serve deployment graphs

Archit Kulkarni

blog-runtime-env-thumb

blog-recommended-content-nodes-dark

Handling files and packages on your cluster with Ray runtime environments

Michael Galarnyk

In this post, we explore the 4 common patterns of ML in production and how to implement these patterns using Ray Serve.


Where Ray Serve Fits In

Serving ML Models in Production: Common Patterns

Google + Anyscale

Google Cloud Integrates Anyscale's RayTurbo with GKE

Simplifying AI Development at Scale: Google Cloud Integrates Anyscale's RayTurbo with GKE

Deploy DeepSeek R1 on Anyscale for full control, seamless scalability, and optimized performance across any cloud or accelerator — without vendor lock-in.

Anyscale + DeepSeek

Deploying DeepSeek R1 on Anyscale

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

Explore the new and improved Anyscale Workspaces. Get advanced observability features so you spend less time on busywork and more time building AI apps.

Anyscale Share Image

Explore Anyscale’s New UX

Anyscale’s New User Experience: A Comprehensive Overview

With Anyscale on AWS Marketplace, you can build, scale, and optimize AI/ML and Generative AI—all within the trusted AWS cloud environment.

Group 491 (1)

Anyscale Available on AWS Marketplace

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Don't miss out! Join us for the Ray + AI Infra Summit in NYC on May 20.

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

Anyscale

Featured Posts and News