News

User Story

Engineering

Culture

Cody Yu

Scott Lee

Ricky Xu

William Lin

Praveen Gorthy

Richard Liaw

Richard Liaw headshot

See how Anyscale reduces costs by up to 2.9x compared to online inference providers such AWS Bedrock and OpenAI, and up to 6x in shared prefix scenarios.

Untitled design (41)

Anyscale Batch LLM Inference Slashes Bedrock Costs Up to 6x

Batch LLM Inference on Anyscale slashes AWS Bedrock costs by up to 6x

The Ray Summit 2025 CfP is now open for submissions. The premier AI conference will be held November 3-5 in San Francisco, and the due date for CfPs is July 14th, 2025.  

Ray Summit 2025 CFP Open

Ray Summit 2025: Call for Proposals Closes on July 14th, 2025

Google + Anyscale

Google Cloud Integrates Anyscale's RayTurbo with GKE

Simplifying AI Development at Scale: Google Cloud Integrates Anyscale's RayTurbo with GKE

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Call for Papers for the vLLM Featured Track at Ray Summit is now Open!

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

Anyscale

Featured Posts and News

Ray Summit 2025: Call for Proposals Closes on July 14th, 2025

Simplifying AI Development at Scale: Google Cloud Integrates Anyscale's RayTurbo with GKE

Ray Summit 2024: Breaking Through the AI Complexity Wall

Batch LLM Inference on Anyscale slashes AWS Bedrock costs by up to 6x