The Modern AI Infrastructure trusted by CohereOpenAIUberCanvaJasper

Ray is the most popular open source framework for scaling and productionizing AI workloads. From Generative AI and LLMs to computer vision, Ray powers the world’s most ambitious AI workloads.

The Leader in Performance


Higher throughput*


Lower cost*


Time to scale to 1000 nodes


World record for shuffling 100TB*

Trusted by the world’s leading AI teams

From ChatGPT to Spotify recommendations to Uber ETA predictions, see how innovators are succeeding with Ray and Anyscale.


"At OpenAI, we are tackling some of the world’s most complex and demanding computational problems. Ray powers our solutions to the thorniest of these problems and allows us to iterate at scale much faster than we could before. As an example, we use Ray to train our largest models, including ChatGPT."

Greg Brockman

Co-founder and President

LLM / Gen AI

"We chose Ray as the unified compute backend for our machine learning and deep learning platform because it has allowed us to significantly improve performance and fault tolerance, while also reducing the complexity of our technology stack. Ray has brought significant value to our business, and has enabled us to rapidly pretrain, fine-tune and evaluate our LLMs."

Min Cai

Distinguished Engineer

AWS Logo

"One of the biggest problems that Ray helped us resolve is improving scalability, latency, and cost-efficiency of very large workloads. We were able to improve the scalability by an order of magnitude, reduce the latency by over 90%, and improve the cost efficiency by over 90%. It was financially infeasible for us to approach that problem with any other distributed compute framework that we tried."

Patrick Ames

Principal Engineer

Efficiently scale all of your ML workloads

Open Source


The open source, scalable, and flexible framework for all of your AI workloads and Python applications.

  • Single framework for training, batch and real time workloads running on top of CPUs, GPUs and xPUs
  • Support for Graviton, Trainium, Inferentia, TPUs and GPUs out of the box

Anyscale Platform

The AI application managed platform by the Ray creators

  • Accelerate experiments across your teams with Anyscale Workspaces
  • Seamless transition from research to production with Anyscale jobs and Services
  • Smart scheduler across multi clouds, regions, zones and instance types for better compute cost efficiency and availability

Ready to try Anyscale?

Access Anyscale today to see how companies using Anyscale and Ray benefit from rapid time-to-market and faster iterations across the entire AI lifecycle.