Ray RLlib

Ray Train

Ray Datasets

RayDP

Retail

Gaming

Government

Financial

Ray Serve

Anyscale

Ray Core

Healthcare

Technology

News

User Story

Engineering

Culture

Sam Chan

image21

Ray Spotlight

Ray Spotlight: How we delivered Ray weekly releases

Goku Mohandas

Execute end-to-end LLM workflows to develop & productionize LLMs at scale.

End-to-end LLM Guide header

End-to-end LLM Workflows Guide

Cindy Zhang

image6

image9

Ray Spotlight Series: Multitenant Serve Applications with Runtime Envs as Containers

Marwan Sarieddine

Screenshot 2024-05-06 at 3.11.06 PM

Natalia Czerep

Mateusz Kwasniak

Artur Zygadło

Cross-modal-Search-for-E-commerce

Cross-modal Search for E-commerce: Building and Scaling a Cross-Modal Image Retrieval App

Max Pumperla

Max Pumperla headshot

Figure 1. End-to-end Stable Diffusion training architecture diagram.

End-to-end Stable Diffusion training architecture diagram

We Pre-Trained Stable Diffusion Models on 2 billion Images and Didn't Break the Bank - Definitive Guides with Ray Series

The Anyscale Team

Ray Meetup Logo

Easily Debug Ray Applications with Ray Distributed Debugger

stable-diffusion-processing-2-billion

Processing 2 Billion Images for Stable Diffusion Model Training - Definitive Guides with Ray Series

Yunxuan Xiao

771b7d9216ffb9c9f04e8521d896b37a

Hao Chen

In this blog post, we introduce an advanced pre-training solution for Stable Diffusion v2 models, leveraging the power of the Ray and Anyscale Platform to enhance scalability and cost efficiency.  

Scalable and Cost-Efficient Stable Diffusion Pre-training with Ray

Reducing the Cost of Pre-training Stable Diffusion by 3.7x with Anyscale

Ray Summit 2024, the annual Ray community conference, is back in San Francisco, CA this September 30th through October 2nd. It is a two-day event with a third day dedicated to training.

Call for Proposals is open Blog Post

Ray Summit 2024 Call for Proposals is now open

Ramit Hora

Intel and Anyscale have integrated Ray with Gaudi3. Gaudi3 is AI-optimized for efficient training and other machine learning workloads.

Anyscale - Intel

Accelerating AI: Harnessing Intel(R) Gaudi(R) 3 with Ray 2.10

Update on Ray CVE-2023-48022: New Verification Tooling Available

Neelay Shah

Akshay Malik

Anyscale is teaming with NVIDIA to combine the developer productivity of Ray Serve and RayLLM with the cutting-edge optimizations from NVIDIA Triton Inference Server software and the NVIDIA TensorRT-LLM library.

NVIDIA-Anyscale Logo 1280x680.jpg

Low-latency Generative AI Model Serving with Ray, NVIDIA Triton Inference Server, and NVIDIA TensorRT-LLM

Artur Niederfahrenhorst

Kourosh Hakhamaneshi

Based on the popular “Needle In a Haystack” benchmark and RAG, we share our process of creating a problem-specific fine-tuning dataset to extend the context of models to build better RAG systems.

fine tuning llms query featured

Fine-tuning LLMs for longer context and better RAG systems

Scott Lee

Kyle Huang

Cheng Su

Generating embeddings is a critical task for developing successful RAG applications, and Anyscalew with Pinecone is the most cost-efficient solution for this workflow.

blog-anyscale-pincone

RAG at Scale: 10x Cheaper Embedding Computations with Anyscale and Pinecone

llm-api-leaderboard-compare

Comparing LLM performance: Introducing the Open Source Leaderboard for LLM APIs

Endpoints Team

Anyscale Endpoints is the first LLM APIs providing a wide range of capabilities to empower developers to build their applications not just from serving and fine tuning LLMs, but also leveraging embedding services and function calling.

anyscale-endpoints-llama-and-orca

Anyscale Endpoints: JSON Mode, Function calling, New models: Llama Guard and Mistral-7B-OpenOrca

JSON Mode and Function calling Features

Anyscale Endpoints: JSON Mode and Function calling Features

Portkey and Anyscale Endpoints, when used in combination, offer a comprehensive LLMOps stack for developing AI applications with open-source Large Language Models (LLMs).

portkey-and-anyscale

Portkey ♥️ Anyscale Endpoints

The Ray Summit 2025 CfP is now open for submissions. The premier AI conference will be held November 3-5 in San Francisco, and the due date for CfPs is July 14th, 2025.  

Ray Summit 2025 CFP Open

Ray Summit 2025: Call for Proposals Closes on July 14th, 2025

Google + Anyscale

Google Cloud Integrates Anyscale's RayTurbo with GKE

Simplifying AI Development at Scale: Google Cloud Integrates Anyscale's RayTurbo with GKE

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

The Call for Speakers for Ray Summit 2025 has Been Extended!

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

All Posts