News

User Story

Engineering

Culture

Sang Cho

Sam Chan

image21

Stephanie Wang

image8

Ray Compiled Graphs for Optimized AI Workloads

Ray Compiled Graphs: Optimized AI Workloads with Native GPU Communication

The Anyscale Team

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

Hao Chen

Richard Liaw

Richard Liaw headshot

Praveen Gorthy

Ray Data is available in GA. Get flexible and performant APIs for unstructured data preprocessing, ingest for ML training, and batch inference.

Group 464 (1)

Ray Data GA

Balaji Veeramani

Matthew Connor

See how Anyscale's accelerated metadata fetching improvements can reduce metadata fetching start-up time by up to 4.5 times compared to open-source Ray.

Untitled design (43)

Accelerated Metadata Fetching in Ray Data up to 4.5x Faster on Anyscale

Christopher Chou

Austin Kuo

Edward Oakes

Chris Sivanich

Anyscale speeds up scale-up time, leading to up to 5.1x faster autoscaling for Meta-Llama-3-70B-Instruct on the Anyscale platform vs KubeRay on Amazon EKS.

image4

Autoscaling Large AI Models up to 5.1x Faster on Anyscale

Explore Anyscale's enterprise governance and observability tools. Easily control your AI infrastructure and get visibility into utilization and efficiency.

image1

Enterprise Governance and Observability on Anyscale

Dominic Catalano

Yifei Feng

With the Anyscale Kubernetes Manager (AKM), you can now connect the Anyscale control plane with your customer-managed Kubernetes clusters.

Screenshot 2024-09-30 at 7.03.17 AM

Introducing Anyscale on Kubernetes

Anyscale on Kubernetes: Simplifying AI Workloads on User-Managed Infrastructure

Leverage Anyscale on GCP to build and scale AI/ML models faster and more efficiently than ever before.

Group 490

Anyscale Available on GCP Marketplace

Anyscale Now on GCP Marketplace

Akshay Malik

Explore RayTurbo, Anyscale's optimized Ray runtime. Best price-performance and developer capabilities for AI workloads, built by the team that built Ray.

Screenshot 2024-09-27 at 12.12.40 PM

Announcing RayTurbo

Cody Yu

Scott Lee

Ricky Xu

William Lin

See how Anyscale reduces costs by up to 2.9x compared to online inference providers such AWS Bedrock and OpenAI, and up to 6x in shared prefix scenarios.

Untitled design (41)

Anyscale Batch LLM Inference Slashes Bedrock Costs Up to 6x

Batch LLM Inference on Anyscale slashes AWS Bedrock costs by up to 6x

With Anyscale on AWS Marketplace, you can build, scale, and optimize AI/ML and Generative AI—all within the trusted AWS cloud environment.

Group 491 (1)

Anyscale Available on AWS Marketplace

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

Explore the new and improved Anyscale Workspaces. Get advanced observability features so you spend less time on busywork and more time building AI apps.

Anyscale Share Image

Explore Anyscale’s New UX

Anyscale’s New User Experience: A Comprehensive Overview

Younes Abouelnagah

image2

Roblox Guest Blog: Fast and Efficient Online Model Serving

Kevin Su

Kai-Hsun Chen

Learn how we combine the power of Anyscale and Union to easily construct a batch inference pipeline.

image

Building a RAG Batch Inference Pipeline with Anyscale and Union

Marwan Sarieddine

Screenshot 2024-05-06 at 3.11.06 PM

Kamil Kaczmarek

Fine-tuning Llama-3, Mistral and Mixtral with Anyscale

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

Anyscale

Featured Posts and News

Ray Summit 2024: Breaking Through the AI Complexity Wall

Anyscale’s New User Experience: A Comprehensive Overview

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

No posts found.