News

User Story

Engineering

Culture

Akshay Malik

Edward Oakes

Phi Nguyen

Learn how Ray Serve & Anyscale solves common challenges of serving AI in production - improving time to market, reducing cost, and ensuring reliability.

ray-serve-ga-blog

Tackling the Cost & Complexity of Serving AI in Production

Ray Serve: Tackling the cost and complexity of serving AI in production

Toby Rahloff

Alex Streed

image1

LiveEO accelerates and optimizes their geospatial workloads by up to 65% using Anyscale and Prefect Cloud. 


liveeo-usecases

LiveEO supercharges their ML infrastructure and accelerates their geospatial workloads practice

Jiao Dong

Hao Zhang

Lianmin Zheng

Jun Gong

Jules S. Damji

In part 2 of our generative AI blog series, we cover how Ray empowers large language models (LLM) frameworks such as Alpa.

Figure 5: Technical integration layered stack for LLM


Figure-5

High-Performance LLM Training at 1000 GPU Scale With Alpa & Ray

Training 175B Parameter Language Models at 1000 GPU scale with Alpa and Ray

 Max Mergenthaler

Together, Ray, Fugue and Nixtla provide a powerful open-source solution for organizations looking to perform forecasting and anomaly detection at scale.

Nixtla and Ray

Forecasting at Scale With Nixtla and Ray | Anyscale

Forecasting at Scale

Using Anyscale with Weights & Biases simplifies MLOps with a built-in integration that allows for scalability, reproducibility and consistency.

Weights&Biasesflow

Simplify ML Development Cycle with Anyscale and Weights & Biases

Simplify your ML Development Cycle with Anyscale and Weights & Biases

Antoine Galataud

Inouk Bourgon

Adrien Lafond

foobot_architecture

Foobot optimizes building energy efficiency by training fully autonomous control agents for HVAC systems, bringing energy savings to office buildings, hospitals, schools and commercial buildings.

Learn the 3 key features that will be critical to ensuring that your ML platform is well-positioned for modern AI applications.

Figure3-Shopify-Merlin-platform

Top 3 Key Elements of a Scalable ML Platform | Anyscale

Three Key Elements of a Scalable ML Platform 

Jake Carter

BlogBiolexis on Anyscale (4)

Biolexis Boosts Their New AI/ML Drug Discovery Platform Using Anyscale’s Fully-Managed Ray Platform

Houssem Eddine Gharbi

Tim Kreienkamp

Blog Adtriba on Anyscale (4)

Adtriba Accelerates and Advances Media Mix Modeling Using the Anyscale Fully-Managed Ray Platform

blog-fastapi-ray-serve-thumb

blog-recommended-content-rings

Ray Serve + FastAPI: The best of both worlds

blog-simplify-mlops-thumb

blog-recommended-content-code-dark

Simplify your MLOps with Ray & Ray Serve

blog-challenges-of-deploying-ml-thumb

blog-recommended-content-nodes-light

Challenges of deploying ML models in production

Ray Summit 2024, the annual Ray community conference, is back in San Francisco, CA this September 30th through October 2nd. It is a two-day event with a third day dedicated to training.

Call for Proposals is open Blog Post

Ray Summit 2024 Call for Proposals is now open

Intel and Anyscale have integrated Ray with Gaudi3. Gaudi3 is AI-optimized for efficient training and other machine learning workloads.

Anyscale - Intel

Accelerating AI: Harnessing Intel(R) Gaudi(R) 3 with Ray 2.10

Anyscale is teaming with NVIDIA to combine the developer productivity of Ray Serve and RayLLM with the cutting-edge optimizations from NVIDIA Triton Inference Server software and the NVIDIA TensorRT-LLM library.

NVIDIA-Anyscale Logo 1280x680.jpg

Low-latency Generative AI Model Serving with Ray, NVIDIA Triton Inference Server, and NVIDIA TensorRT-LLM

Generating embeddings is a critical task for developing successful RAG applications, and Anyscalew with Pinecone is the most cost-efficient solution for this workflow.

blog-anyscale-pincone

RAG at Scale: 10x Cheaper Embedding Computations with Anyscale and Pinecone

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Hosted Anyscale is in Private Preview. Click here to request access!

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

Anyscale

Posts by Phi Nguyen

No posts found.