Ray RLlib

Ray Train

Ray Datasets

RayDP

Retail

Gaming

Government

Financial

Ray Serve

Anyscale

Ray Core

Healthcare

Technology

Ray Tune

News

User Story

Engineering

Culture

Zhe Zhang

Ion Stoica

Ion Stoica headshot

Ben Lorica

Ray For Success

Four Reasons Why Leading Companies Are Betting On Ray

Ray Ecosystem

What’s new in the Ray Distributed Library Ecosystem

Anyscale Platform

Why you should build your AI Applications with Ray

ExamplesOfToolsMultiCloud

The Emergence of Multi-cloud Native Applications and Platforms

Eric Liang

Eric Liang headshot

Birds

The Ideal Foundation for a General Purpose Serverless Platform

Robert Nishihara

product-figure-1

The Infinite Laptop

Harpa-Kalkofnsvegur-Reykjavík-Detail-1-crop

Here’s what you need to look for in a model server to build ML-powered services

BenIon-blog-post-image-scaled

Five Key Features for a Machine Learning Platform

Understanding the Ray Ecosystem and Community

The Future of Computing is Distributed

In this guide, we will learn how to develop and productionize a retrieval augmented generation (RAG) based LLM application, with a focus on scale, evaluation and routing.  

social-rag-based-llm

Building RAG-based LLM Applications for Production (Part 1)

In this blog, we compare full-parameter fine-tuning with LoRA and answer questions around the strengths and weaknesses of the two techniques. 

lora blog 1

Fine-Tuning LLMs: LoRA or Full-Parameter? An in-depth Analysis with Llama 2

factuality 373 examples

Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaper

In this blog, we provide a thorough analysis and a practical guide for fine-tuning. We examine the Llama-2 models under three real-world use cases, and show that fine-tuning yields significant accuracy improvements across the board (in some niche cases, better than GPT-4). 

Llama 2 performance

Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Models to Unique Applications

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

From the creators of Ray, Anyscale is a framework for building machine learning applications at any scale originating from the UC Berkeley RISELab.

Posts by Ion Stoica

No posts found.