Posts by Waleed Kadous
Deep Dive: Data Ingest in a Third Generation ML Architecture
Distributed libraries allow improved performance by exploiting the full bandwidth of distributed memory, and giving greater programmability. But how does that actually work? What does the code look like?
In this post, we’ll be looking at a concrete...
Why Third Generation ML Platforms are More Performant
In a previous blog post, we defined a "3rd generation ML platform" as one that offered full programmability for ML workflows. Key to a 3rd generation platform is the concept of a programmable compute layer. In this blog, we report on emerging pattern...
The Third Generation of Production ML Architectures
As technology has advanced, production ML architectures have evolved. One way to see it is in terms of generations: The first generation involved “fixed function” pipelines, while the second generation involved programmability within the pipeline of...
Why I’m joining Anyscale
Anyscale is on an ambitious mission to make distributed computing simple and flexible. And there are reasons to be confident. Anyscale’s library, Ray, demonstrates how it can be done.