This talk is an overview of the progress made so far to implement a streaming runner that allows us to use Ray to run stream analytics pipelines written with Apache Beam. This project aims to have a seamless, easy integration that also integrates with Ray Datasets and enables ML use cases with continuous streams of data.

Software Engineer

Ray + streaming: Integrating Ray with Apache Beam

Centered on Ray, the open-source distributed computing framework, Ray Summit brings together ML practitioners, data scientists, and more to discuss the growing demand for distributed computing.

Ray Summit 2022 Logo Dark Blue

Ray Summit 2022 Logo

Ray Logo

Anyscale

Developers, researchers, and engineers are using Ray to build the next generation of scalable AI and machine learning applications. Ray Summit brings the community together — both in person and virtually — to build, learn, and explore everything AI and more on Ray.

By Anyscale

Ray Summit 2022 people and logo

Ray Summit 2022 Logo and People, smaller

From the opening community party at the SF Exploratorium to epic keynotes and deep-dive technical content, you don’t want to miss Ray Summit. No matter your level of experience with Ray, you’ll come away with tools and know-how that will help you to build and deploy large-scale AI and ML applications.

Man taking a photo on his phone

Ray Summit 2022 - Keynote Speakers

Ray Summit is a great opportunity to level up your Ray skills through hands-on training sessions with the builders and maintainers of Ray. We’re offering several pre-conference training sessions on August 22. Space is limited — [reserve your spot now](https://www.myeventi.events/raysummit22/attendee/)!

Training image desktop

Training image mobile

As the annual user conference for the [open source Ray community](https://www.ray.io/community), Ray Summit is a unique opportunity to enhance your Ray skills, build your professional network, and learn what's on the Ray roadmap.

Extend what you can do with Ray by attending hands-on, expert-led workshops and deep dives

Mingle with the world’s top minds in distributed computing, machine learning, and AI

Learn what’s on the Ray roadmap and connect with the builders and maintainers of Ray and Ray libraries

Come connect with the global community of thinkers and disruptors who are building and deploying the next generation of AI and ML applications.

Ray Summit 2022 horizontal logo

chucks

beanbags

register-bottom-mobile

Ready to get involved in the Ray community before the conference? Ask a question in the forums. Open a pull request. Or share why you’re excited with the hashtag __#RaySummit__ on Twitter.

ray22-OG-image

Ray Summit 2022

Ray Summit 2022 - Agenda

From the creators of Ray, Anyscale is a framework for building machine learning applications at any scale originating from the UC Berkeley RISELab.

Lightning Talk

Ray + streaming: Integrating Ray with Apache Beam

About Pablo

Pablo Estrada

Ready to Register?

Join the Conversation