The Ray Beam Runner Project: Unified batch, streaming, and ML

Apache Beam provides a unified model for developing batch and streaming data analytics pipelines, and the Ray Beam Runner Project is an initiative to introduce a new Pythonic Apache Beam Runner for Ray. The project was conceived based on strong community interest in integrating Ray with Beam, and a prototype quickly proved its viability. We will discuss the current state of this initiative, and our long-term vision to provide a unified authoring and execution environment for mixed-purpose batch, streaming, and ML pipelines.