RL Summit

AlphaDow: Leveraging Ray’s ecosystem to train and deploy an RL industrial production scheduling agent

Tuesday, March 29, 5:45PM UTC

Adam Kelloway from Dow talks about AlphaDow, an RL-based industrial production scheduling agent.


Dow is building a highly automated and intelligent multi-agent digital supply chain where many agents (RL, ML, MIP, and human) interact seamlessly to make better and faster decisions that positively impact customers, financial performance, and shareholders. Several of the digital agents are deployed using Ray Serve, which significantly simplifies their deployment, scaling, and interaction with each other. One of these agents is Dow’s project AlphaDow, which creates reinforcement learning-based agents for production scheduling — a non-trivial daily problem for all of Dow’s many facilities. AlphaDow agents are trained on in-house simulation models using RLLib and Ray Tune running on Azure compute clusters where Ray’s implementation of Population-Based Bandits is used to great effect for hyperparameter tuning. Once trained, these agents are deployed on Dow’s AKS cluster running Ray and Ray Serve.


AlphaDow’s success (thanks in part to Ray) has been the catalyst for accelerating progress towards Dow’s AI strategy and vision. In this talk, Adam will highlight several of the challenges of deploying such advanced models into a legacy industrial setting, as well as how Ray has helped overcome some of these challenges and accelerated deployments in general at Dow.

Resources:

Speakers

Adam Kelloway

Adam Kelloway

Artificial Intelligence Technical Leader, Dow, Inc.

Adam Kelloway is wearing many hats (Data Sci, ML Eng. & Data Eng.) for Dow’s Digital Fulfillment Center as he shapes, grows, and matures Dow’s AI/ML/Data Strategies. When he’s building models those are focused on Dow’s Supply Chain operations. He is driving the adoption of RL, ML, and MIP based agents to accomplish Dow’s multi-agent automated and intelligent digital supply chain. Recent highlights include leveraging Ray Core and Ray Serve to distribute and deploy a hybrid Simulation/Mixed Integer Model for production planning and continued work to productionize RL agents for production scheduling.

Adam has a Master of Engineering (MEng) degree from Imperial College London and a Ph.D. in Chemical Engineering from the University of Minnesota where he focused on the application of process modeling and optimization to the technical and economic feasibility analyses of biomass-based process technologies. He is a member of AICHE and represents Dow on the Manufacturing Leadership Council. He has presented work at numerous conferences including AICHE, Aspen Optimize, Ray Summit, and NeurIPS.

Adam is married to Claire, a physical therapist specializing in neurological rehab, and lives in Houston with their dog Chester.