FogROS: An Adaptive Framework for Automating Fog Robotics Deployment and Co-scheduling Feature Updates and Queries for Feature Stores
Yafei Liang
EECS Department, University of California, Berkeley
Technical Report No. UCB/EECS-2022-46
May 10, 2022
http://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-46.pdf
As many robot automation applications increasingly rely on multi-core processing or deep- learning models, cloud computing is becoming an attractive and economically viable resource for systems that do not contain high computing power onboard. Despite its immense com- puting capacity, it is often underused by the robotics and automation community due to lack of expertise in cloud computing and cloud-based infrastructure. Fog Robotics balances com- puting and data between cloud edge devices. We propose a software framework, FogROS, as an extension of the Robot Operating System (ROS), the de-facto standard for creating robot automation applications and components. It allows researchers to deploy components of their software to the cloud with minimal e↵ort, and correspondingly gain access to addi- tional computing resources and predeployed software made available by other researchers. To accommodate the real-time update requirements for many Machine Learning models and robotics applications, Feature Stores are fast emerging as a new class of Machine Learning system that maintains intermediate statistics of live data streams used for model training and inference to improve accuracy and save prediction time. Our work is based on RALF, a feature store designed for streaming data and explicitly leverages downstream feedback. Our project explores the impact of lazy evaluation, which postpones feature updates in a feature store, on the three most important aspects of feature stores (i.e., staleness, latency, and costs) and builds an SLO-aware featurization scheduler that reduces the staleness of the queried features by co-scheduling feature updates and query responses.
Advisors: Joseph Gonzalez
BibTeX citation:
@mastersthesis{Liang:EECS-2022-46, Author= {Liang, Yafei}, Editor= {Gonzalez, Joseph and Hellerstein, Joseph M.}, Title= {FogROS: An Adaptive Framework for Automating Fog Robotics Deployment and Co-scheduling Feature Updates and Queries for Feature Stores}, School= {EECS Department, University of California, Berkeley}, Year= {2022}, Month= {May}, Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-46.html}, Number= {UCB/EECS-2022-46}, Abstract= {As many robot automation applications increasingly rely on multi-core processing or deep- learning models, cloud computing is becoming an attractive and economically viable resource for systems that do not contain high computing power onboard. Despite its immense com- puting capacity, it is often underused by the robotics and automation community due to lack of expertise in cloud computing and cloud-based infrastructure. Fog Robotics balances com- puting and data between cloud edge devices. We propose a software framework, FogROS, as an extension of the Robot Operating System (ROS), the de-facto standard for creating robot automation applications and components. It allows researchers to deploy components of their software to the cloud with minimal e↵ort, and correspondingly gain access to addi- tional computing resources and predeployed software made available by other researchers. To accommodate the real-time update requirements for many Machine Learning models and robotics applications, Feature Stores are fast emerging as a new class of Machine Learning system that maintains intermediate statistics of live data streams used for model training and inference to improve accuracy and save prediction time. Our work is based on RALF, a feature store designed for streaming data and explicitly leverages downstream feedback. Our project explores the impact of lazy evaluation, which postpones feature updates in a feature store, on the three most important aspects of feature stores (i.e., staleness, latency, and costs) and builds an SLO-aware featurization scheduler that reduces the staleness of the queried features by co-scheduling feature updates and query responses.}, }
EndNote citation:
%0 Thesis %A Liang, Yafei %E Gonzalez, Joseph %E Hellerstein, Joseph M. %T FogROS: An Adaptive Framework for Automating Fog Robotics Deployment and Co-scheduling Feature Updates and Queries for Feature Stores %I EECS Department, University of California, Berkeley %D 2022 %8 May 10 %@ UCB/EECS-2022-46 %U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-46.html %F Liang:EECS-2022-46