User Tools

Site Tools


projects:year8:8a.026.uva

8a.026.UVA - Graph Reinforcement Learning for Smart Manufacturing

Project - Summary

  • Control of manufacturing systems has been studied in a previous CVDI project. However, this work assumed that information was shared hierarchically but not between individual entities (e.g. machines, systems, lines).
  • Previous attempts to model large systems, such as manufacturing systems, can suffer from explosion of action and state space or fails to capture the dependencies among individual elements in the system.
  • This project will study and characterize improvement to automatic control of manufacturing systems when information, such as queues and health estimates, is shared.
  • Graphs can be used to model many systems such as social networks, traffic networks, and manufacturing systems. This project will model the manufacturing system as a graph.
  • (Graph Neural Networks) GNNs are a recently developed method of encoding information in graphs.
  • GNNs' message passing between the modes of graphs captures the dependence of nodes. This provide us the potential to use GNNs as a framework for cooperative multi-agent RL.
  • We propose to investigate the use of GNNs to form a multi-agents reinforcement learning framework, provide insights to control large-scale manufacturing systems with Internet of Things capabilities.

Project - Team

Team Member Role Email Phone Number Academic Site/IAB
Peter Beling PI pb3a@virginia.edu (804) 982-2066 University of Virginia
Stephen Adams Research Scientist sca2c@virginia.edu (757) 870-4954 University of Virginia
Jianyu Su Student js9wv@virginia.edu Not available University of Virginia
Funded by: U-ANGEL

Project - Novelty of Approach

  • This project seeks to determine the feasibility and effectiveness of multi-agent graph reinforcement learning
  • The proposed methods will be tested on case implementation in IAB member defined setting

Project - Deliverables

Deliverables
1 Source code
2 Report of results

Project - Benefits to IAB

  • Improved model performance which scales better with the sizes of systems
  • Ability to achieve cooperative policies for elements in a large system
  • In commercial or engineering settings, improved decision intelligence

Project - Documents

FilenameFilesizeLast modified
8a.026.uva_year_8_final_report.docx901.0 KiB2020/11/05 13:30
8a.026.uva_year_8_project_proposal_revised_09.27.2019.docx52.4 KiB2019/09/27 11:38

Life Form Feedback

Year 8 Project Poster Session Feedback (Fall 2019)
Real name Great Progress On Course Needs Change Off Course Abstain
Kimmo Valtonen (kimmo.valtonen)     
Sumit Shah (sumit.shah)     
Count:02000
projects/year8/8a.026.uva.txt · Last modified: 2019/10/22 11:57 by matt.delcambre