An adaptive meta-reinforcement learning framework for dynamic flexible job shop scheduling

Wu, Lincong, Li, Xiaoxia ORCID: https://orcid.org/0000-0003-0887-4952 , Lu, Xin, Feng, Zaiwen and Jing, Yanguo ORCID: https://orcid.org/0000-0001-9581-4215 (2025) An adaptive meta-reinforcement learning framework for dynamic flexible job shop scheduling. IEEE Transactions on Automation Science and Engineering .

Preview

PDF - Accepted Version Available under License CC BY-NC Download (3MB) | Preview

Abstract

The optimization of flexible job shop scheduling is essential for improving manufacturing efficiency and performance in dynamic production environments. However, existing scheduling methods face challenges in scalability and adaptability, which limits their effectiveness in such environments. To address these limitations, this paper proposes a generalized and modular DFJSP framework that systematically decomposes shop-floor elements into key modules, enabling flexible and resilient scheduling under dynamic conditions. Building on this framework, an Adaptive Markov Decision Process (AMDP) is formulated to capture real-time shop-floor states and guide optimal action selection. Leveraging Meta-Reinforcement Learning (MRL), the proposed approach integrates Model-Agnostic Meta-Learning (MAML) with Proximal Policy Optimization (PPO) to facilitate rapid adaptation to new scheduling tasks while enhancing policy generalization. Numerical experiments demonstrate that the framework effectively balances multiple dynamic objectives, including makespan and energy consumption, and adapts efficiently to real-time variations in job priorities, machine availability, and processing times. The results highlight the potential of combining modular problem formulation, AMDP modeling, and MRL for scalable, efficient, and robust DFJSP solutions in modern manufacturing environments.

Item Type:	Article
Journal / Publication Title:	IEEE Transactions on Automation Science and Engineering
Publisher:	Institute of Electrical and Electronics Engineers
ISSN:	1545-5955 / 1558-3783
Departments:	Institute of Business, Industry and Leadership > Business
Additional Information:	Professor Yanguo Jing, Dean, Professor in Artificial Intelligence, University of Cumbria, UK.
Depositing User:	Anna Lupton
Date Deposited:	04 Nov 2025 09:38
Last Modified:	04 Nov 2025 09:45
URI:	https://insight.cumbria.ac.uk/id/eprint/9157

Downloads