Resilient reinforcement learning and robust output regulation under denial-of-service attacks

Authors：Gao, Weinan; Deng, Chao^*; Jiang, Yi; Jiang, Zhong-Ping

Source：Automatica, 2022, 142: 110366.

DOI：10.1016/j.automatica.2022.110366

• Reinforcement learning
• Robust output regulation
• Hybrid iteration
• Denial-of-service attacks

In this paper, we have proposed a novel resilient reinforcement learning approach for solving robust optimal output regulation problems of a class of partially linear systems under both dynamic uncertainties and denial-of-service attacks. Fundamentally different from existing works on reinforcement learning, the proposed approach rigorously analyzes both the resilience of closed-loop systems against attacks and the robustness against dynamic uncertainties. Moreover, we have proposed an original successive approximation approach, named hybrid iteration, to learn the robust optimal control policy, that converges faster than value iteration, and is independent of an initial admissible controller. Simulation results demonstrate the efficacy of the proposed approach.

• Institution
  东北大学; 南京邮电大学; 6