摘要
In this paper, a novel adaptive dynamic programming (ADP)-based optimal control method is developed for discrete-time systems subject to constraints and disturbances. Particularly, a safe policy iteration scheme is designed to handle state and input constraints, including both hard and soft constraints, by converting the original policy improvement strategy into a constrained optimization problem with a prescribed state cost function. After that, an actor-critic-disturbance framework is introduced to address the constrained optimal control problem. The robust safety against disturbances is treated as a two-player zero-sum game, where the actor and disturbance neural networks are used to approximate the optimal control input and the disturbance policy, respectively. The convergence property of the proposed algorithm is analyzed, and the multi-step version of the proposed ADP scheme is derived based on this property. Simulation results are demonstrated and discussed to validate the effectiveness and performance of the proposed method.
学科与关键词
- Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement LearningZhang, Lingzhi; Xie, Lei*; Jiang, Yi; Li, Zhishan; Liu, Xueqin; Su, HongyeIEEE Transactions on Neural Networks and Learning Systems, 2023.
- Adaptive Dynamic Programming for Control: A Survey and Recent AdvancesLiu, Derong*; Xue, Shan; Zhao, Bo; Luo, Biao; Wei, QinglaiIEEE Transactions on Systems Man Cybernetics-Systems, 2021, 51(1): 142-160.被引 222
- Discrete-Time Impulsive Adaptive Dynamic ProgrammingWei, Qinglai*; Song, Ruizhuo; Liao, Zehua; Li, Benkai; Lewis, Frank L.IEEE Transactions on Cybernetics, 2020, 50(10): 4293-4306.被引 72
