ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning

Zhang, Lingzhi; Xie, Lei*; Jiang, Yi; Li, Zhishan; Liu, Xueqin; Su, Hongye浙江大学; 5
IEEE Transactions on Neural Networks and Learning Systems2023-10-31DOI: 10.1109/TNNLS.2023.3326397
26阅读
引用收藏
分享

摘要

The state and input constraints of nonlinear systems could greatly impede the realization of their optimal control when using reinforcement learning (RL)-based approaches since the commonly used quadratic utility functions cannot meet the requirements of solving constrained optimization problems. This article develops a novel optimal control approach for constrained discrete-time (DT) nonlinear systems based on safe RL. Specifically, a barrier BF) is introduced and incorporated with the value function to help transform a constrained optimization problem into an unconstrained one. Meanwhile, the minimum of such an optimization problem can be guaranteed to occur at the origin. Then a constrained policy iteration (PI) algorithm is developed to realize the optimal control of the nonlinear system and to enable the state and input constraints to be satisfied. The constrained optimal control policy and its corresponding value function are derived through the implementation of two neural networks (NNs). Performance analysis shows that the proposed control approach still retains the convergence and optimality properties of the traditional PI algorithm. Simulation results of three examples reveal its effectiveness.

学科与关键词

关键词
Barrier BF)constrained policy iteration (PI)discrete-time (DT) nonlinear systemsoptimal controlsafe reinforcement learning (RL)
相关
加载中…
  • Reinforcement learning based adaptive optimal control for constrained nonlinear system via a novel state-dependent transformation
    Yan, Lei; Liu, Zhi*; Zhang, Yun; Wu, Zongze; Chen, C. L. PhilipISA TRANSACTIONS, 2023, 133: 29-41.被引 4
  • Reinforcement Learning-Based Optimal Stabilization for Unknown Nonlinear Systems Subject to Inputs With Uncertain Constraints
    Zhao, Bo*; Liu, Derong; Luo, ChaominIEEE Transactions on Neural Networks and Learning Systems, 2020, 31(10): 4330-4340.被引 115
  • Safe Reinforcement Learning-Based Robust Approximate Optimal Control for Hypersonic Flight Vehicles
    Shi, Lei; Wang, Xuesong; Cheng, Yuhu*IEEE Transactions on Vehicular Technology, 2023, 72(9): 11401-11414.被引 7
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Neural Networks and Learning Systems
发表日期
2023-10-31
DOI
10.1109/TNNLS.2023.3326397
语言
ENGLISH
成果收录
SCIE
资助标注
National Nature Science Foundation of China [62073286]; Science Fund for Creative Research Groups of the National Natural Science Foundation of China [61621002]; Research Grants Council of the Hong Kong Special Administrative Region, China [CityU PDFS2324-1S02]

作者

  • Z

    Zhang, Lingzhi (第一作者)

    zhejiang univ

  • X

    Xie, Lei (通讯)

    zhejiang univ

查看全部 6 位作者收起作者
  • J

    Jiang, Yi

  • L

    Li, Zhishan

    zhejiang univ

  • L

    Liu, Xueqin

    5

  • S

    Su, Hongye

    zhejiang univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417