ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Multi-Objective Optimization for UAV-Assisted Wireless Powered IoT Networks Based on Extended DDPG Algorithm

Yu, Yu; Tang, Jie*; Huang, Jiayi; Zhang, Xiuyin; So, Daniel Ka Chun; Wong, Kai-Kit6; 1
IEEE Transactions on Communications2021-9DOI: 10.1109/TCOMM.2021.3089476
47被引6阅读
引用收藏
分享

摘要

This paper studies an unmanned aerial vehicle (UAV)-assisted wireless powered IoT network, where a rotary-wing UAV adopts fly-hover-communicate protocol to successively visit IoT devices in demand. During the hovering periods, the UAV works on full-duplex mode to simultaneously collect data from the target device and charge other devices within its coverage. Practical propulsion power consumption model and non-linear energy harvesting model are taken into account. We formulate a multi-objective optimization problem to jointly optimize three objectives: maximization of sum data rate, maximization of total harvested energy and minimization of UAV's energy consumption over a particular mission period. These three objectives are in conflict with each other partly and weight parameters are given to describe associated importance. Since IoT devices keep gathering information from the physical surrounding environment and their requirements to upload data change dynamically, online path planning of the UAV is required. In this paper, we apply deep reinforcement learning algorithm to achieve online decision. An extended deep deterministic policy gradient (DDPG) algorithm is proposed to learn control policies of UAV over multiple objectives. While training, the agent learns to produce optimal policies under given weights conditions on the basis of achieving timely data collection according to the requirement priority and avoiding devices' data overflow. The verification results show that the proposed MODDPG (multi-objective DDPG) algorithm achieves joint optimization of three objectives and optimal policies can be adjusted according to weight parameters among optimization objectives.

学科与关键词

关键词
Wireless communicationOptimizationUnmanned aerial vehiclesEnergy consumptionData modelsWireless sensor networksData collectionInternet of Things (IoT)wireless power transfer (WPT)unmanned aerial vehicle (UAV)multi-objective optimization (MOO)deep deterministic policy gradient (DDPG)
相关
加载中…
  • Trajectory Planning of UAV in Wireless Powered IoT System Based on Deep Reinforcement Learning
    Zhang, Jidong*; Yu, Yu; Wang, Zhigang; Ao, Shaopeng; Tang, Jie; Zhang, Xiuyin; Wong, Kai-KitIEEE/CIC International Conference on Communications in China (ICCC), ELECTR NETWORK, 2020-08-09 To 2020-08-11.被引 7
  • Minimum Throughput Maximization for Multi-UAV Enabled WPCN: A Deep Reinforcement Learning Method
    Tang, Jie; Song, Jingru; Ou, Junhui*; Luo, Jingci; Zhang, Xiuyin; Wong, Kai-KitIEEE Access, 2020, 8: 9124-9132.被引 41
  • Energy-Delay Tradeoff for Dynamic Trajectory Planning in Priority-Oriented UAV-Aided IoT Networks
    Cao, Hailin; Zhu, Wang; Chen, Zhengchuan*; Sun, Zhiwei; Wu, Dapeng OliverIEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7(1): 158-170.被引 1
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Communications
发表日期
2021-09
卷期
第 69 卷, 第 9 期
页码
6361-6374
DOI
10.1109/TCOMM.2021.3089476
语言
ENGLISH
期刊收录
NSL
期刊等级
2区
成果收录
SCIE
资助标注
Nation Key Research and Development Project [2019YFB1804100]; National Natural Science Foundation of China [61971194]; Key Research and Development Project of Guangdong Province [2019B010156003]; Natural Science Foundation of Guangdong Province [2019A1515011607]; Open Research Fund of National Mobile Communications Research Laboratory, Southeast University [2019D06]; Fundamental Research Funds for the Central Universities [2019JQ08]; Research Fund Program of Guangdong Key Laboratory of Aerospace Communication and Networking Technology [2018B030322004]

作者

  • Y

    Yu, Yu (第一作者)

  • T

    Tang, Jie (通讯)

    southeast univ

查看全部 6 位作者收起作者
  • H

    Huang, Jiayi

  • Z

    Zhang, Xiuyin

  • S

    So, Daniel Ka Chun

  • W

    Wong, Kai-Kit

    1 · 6

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417