ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Joint Gradient Sparsification and Device Scheduling for Federated Learning

Lin, Xiaohan; Liu, Yuan*; Chen, Fangjiong*; Ge, Xiaohu; Huang, Yang华中科技大学; 南京航空航天大学; y
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING2023-9DOI: 10.1109/TGCN.2023.3239373
1被引23阅读
引用收藏
分享

摘要

Federated learning is an attractive distributed learning framework where edge server coordinates edge devices to collaboratively train an artificial intelligence (AI) model while training data stays in edge devices. However, implementing federated learning in an energy-efficient way still faces some problems in practice: i) uploading high-dimensional parameters of edge devices is energy-costly and causes communication congestion; ii) The heterogeneity of edge devices, i.e., non-i.i.d. data, different software/hardware configurations, and time-varying channel conditions, affects training accuracy and convergence rate of federated learning. To address these issues, in this paper, we aim at minimizing energy use of the heterogeneous edge devices while maintaining the learning performance. Note that the effects of sparsification and the number of participating devices are highly coupled, and they have opposite effects on both learning performance and energy consumption. Therefore, the gradient sparsification and device scheduling should be jointly optimized for federated learning. We consider the case where a fraction of heterogeneous devices are scheduled to upload their sparsified local gradients for global aggregation at the server. First, a tradeoff between the sparsification and the number of participating devices is revealed through the convergence rate analysis. Then, a joint optimization problem is formulated to minimize energy consumption under the convergence guarantee. An efficient algorithm is proposed to find the globally optimal solution of the considered non-convex problem. Simulations verify the efficiency of the proposed scheme.

学科与关键词

关键词
Edge AIfederated learninggradient sparsificationheterogeneous devicesdevice scheduling
相关
加载中…
  • Efficient Federated Learning in Resource-Constrained Edge Intelligence Networks Using Model Compression
    Chen, Chao; Jiang, Bohang; Liu, Shengli*; Li, Chuanhuang; Wu, Celimuge; Yin, RuiIEEE Transactions on Vehicular Technology, 2024, 73(2): 2643-2655.被引 2
  • Energy Efficient Federated Learning Over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission
    Chen, Rui; Li, Liang; Xue, Kaiping; Zhang, Chi; Pan, Miao*; Fang, YuguangIEEE Transactions on Mobile Computing, 2023, 22(12): 7451-7465.被引 2
  • Training Efficiency of Federated Learning: A Wireless Communication Perspective
    Yang, Shunan*; Liu, Yuan12th International Conference on Wireless Communications and Signal Processing (WCSP), Nanjing, PEOPLES R CHINA, 2020-10-21 To 2020-10-23.被引 7
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING
发表日期
2023-09
卷期
第 7 卷, 第 3 期
页码
1407-1419
DOI
10.1109/TGCN.2023.3239373
成果收录
SCIE
资助标注
National Key Research and Development Program of China [2020YFB1807700]; National Nature Science Foundation of China [61971196, U2001210, 62271208]

作者

  • L

    Lin, Xiaohan (第一作者)

  • L

    Liu, Yuan (通讯)

查看全部 5 位作者收起作者
  • C

    Chen, Fangjiong (通讯)

  • G

    Ge, Xiaohu

    huazhong univ sci & technol

  • H

    Huang, Yang

    nanjing univ aeronaut & astronaut

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417