ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Heterogeneous Training Intensity for Federated Learning: A Deep Reinforcement Learning Approach

Zeng, Manying; Wang, Xiumin*; Pan, Weijian; Zhou, Pan华中科技大学
IEEE Transactions on Network Science and Engineering2023-3DOI: 10.1109/TNSE.2022.3225444
3被引13阅读
引用收藏
分享

摘要

Federated learning (FL) has recently received considerable attention in Internet of Things, due to its capability of letting multiple clients collaboratively train machine learning models, without sharing their private information. However, in synchronous FL, the client with weak computing or communication capability may significantly drag down the model training process, which leads to very high waiting latency for other clients. Intuitively, to alleviate this straggler problem, the clients with lower (higher) training capabilities should be assigned with less (more) training intensity. Inspired by this observation, this paper formulates a novel Heterogeneous Training Intensity assignment problem for FL, named HTI_FL, aiming at reducing the largest training latency gap among clients. To address HTI_FL problem, we first propose an optimal deterministic algorithm, which however is only suitable for a static FL context with stable network conditions and clients' computing capabilities. To consider a practical dynamic context, we propose a Deep Reinforcement Learning Approach to learning the network conditions and clients' capabilities, and furthermore adaptively assign training intensities to clients. Finally, simulation results demonstrate the effectiveness of the proposed scheme in reducing the waiting time and accelerating the convergence of FL.

学科与关键词

关键词
TrainingServersData modelsComputational modelingConvergenceSimulationReinforcement learningDeep reinforcement learningfederated learningheterogeneous training intensity
相关
加载中…
  • Heterogeneous Semi-Asynchronous Federated Learning in Internet of Things: A Multi-Armed Bandit Approach
    Chen, Shuai; Wang, Xiumin*; Zhou, Pan; Wu, Weiwei; Lin, Weiwei*; Wang, ZhenyuIEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6(5): 1113-1124.被引 6
  • Client Scheduling and Resource Management for Efficient Training in Heterogeneous IoT-Edge Federated Learning
    Cui, Yangguan; Cao, Kun; Cao, Guitao; Qiu, Meikang; Wei, Tongquan*IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2022, 41(8): 2407-2420.被引 25
  • Efficient Federated Learning Using Layer-Wise Regulation and Momentum Aggregation*
    Zhang, Fan; Fang, Zekuan; Li, Yiming; Chen, Mingsong*JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31(18): 2250314.
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Network Science and Engineering
发表日期
2023-03
卷期
第 10 卷, 第 2 期
页码
990-1002
DOI
10.1109/TNSE.2022.3225444
成果收录
SCIE
资助标注
National Natural Science Foundation of China [61872150, 61972448]; Guangdong Basic and Applied Basic Research Foundation [2022B1515020015, 2020A1515011209]; Science and Technology Program of Guangzhou [202002030426]

作者

  • Z

    Zeng, Manying (第一作者)

  • W

    Wang, Xiumin (通讯)

查看全部 4 位作者收起作者
  • P

    Pan, Weijian

  • Z

    Zhou, Pan

    huazhong univ sci & technol

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417