摘要
Federated learning (FL) has recently received considerable attention in Internet of Things, due to its capability of letting multiple clients collaboratively train machine learning models, without sharing their private information. However, in synchronous FL, the client with weak computing or communication capability may significantly drag down the model training process, which leads to very high waiting latency for other clients. Intuitively, to alleviate this straggler problem, the clients with lower (higher) training capabilities should be assigned with less (more) training intensity. Inspired by this observation, this paper formulates a novel Heterogeneous Training Intensity assignment problem for FL, named HTI_FL, aiming at reducing the largest training latency gap among clients. To address HTI_FL problem, we first propose an optimal deterministic algorithm, which however is only suitable for a static FL context with stable network conditions and clients' computing capabilities. To consider a practical dynamic context, we propose a Deep Reinforcement Learning Approach to learning the network conditions and clients' capabilities, and furthermore adaptively assign training intensities to clients. Finally, simulation results demonstrate the effectiveness of the proposed scheme in reducing the waiting time and accelerating the convergence of FL.
学科与关键词
- Heterogeneous Semi-Asynchronous Federated Learning in Internet of Things: A Multi-Armed Bandit ApproachChen, Shuai; Wang, Xiumin*; Zhou, Pan; Wu, Weiwei; Lin, Weiwei*; Wang, ZhenyuIEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6(5): 1113-1124.被引 6
- Client Scheduling and Resource Management for Efficient Training in Heterogeneous IoT-Edge Federated LearningCui, Yangguan; Cao, Kun; Cao, Guitao; Qiu, Meikang; Wei, Tongquan*IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2022, 41(8): 2407-2420.被引 25
- Efficient Federated Learning Using Layer-Wise Regulation and Momentum Aggregation*Zhang, Fan; Fang, Zekuan; Li, Yiming; Chen, Mingsong*JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31(18): 2250314.
