Automated Federated Learning in Mobile-Edge Networks-Fast Adaptation and Convergence

摘要

Federated learning (FL) can be used in mobile-edge networks to train machine learning models in a distributed manner. Recently, FL has been interpreted within a model-agnostic meta-learning (MAML) framework, which brings FL significant advantages in fast adaptation and convergence over heterogeneous data sets. However, existing research simply combines MAML and FL without explicitly addressing how much benefit MAML brings to FL and how to maximize such benefit over mobile-edge networks. In this article, we quantify the benefit from two aspects: 1) optimizing FL hyperparameters (i.e., sampled data size and the number of communication rounds) and 2) resource allocation (i.e., transmit power) in mobile-edge networks. Specifically, we formulate the MAML-based FL design as an overall learning time minimization problem, under the constraints of model accuracy and energy consumption. Facilitated by the convergence analysis of MAML-based FL, we decompose the formulated problem and then solve it using analytical solutions and the coordinate descent method. With the obtained FL hyperparameters and resource allocation, we design an MAML-based FL algorithm, called automated FL (AutoFL), that is able to conduct fast adaptation and convergence. Extensive experimental results verify that AutoFL outperforms other benchmark algorithms regarding the learning time and convergence performance.

关键词