Data independent warmup scheme for non-IID federated learning

Mohamad Arafeh, Hakima Ould-Slimane, Hadi Otrok, Azzam Mourad, Chamseddine Talhi, Ernesto Damiani

Research output: Contribution to journalArticlepeer-review

11 Scopus citations

Abstract

Machine Learning's influence increases daily, and its application prevails in different, critical, and life-changing fields. However, collecting the needed data is challenging due to the increasing concerns about clients’ privacy. In this context, federated learning addresses privacy issues by adopting an on-device model training strategy while communicating only the model parameters rather than raw data. Such an approach allows for preserving users’ information and shielding them from harm following malicious or suspicious parties’ dissemination of their private information. Nevertheless, the distributed nature of federated learning makes it vulnerable to the weight divergence problem caused by the Non-IID (Non-Independent And Identically Distributed) clients. As a result, we can observe a substantial accuracy reduction and convergence time increase. In this paper, we propose a scheme for federated learning addressing the Non-IID clients while also handling the dynamic evolution of the learning context without sacrificing the clients’ privacy. Our scheme takes advantage of the client's weights to select a compatible subset with the minimum weight divergence to aggregate the initial global model. Our experiments show that the proposed method can boost the federated learning performance while reducing the convergence time.

Original languageBritish English
Pages (from-to)342-360
Number of pages19
JournalInformation Sciences
Volume623
DOIs
StatePublished - Apr 2023

Keywords

  • Distributed learning
  • Federated learning
  • Genetic algorithm
  • Machine learning
  • Non-IID

Fingerprint

Dive into the research topics of 'Data independent warmup scheme for non-IID federated learning'. Together they form a unique fingerprint.

Cite this