Understanding the Energy Consumption of HPC Scale Artificial Intelligence - Laboratoire d'Informatique de Grenoble Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Understanding the Energy Consumption of HPC Scale Artificial Intelligence

Résumé

This paper contributes towards better understanding the energy consumption trade-offs of HPC scale Artificial Intelligence (AI), and more specifically Deep Learning (DL) algorithms. For this task we developed benchmark-tracker, a benchmark tool to evaluate the speed and energy consumption of DL algorithms in HPC environments. We exploited hardware counters and Python libraries to collect energy information through software, which enabled us to instrument a known AI benchmark tool, and to evaluate the energy consumption of numerous DL algorithms and models. Through an experimental campaign, we show a case example of the potential of benchmark-tracker to measure the computing speed and the energy consumption for training and inference DL algorithms, and also the potential of Benchmark-Tracker to help better understanding the energy behavior of DL algorithms in HPC platforms. This work is a step forward to better understand the energy consumption of Deep Learning in HPC, and it also contributes with a new tool to help HPC DL developers to better balance the HPC infrastructure in terms of speed and energy consumption.
Fichier principal
Vignette du fichier
main.pdf (221.46 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03845090 , version 1 (09-11-2022)

Identifiants

  • HAL Id : hal-03845090 , version 1

Citer

Danilo Carastan dos Santos, Thi Hoang Thi Pham. Understanding the Energy Consumption of HPC Scale Artificial Intelligence. CARLA 2022 - Latin America High Performance Computing Conference, Sep 2022, Porto Alegre, Brazil. pp.1-14. ⟨hal-03845090⟩
63 Consultations
102 Téléchargements

Partager

Gmail Facebook X LinkedIn More