Skip to Main content Skip to Navigation
New interface
Journal articles

Are SNNs really more energy-efficient than ANNs? An in-depth hardware-aware study

Manon Dampfhoffer 1, * Thomas Mesquida 2 Alexandre Valentian 2 Lorena Anghel 1 
* Corresponding author
2 LSTA - Laboratoire Systèmes-sur-puce et Technologies Avancées
UGA - Université Grenoble Alpes, DSCIN - Département Systèmes et Circuits Intégrés Numériques : DRT/LIST/DSCIN
Abstract : Spiking Neural Networks (SNNs) hold the promise of lower energy consumption in embedded hardware due to their spike-based computations compared to traditional Artificial Neural Networks (ANNs). The relative energy efficiency of this emerging technology compared to traditional digital hardware has not been fully explored. Many studies do not consider memory accesses, which account for an important fraction of the energy consumption, use naive ANN hardware implementations, or lack generality. In this paper, we compare the relative energy efficiency of classical digital implementations of ANNs with novel event-based SNN implementations based on variants of the Integrate and Fire (IF) model. We provide a theoretical upper bound on the relative energy efficiency of ANNs, by computing the maximum possible benefit from ANN data reuse and sparsity. We also use the Eyeriss ANN accelerator as a case study. We show that the simpler IF model is more energy-efficient than the Leaky IF and temporal continuous synapse models. Moreover, SNNs with the IF model can compete with efficient ANN implementations when there is a very high spike sparsity, i.e. between 0.15 and 1.38 spikes per synapse per inference, depending on the ANN implementation. Our analysis shows that hybrid ANN-SNN architectures, leveraging a SNN event-based approach in layers with high sparsity and ANN parallel processing for the others, are a promising new path for further energy savings.
Document type :
Journal articles
Complete list of metadata

https://hal-cea.archives-ouvertes.fr/cea-03852141
Contributor : Contributeur MAP CEA Connect in order to contact the contributor
Submitted on : Monday, November 14, 2022 - 6:30:37 PM
Last modification on : Thursday, November 17, 2022 - 3:57:25 AM

File

Are_SNNs_Really_More_Energy_Ef...
Publication funded by an institution

Identifiers

Collections

Citation

Manon Dampfhoffer, Thomas Mesquida, Alexandre Valentian, Lorena Anghel. Are SNNs really more energy-efficient than ANNs? An in-depth hardware-aware study. IEEE Transactions on Emerging Topics in Computational Intelligence, 2022, 2022, pp.1-11. ⟨10.1109/TETCI.2022.3214509⟩. ⟨cea-03852141⟩

Share

Metrics

Record views

0

Files downloads

0