Resistive memories for spike-based neuromorphic circuits

E. Vianello (1) , T. Werner (1) , O. Bichler (2) , A. Valentian (1) , G. Molas (1) , B. Yvert (3, 4) , B. de Salvo (1) , L. Perniola (1)

1 CEA-LETI - Commissariat à l'énergie atomique et aux énergies alternatives - Laboratoire d'Electronique et de Technologie de l'Information
2 DACLE-LIST - Département d'Architectures, Conception et Logiciels Embarqués-LIST
3 UGA [2016-2019] - Université Grenoble Alpes [2016-2019]
4 SCLIN - Clinatec - Centre de recherche biomédicale Edmond J.Safra

In the last decade machine learning algorithms have proven unprecedented performance to solve many real-world detection and classification tasks, for example in image or speech recognition. Despite these advances, there are still some deficits. First, these algorithms require significant memory access thus ruling out an implementation using standard platforms (e.g. GPUs, FPGAS) for embedded applications. Second, most machine leaning algorithms need to be trained with huge data sets (supervised learning). Resistive memories (RRAM) have demonstrated to be a promising candidate to overcome both these constrains. RRAM arrays can act as a dot product accelerator, which is one of the main building blocks in neuromorphic computing systems. This approach could provide improvements in power and speed with respect to the GPU-based networks. Moreover RRAM devices are promising candidates to emulate synaptic plasticity, the capability of synapses to enhance or diminish their connectivity between neurons, which is widely believed to be the basis for learning and memory in the brain. Neural systems exhibit various types and time periods of plasticity, e.g. synaptic modifications can last anywhere from seconds to days or months. In this work we proposed an architecture that implements both Short-And Long-Term Plasticity rules (STP and LTP) using RRAM arrays. We showed the benefits of utilizing both kinds of plasticity with two different applications, visual pattern extraction and decoding of neural signals. LTP allows the neural networks to learn patterns without training data set (unsupervised learning), and STP makes the learning process very robust against environmental noise.

Mots clés: Learning algorithms; Education; Learning systems; Memory architecture; Neural networks; Program processors; Random access storage; RRAM; Speech recognition; Timing circuits; Unsupervised learning; Artificial synapses; Embedded application; Neuromorphic circuits; Neuromorphic computing; Resistive memory (rram); Short term plasticity; Spiking neural networks; Synaptic modification

Domaines: Informatique [cs]

E. Vianello, T. Werner, O. Bichler, A. Valentian, G. Molas, et al.. Resistive memories for spike-based neuromorphic circuits. 2017 IEEE International Memory Workshop (IMW), May 2017, Monterey,, United States. ⟨10.1109/IMW.2017.7939100⟩. ⟨cea-01836851⟩