Evolutive deep models for online learning on data streams with no storage

Abstract : In recent years Deep Learning based methods gained a growing recognition in many applications and became the state-of-the-art approach in various fields of Machine Learning, such as Object Recognition, Scene Understanding, Natural Language processing and others. Nevertheless, most of the applications of Deep Learning use static datasets which do not change over time. This scenario does not respond well to a big number of recent applications (such as tendency analysis on social networks, video surveillance, sensor monitoring, etc.), especially when working with data streams which require real-time adaptation to the content of the data. In this paper, we propose a model that is able to perform online data classification and can adapt to data classes, never seen by the model before, while preserving previously learned information. Our approach does not need to store and reuse previous observations, which is a big advantage for data-streams applications, since the dataset one wants to work with can potentially be of very large size. To make up for the absence of previous data, the proposed model uses a recently developed Generative Adversarial Network to drive a Deep Convolutional Network for the main classification task. More specifically, we propagate generative models instead of the data itself, to be able to regenerate the historical training data that we didn't keep. We test our proposition on the well known MNIST benchmark database, where our method achieves results close to the state of the art convolutional networks trained by using the full dataset. We also study the impact of dataset re-generation with GANs on the learning process.
Document type :
Conference papers
Complete list of metadatas

Cited literature [6 references]  Display  Hide  Download

https://hal-cea.archives-ouvertes.fr/cea-01832986
Contributor : Pierre Blanchart <>
Submitted on : Monday, July 9, 2018 - 11:38:46 AM
Last modification on : Wednesday, September 4, 2019 - 1:40:15 PM
Long-term archiving on : Tuesday, October 2, 2018 - 7:58:07 AM

File

evolutive-deep-models.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : cea-01832986, version 1

Citation

Andrey Besedin, Pierre Blanchart, Michel Crucianu, Marin Ferecatu. Evolutive deep models for online learning on data streams with no storage. Workshop on Large-scale Learning from Data Streams in Evolving Environments, Sep 2017, Skopje, Macedonia. ⟨cea-01832986⟩

Share

Metrics

Record views

296

Files downloads

86