Generalization of iterative sampling in autoencoders - CEA - Commissariat à l’énergie atomique et aux énergies alternatives Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2020

Generalization of iterative sampling in autoencoders

Résumé

Generative autoencoders are designed to model a target distribution with the aim of generating samples and it has also been shown that specific non-generative autoencoders (i.e. contractive and denoising autoencoders) can be turned into gen-erative models using reinjections (i.e. iterative sampling). In this work, we provide mathematical evidence that any autoencoder reproducing the input data with a loss of information can sample from the training distribution using reinjections. More precisely, we prove that the property of modeling a given distribution and sampling from it not only applies to contractive and denoising autoencoders but also to all lossy autoencoders. In accordance with previous results, we emphasize that the reinjection sampling procedure in autoencoders improves the quality of the sampling. We experimentally illustrate the above property by generating synthetic data with non-generative autoencoders trained on standard datasets. We show that the learning curve of a classifier trained with synthetic data is similar to that of a classifier trained with original data.
Fichier principal
Vignette du fichier
ICMLA_IEEE.pdf (1010.73 Ko) Télécharger le fichier
ICMLA_supplementary_materials.pdf (703.52 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

cea-02917445 , version 1 (19-08-2020)

Identifiants

  • HAL Id : cea-02917445 , version 1

Citer

Miguel Solinas, Clovis Galiez, Romain Cohendet, Stéphane Rousset, Marina Reyboz, et al.. Generalization of iterative sampling in autoencoders. 2020. ⟨cea-02917445⟩
315 Consultations
420 Téléchargements

Partager

Gmail Facebook X LinkedIn More