Fully synthetic training for image restoration tasks - Laboratoire Traitement et Communication de l'Information Accéder directement au contenu
Article Dans Une Revue Computer Vision and Image Understanding Année : 2023

Fully synthetic training for image restoration tasks

Résumé

In this work, we show that neural networks aimed at solving various image restoration tasks can be successfully trained on fully synthetic data. In order to do so, we rely on a generative model of images, the scaling dead leaves model, which is obtained by superimposing disks whose size distribution is scale-invariant. Pairs of clean and corrupted synthetic images can then be obtained by a careful simulation of the degradation process. We show on various restoration tasks that such a synthetic training yields results that are only slightly inferior to those obtained when the training is performed on large natural image databases. This implies that, for restoration tasks, the geometric contents of natural images can be nailed down to only a simple generative model and a few parameters. This prior can then be used to train neural networks for specific modality, without having to rely on demanding campaigns of natural images acquisition. We demonstrate the feasibility of this approach on difficult restoration tasks, including the denoising of smartphone RAW images and the full development of low-light images.
Fichier principal
Vignette du fichier
hal_cviu.pdf (36.84 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03940525 , version 1 (16-01-2023)

Identifiants

  • HAL Id : hal-03940525 , version 1

Citer

Raphaël Achddou, Yann Gousseau, Saïd Ladjal. Fully synthetic training for image restoration tasks. Computer Vision and Image Understanding, 2023, 233. ⟨hal-03940525⟩
112 Consultations
11 Téléchargements

Partager

Gmail Facebook X LinkedIn More