Image annotation and two paths to text illustration

H. Le Borgne 1 E. Gadeski 1 I. Chami 1 T.Q. Nhi Tran 1 Y. Tamaazousti 1, 2 A.L. Ginsca 1 A. Popescu 1
1 DIASI - Département Intelligence Ambiante et Systèmes Interactifs
2 MICS - Mathématiques et Informatique pour la Complexité et les Systèmes
Abstract : This paper describes our participation to the ImageCLEF 2016 scalable concept image annotation main task and Text Illustration teaser. Regarding image annotation, we focused on better localizing the detected features. For this, we identified the saliency of the image to collect a list of potential interesting places into the image. We also added a specific human attribute detector that boosted the results of the best performing team in 2015. For the text illustration, we proposed two complementary approaches. The first one relies on semantic signatures that give a textual description of an image. This description is further matched to the textual query. The second approach learns a common latent space, in which visual and textual features are directly comparable. We propose a robust description, as well as the use of an auxiliary dataset to improve retrieval. While the first approach only uses external data, the second one was mainly learned from the provided training dataset.
Keywords : Semantics Human attributes Image annotation Main tasks Semantic signatures Textual description Textual features Textual query Training dataset Image analysis
Document type :
Conference papers
Complete list of metadatas
https://hal-cea.archives-ouvertes.fr/cea-01843172
Contributor : Léna Le Roy <>
Submitted on : Wednesday, July 18, 2018 - 3:55:43 PM
Last modification on : Wednesday, January 23, 2019 - 2:39:26 PM

Identifiers

  • HAL Id : cea-01843172, version 1

Collections

CEA | CEA-UPSAY | DRT | CENTRALESUPELEC | LIST | MICS | UNIV-PARIS-SACLAY

Citation

H. Le Borgne, E. Gadeski, I. Chami, T.Q. Nhi Tran, Y. Tamaazousti, et al.. Image annotation and two paths to text illustration. 2016 Working Notes of Conference and Labs of the Evaluation Forum, CLEF 2016, 2016, Evora, Portugal. pp.322-333. ⟨cea-01843172⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

45

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD