Image annotation and two paths to text illustration

H. Le Borgne; E. Gadeski; I. Chami; T.Q. Nhi Tran; Y. Tamaazousti; A.L. Ginsca; A. Popescu

Image annotation and two paths to text illustration

H. Le Borgne ¹ E. Gadeski ¹ I. Chami ¹ T.Q. Nhi Tran ¹ Y. Tamaazousti ^{1, 2} A.L. Ginsca ¹ A. Popescu ¹

1 DIASI - Département Intelligence Ambiante et Systèmes Interactifs

2 MICS - Mathématiques et Informatique pour la Complexité et les Systèmes

Abstract : This paper describes our participation to the ImageCLEF 2016 scalable concept image annotation main task and Text Illustration teaser. Regarding image annotation, we focused on better localizing the detected features. For this, we identified the saliency of the image to collect a list of potential interesting places into the image. We also added a specific human attribute detector that boosted the results of the best performing team in 2015. For the text illustration, we proposed two complementary approaches. The first one relies on semantic signatures that give a textual description of an image. This description is further matched to the textual query. The second approach learns a common latent space, in which visual and textual features are directly comparable. We propose a robust description, as well as the use of an auxiliary dataset to improve retrieval. While the first approach only uses external data, the second one was mainly learned from the provided training dataset.

Keywords : Semantics Human attributes Image annotation Main tasks Semantic signatures Textual description Textual features Textual query Training dataset Image analysis

Document type :

Conference papers

Domain :

Computer Science [cs]

Complete list of metadatas

https://hal-cea.archives-ouvertes.fr/cea-01843172
Contributor : Léna Le Roy <>
Submitted on : Wednesday, July 18, 2018 - 3:55:43 PM
Last modification on : Wednesday, January 23, 2019 - 2:39:26 PM

Image annotation and two paths to text illustration

Identifiers

Collections

Citation

Export

Metrics

37

Contact

Image annotation and two paths to text illustration

Identifiers

Collections

Citation

Export

Share

Metrics

37

Contact