Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task

Résumé

In this paper, we present a study on a French Spoken Language Understanding (SLU) task: the MEDIA task. Many works and studies have been proposed for many tasks, but most of them are focused on English language and tasks. The exploration of a richer language like French within the framework of a SLU task implies to recent approaches to handle this difficulty. Since the MEDIA task seems to be one of the most difficult, according to several previous studies, we propose to explore Neural Networks approaches focusing of three aspects: firstly, the Neu-ral Network inputs and more specifically the word embeddings; secondly, we compared French version of BERT against the best setup through different ways; Finally, the comparison against State-of-the-Art approaches. Results show that the word embeddings trained on a small corpus need to be updated during SLU model training. Furthermore, the French BERT fine-tuned approaches outperform the classical Neural Network Architectures and achieves state of the art results. However, the contextual embeddings extracted from one of the French BERT approaches achieve comparable results in comparison to word embedding, when integrated into the proposed neural architecture.
Fichier principal
Vignette du fichier
Coling2020(3).pdf (122.65 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03007482 , version 1 (16-11-2020)

Identifiants

  • HAL Id : hal-03007482 , version 1

Citer

Sahar Ghannay, Christophe Servan, Sophie Rosset. Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task. In Proceedings of The 28th International Conference on Computational Linguistics (COLING’2020), 2020, Dec 2020, Barcelona (online), Spain. ⟨hal-03007482⟩
133 Consultations
157 Téléchargements

Partager

Gmail Facebook X LinkedIn More