Using Distributional Principles for the Semantic Study of Contextual Language Models - CEA - Commissariat à l’énergie atomique et aux énergies alternatives Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Using Distributional Principles for the Semantic Study of Contextual Language Models

Résumé

Many studies were recently done for investigating the properties of contextual language models but surprisingly, only a few of them consider the properties of these models in terms of semantic similarity. In this article, we first focus on these properties for English by exploiting the distributional principle of substitution as a probing mechanism in the controlled context of SemCor and WordNet paradigmatic relations. Then, we propose to adapt the same method to a more open setting for characterizing the differences between static and contextual language models.
Fichier principal
Vignette du fichier
102.pdf (215.64 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

cea-03648645 , version 1 (21-04-2022)

Identifiants

Citer

Olivier Ferret. Using Distributional Principles for the Semantic Study of Contextual Language Models. 35th Pacific Asia Conference on Language, Information and Computation, Nov 2021, Shanghai, China. pp.189-200. ⟨cea-03648645⟩
37 Consultations
20 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More