Automatic Identification of Maghreb Dialects Using a Dictionary-Based Approach

Houda Saadane (1) , Hosni Seffih , Christian Fluhr (2) , Khalid Choukri (3) , Nasredine Semmar (4)

1 LIDILEM - LInguistique et DIdactique des Langues Étrangères et Maternelles
2 LIC2M - Laboratoire Ingénierie de la Connaissance Multimédia Multilingue
3 ELDA - Evaluations and Language resources Distribution Agency
4 DIASI (CEA, LIST) - Département Intelligence Ambiante et Systèmes Interactifs

Automatic identification of Arabic dialects in a text is a difficult task, especially for Maghreb languages and when they are written in Arabic or Latin characters (Arabizi). These texts are characterized by the use of code-switching between the Modern Standard Arabic (MSA) and the Arabic Dialect (AD) in the texts written in Arabic, or between Arabizi and foreign languages for those written in Latin. This paper presents the specific resources and tools we have developed for this purpose, with a focus on the transliteration of Arabizi into Arabic (using the dedicated tools for Arabic dialects). A dictionary-based approach to detect the dialectal origin of a text is described, it exhibits satisfactory results.

Mots clés: Arabic Dialects; Arabizi; Transliteration; Identification of Dialects

Domaines: Informatique [cs]; Traitement du texte et du document

Houda Saadane, Hosni Seffih, Christian Fluhr, Khalid Choukri, Nasredine Semmar. Automatic Identification of Maghreb Dialects Using a Dictionary-Based Approach. Eleventh International Conference on Language Resources and Evaluation (LREC 2018), May 2018, Miyazaki, Japan. ⟨hal-02012150⟩