Casablanca: Data and Models for Multidialectal Arabic Speech Recognition

In spite of the recent progress in speech processing and synthesis, the majority of world languages and dialects remain uncovered. This situation only furthers an already wide technological divide, thereby hindering technological and socioeconomic inclusion. This challenge is largely due to the absence of datasets that can empower diverse speech systems. In this paper, we seek to mitigate this obstacle for a number of Arabic dialects by describing a community effort to collect and transcribe a new dataset, Casablanca. We also develop a number of strong baselines exploiting Casablanca.

AstroWind Hero Image

Features

What you get with Casablanca

Arabic Transcription

Casablanca provides high-quality, manual transcriptions of Arabic speech from various dialects, ensuring accurate phonetic representation across multiple regional accents.

Gender

The dataset includes balanced representation from male and female speakers, enabling the development of gender-aware speech models.

Dialect

Casablanca covers a wide range of Arabic dialects, including Algerian, Egyptian, Emirati, Jordanian, Mauritanian, Moroccoan, Palestinian, and Yemeni varieties. This diversity allows for the training and evaluation of dialect-specific speech recognition systems, addressing the unique characteristics of each dialect. .

Code-Switching (Latin)

The dataset captures instances of code-switching between Arabic and (English and French) (Latin script), reflecting common speech patterns in multilingual environments.

Code-Switching (Transliterated)

In addition to code-switching in Latin script, Casablanca includes code-switching words that has been transliterated using Arabic characters.

Segement Start-End

Each speech sample is precisely segmented with start and end timestamps, facilitating easy downloading the segments and aligning them with the transcriptions.

Speech

Examples

Dialect Speech Utterance Transcription Transcription CS Gender
Moroccoan ู‡ุงุฏูŠูƒ ู„ุง ู…ูŠู„ุชูŠ ู†ุงุตูŠูˆู†ุงู„ ู„ูŠ ูƒูˆู†ุช ู‡ุถุฑุชู„ูŠูƒ ุนู„ูŠู‡ุง ุฎุงุตูƒ ุชุนุฑู ุจู„ูŠ ูƒุงุน ุงู„ุดุฑูƒุงุช ุงู„ูƒุจุงุฑ ู„ูŠ ูƒุงูŠุฏูŠุฑูˆ ู„ูŠ ุฒุงููŠุฑ ุงู„ูƒุจุงุฑ ุจุญุงู„ู†ุง ูƒุงูŠุชู…ู†ุงูˆ ุดูŠ ู†ู‡ุงุฑ ูŠุณู†ูŠูˆ ู…ุนุงู‡ุง ุนู‚ุฏ ูˆุงุญุฏ ู‡ุงุฏูŠูƒ la multi-nationale ู„ูŠ ูƒูˆู†ุช ู‡ุถุฑุชู„ูŠูƒ ุนู„ูŠู‡ุง ุฎุงุตูƒ ุชุนุฑู ุจู„ูŠ ูƒุงุน ุงู„ุดุฑูƒุงุช ุงู„ูƒุจุงุฑ ู„ูŠ ูƒุงูŠุฏูŠุฑูˆ les affaires ุงู„ูƒุจุงุฑ ุจุญุงู„ู†ุง ูƒุงูŠุชู…ู†ุงูˆ ุดูŠ ู†ู‡ุงุฑ ูŠุณู†ูŠูˆ ู…ุนุงู‡ุง ุนู‚ุฏ ูˆุงุญุฏ Male
Egyptian ูŠูˆ ูˆู„ูŠูƒู… ูŠุง ู…ุนู„ู…. you welcome ูŠุง ู…ุนู„ู…. Male
Jordanian ุงู†ูˆ ู‡ุฐุง ุงู„ู…ุทุฑุจ ุงู„ู‡ู†ุฏูŠ ุงู†ุชุฑู†ุงุดูˆู†ุงู„ ูŠุนู†ูŠ ุจุฑูˆููŠุดู†ุงู„ ุงู†ูˆ ู‡ุฐุง ุงู„ู…ุทุฑุจ ุงู„ู‡ู†ุฏูŠ international ูŠุนู†ูŠ professional Female
Algerian ุจูˆู† ู†ุชูˆู…ุง ุงู…ุจูˆุณูŠุจู„ ุชุญูƒู…ูˆ ู‡ุงุฏ ุงู„ุจูˆุณุช , ุจุตุญ ุชู†ุฌู…ูˆ ุชุฎุฏู…ูˆ ุฎุฏู…ุฉ ูˆุญุฏูˆุฎุฑู‰ . ู‡ุงูˆ ุฌู†ุฑุงู„ , ู‡ุฐุง ุนู†ุฏูˆ ุงู„ุจุงูƒ ุŸ ู…ุง ุนู†ุฏูˆุด Bon ู†ุชูˆู…ุง impossible ุชุญูƒู…ูˆ ู‡ุงุฏ poste , ุจุตุญ ุชู†ุฌู…ูˆ ุชุฎุฏู…ูˆ ุฎุฏู…ุฉ ูˆุญุฏูˆุฎุฑู‰ . ู‡ุงูˆ ุฌู†ุฑุงู„ , ู‡ุฐุง ุนู†ุฏูˆ ุงู„ุจุงูƒ ุŸ ู…ุง ุนู†ุฏูˆุด Male
Palestinian ู…ูˆุงูู‚ ู…ูˆุงูู‚ ุจุณ ุนู„ู‰ ุดุฑุท ุณู†ุชูŠู† ู„ุงู„ูƒ ูˆ ุณู†ุชูŠู† ู„ุงู„ูŠ ูŠุนู†ูŠ ููŠูุชูŠ ููŠูุชูŠ ู…ูˆุงูู‚ ู…ูˆุงูู‚ ุจุณ ุนู„ู‰ ุดุฑุท ุณู†ุชูŠู† ู„ุงู„ูƒ ูˆ ุณู†ุชูŠู† ู„ุงู„ูŠ ูŠุนู†ูŠ fifty fifty Male
Emirati ุนูŠู„ ุฃู†ุง ุจุนุฏ ูŠู…ุนุฉุŒ ู…ุง ุจุซู‚ู„ ุนู„ูŠูƒ ุจุณ ู‡ุงุชู„ูŠ ุฑูˆูŠุงู„ ุฌู„ูŠ ู‡ุฐุง ุฒูŠู†ุŒ ู…ุจ ุจุณ ุญู‚ูŠุŒ ุญู‚ูŠ ูˆ ุญู‚ ุฃุจูˆูŠ ุนูŠู„ ุฃู†ุง ุจุนุฏ ูŠู…ุนุฉุŒ ู…ุง ุจุซู‚ู„ ุนู„ูŠูƒ ุจุณ ู‡ุงุชู„ูŠ royal jelly ู‡ุฐุง ุฒูŠู†ุŒ ู…ุจ ุจุณ ุญู‚ูŠุŒ ุญู‚ูŠ ูˆ ุญู‚ ุฃุจูˆูŠ Female
Yemeni ุงูˆูƒู‰ ุŒ ุฌู‰ุก ู…ู† ุงุฌู„ ุงุดุฑุญ ู„ูƒ ูƒู„ ุดูŠ ok ุŒ ุฌู‰ุก ู…ู† ุงุฌู„ ุงุดุฑุญ ู„ูƒ ูƒู„ ุดูŠ Male
Mauritanian ู‡ุฐุง ุจุนุฏ ูƒุงุน ุฏูˆ ุจูˆุด ู…ุนุฑูˆู ุงูŠู† ุณูŠู„ ุจูˆุชูˆู†. ู‡ุฐุง ุจุนุฏ ูƒุงุน deux poches ู…ุนุฑูˆู une seule button. Male

Meet

Our team

Muhammad
Abdul-Mageed
Mustafa
Jarrar
Shady
Shehata
Ismail
Berrada

Bashar
Talafha
Karima
Kadaoui
Samar
Magdy
Mariem
Habiboullah
Chafei
Mohamed
Ahmed
El-Shangiti
Hiba
Zayed
Mohamedou
Cheikh
Rahaf
Alhamouri
Rwaa
Assi
Aisha
Alraeesi
Hour
Mohamed
Fakhraddin
Alwajih
Abdelrahman
Mohamed
Abdellah EL MEKKI
Moatez
Nagoudi
Saadia
Benelhadj
Hamzah
Alsayadi
Walid
Al-Dhabyani
Sara
Shatnawi
Yasir
Ech-chammakhy
Amal
Makouar
Yousra
Berrachedi

Cite

Our paper

@article{talafha2024casablanca,
   title={Casablanca: Data and Models for Multidialectal Arabic Speech Recognition},
   author={Talafha, Bashar and Kadaoui, Karima and Magdy, Samar Mohamed and Habiboullah, Mariem
           and Chafei, Chafei Mohamed and El-Shangiti, Ahmed Oumar and Zayed,
           Hiba and Alhamouri, Rahaf and Assi, Rwaa and Alraeesi, Aisha and others},
   journal={arXiv preprint arXiv:2410.04527},
   year={2024}
}
AstroWind โ€” Free template for creating websites with Astro + Tailwind CSS