Falcon-Emirati: When an LLM Learns the Dialect, the Culture, and the Nuance

Falcon-Emirati-7B is a dialect-specialized model built on the 7B variant of Falcon-H1-Arabic, designed to understand and generate Emirati Arabic with native-level vocabulary, tone, and cultural context. Falcon-H1-Arabic uses the Falcon-H1 hybrid architecture, combining Mamba state space models with Transformer attention in each block. Training drew on authentic Emirati web data, MSA cultural material, and glossary-constrained synthetic data, with adaptation strategies determined experimentally.