Skip to main navigation Skip to search Skip to main content

Help from the Neighbors: Estonian Dialect Normalization Using a Finnish Dialect Generator

  • Tuuli Tuisk
  • , Hämäläinen Mika
  • , Alnajjar Khalid
  • Ne LU

Research output: Chapter in Book/Report/Conference proceedingConference paperResearchpeer-review

3 Citations (Scopus)

Abstract

While standard Estonian is not a low-resourced language, the different dialects of the language are under-resourced from the point of view of NLP, given that there are no vast hand normalized resources available for training a machine learning model to normalize dialectal Estonian to standard Estonian. In this paper, we crawl a small corpus of parallel dialectal Estonian - standard Estonian sentences. In addition, we take a savvy approach of generating more synthetic training data for the normalization task by using an existing dialect generator model built for Finnish to "dialectalize" standard Estonian sentences from the Universal Dependencies tree banks. Our BERT based normalization model achieves a word error rate that is 26.49 points lower when using both the synthetic data and Estonian data in comparison to training the model with only the available Estonian data. Our results suggest that synthetic data generated by a model trained on a more resourced related language can indeed boost the results for a less resourced language.

Original languageEnglish
Title of host publicationDeepLo 2022 - 3rd Workshop on Deep Learning Approaches for Low-Resource NLP, Proceedings of the DeepLo Workshop
EditorsColin Cherry, Angela Fan, George Foster, Gholamreza Haffari, Shahram Khadivi, Nanyun Peng, Xiang Ren, Ehsan Shareghi, Swabha Swayamdipta
Place of PublicationSeattle
PublisherAssociation for Computational Linguistics
Pages61-66
Number of pages6
ISBN (Electronic)9781955917971
DOIs
Publication statusPublished - 2022

Publication series

NameDeepLo 2022 - 3rd Workshop on Deep Learning Approaches for Low-Resource NLP, Proceedings of the DeepLo Workshop

OECD Field of Science

  • 6.2 Languages and Literature

Fingerprint

Dive into the research topics of 'Help from the Neighbors: Estonian Dialect Normalization Using a Finnish Dialect Generator'. Together they form a unique fingerprint.

Cite this