Collecting language resources for the Latvian e-Government machine translation platform

Roberts Rozis; Andrejs Vasiljevs; Raivis Skadinš

Collecting language resources for the Latvian e-Government machine translation platform

Roberts Rozis
, Andrejs Vasiljevs
, Raivis Skadinš

Tilde Company

Research output: Chapter in Book/Report/Conference proceeding › Conference paper › Research › peer-review

2 Citations (Scopus)

Abstract

This paper describes corpora collection activity for building large machine translation systems for Latvian e-Government platform. We describe requirements for corpora, selection and assessment of data sources, collection of the public corpora and creation of new corpora from miscellaneous sources. Methodology, tools and assessment methods are also presented along with the results achieved, challenges faced and conclusions made. Several approaches to address the data scarceness are discussed. We summarize the volume of obtained corpora and provide quality metrics of MT systems trained on this data. Resulting MT systems for English-Latvian, Latvian-English and Latvian-Russian are integrated in the Latvian e-service portal and are freely available on website HUGO.LV. This paper can serve as a guidance for similar activities initiated in other countries, particularly in the context of European Language Resource Coordination action.

Original language	English
Title of host publication	Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016
Editors	Nicoletta Calzolari, Khalid Choukri, Helene Mazo, Asuncion Moreno, Thierry Declerck, Sara Goggi, Marko Grobelnik, Jan Odijk, Stelios Piperidis, Bente Maegaard, Joseph Mariani
Publisher	European Language Resources Association (ELRA)
Pages	1270-1276
Number of pages	7
ISBN (Electronic)	9782951740891
Publication status	Published - 2016
Externally published	Yes
Event	10th International Conference on Language Resources and Evaluation, LREC 2016 - Portoroz, Slovenia Duration: 23 May 2016 → 28 May 2016

Publication series

Name	Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016

Conference

Conference	10th International Conference on Language Resources and Evaluation, LREC 2016
Country/Territory	Slovenia
City	Portoroz
Period	23/05/16 → 28/05/16

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 16 Peace, Justice and Strong Institutions

Keywords

Corpus
E-Government
Machine translation
Parallel texts
Public sector information
Web crawling

Cite this

Rozis, R., Vasiljevs, A., & Skadinš, R. (2016). Collecting language resources for the Latvian e-Government machine translation platform. In N. Calzolari, K. Choukri, H. Mazo, A. Moreno, T. Declerck, S. Goggi, M. Grobelnik, J. Odijk, S. Piperidis, B. Maegaard, & J. Mariani (Eds.), Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016 (pp. 1270-1276). (Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016). European Language Resources Association (ELRA).

Rozis, Roberts ; Vasiljevs, Andrejs ; Skadinš, Raivis. / Collecting language resources for the Latvian e-Government machine translation platform. Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016. editor / Nicoletta Calzolari ; Khalid Choukri ; Helene Mazo ; Asuncion Moreno ; Thierry Declerck ; Sara Goggi ; Marko Grobelnik ; Jan Odijk ; Stelios Piperidis ; Bente Maegaard ; Joseph Mariani. European Language Resources Association (ELRA), 2016. pp. 1270-1276 (Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016).

@inproceedings{48db37928c714a3abcf4819d72a8a272,

title = "Collecting language resources for the Latvian e-Government machine translation platform",

abstract = "This paper describes corpora collection activity for building large machine translation systems for Latvian e-Government platform. We describe requirements for corpora, selection and assessment of data sources, collection of the public corpora and creation of new corpora from miscellaneous sources. Methodology, tools and assessment methods are also presented along with the results achieved, challenges faced and conclusions made. Several approaches to address the data scarceness are discussed. We summarize the volume of obtained corpora and provide quality metrics of MT systems trained on this data. Resulting MT systems for English-Latvian, Latvian-English and Latvian-Russian are integrated in the Latvian e-service portal and are freely available on website HUGO.LV. This paper can serve as a guidance for similar activities initiated in other countries, particularly in the context of European Language Resource Coordination action.",

keywords = "Corpus, E-Government, Machine translation, Parallel texts, Public sector information, Web crawling",

author = "Roberts Rozis and Andrejs Vasiljevs and Raivis Skadin{\v s}",

year = "2016",

language = "English",

series = "Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016",

publisher = "European Language Resources Association (ELRA)",

pages = "1270--1276",

editor = "Nicoletta Calzolari and Khalid Choukri and Helene Mazo and Asuncion Moreno and Thierry Declerck and Sara Goggi and Marko Grobelnik and Jan Odijk and Stelios Piperidis and Bente Maegaard and Joseph Mariani",

booktitle = "Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016",

note = "10th International Conference on Language Resources and Evaluation, LREC 2016 ; Conference date: 23-05-2016 Through 28-05-2016",

}

Rozis, R, Vasiljevs, A & Skadinš, R 2016, Collecting language resources for the Latvian e-Government machine translation platform. in N Calzolari, K Choukri, H Mazo, A Moreno, T Declerck, S Goggi, M Grobelnik, J Odijk, S Piperidis, B Maegaard & J Mariani (eds), Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016. Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016, European Language Resources Association (ELRA), pp. 1270-1276, 10th International Conference on Language Resources and Evaluation, LREC 2016, Portoroz, Slovenia, 23/05/16.

Collecting language resources for the Latvian e-Government machine translation platform. / Rozis, Roberts; Vasiljevs, Andrejs; Skadinš, Raivis.
Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016. ed. / Nicoletta Calzolari; Khalid Choukri; Helene Mazo; Asuncion Moreno; Thierry Declerck; Sara Goggi; Marko Grobelnik; Jan Odijk; Stelios Piperidis; Bente Maegaard; Joseph Mariani. European Language Resources Association (ELRA), 2016. p. 1270-1276 (Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference paper › Research › peer-review

TY - GEN

T1 - Collecting language resources for the Latvian e-Government machine translation platform

AU - Rozis, Roberts

AU - Vasiljevs, Andrejs

AU - Skadinš, Raivis

PY - 2016

Y1 - 2016

N2 - This paper describes corpora collection activity for building large machine translation systems for Latvian e-Government platform. We describe requirements for corpora, selection and assessment of data sources, collection of the public corpora and creation of new corpora from miscellaneous sources. Methodology, tools and assessment methods are also presented along with the results achieved, challenges faced and conclusions made. Several approaches to address the data scarceness are discussed. We summarize the volume of obtained corpora and provide quality metrics of MT systems trained on this data. Resulting MT systems for English-Latvian, Latvian-English and Latvian-Russian are integrated in the Latvian e-service portal and are freely available on website HUGO.LV. This paper can serve as a guidance for similar activities initiated in other countries, particularly in the context of European Language Resource Coordination action.

AB - This paper describes corpora collection activity for building large machine translation systems for Latvian e-Government platform. We describe requirements for corpora, selection and assessment of data sources, collection of the public corpora and creation of new corpora from miscellaneous sources. Methodology, tools and assessment methods are also presented along with the results achieved, challenges faced and conclusions made. Several approaches to address the data scarceness are discussed. We summarize the volume of obtained corpora and provide quality metrics of MT systems trained on this data. Resulting MT systems for English-Latvian, Latvian-English and Latvian-Russian are integrated in the Latvian e-service portal and are freely available on website HUGO.LV. This paper can serve as a guidance for similar activities initiated in other countries, particularly in the context of European Language Resource Coordination action.

KW - Corpus

KW - E-Government

KW - Machine translation

KW - Parallel texts

KW - Public sector information

KW - Web crawling

UR - https://www.scopus.com/pages/publications/84992556206

M3 - Conference paper

AN - SCOPUS:84992556206

T3 - Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016

SP - 1270

EP - 1276

BT - Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016

A2 - Calzolari, Nicoletta

A2 - Choukri, Khalid

A2 - Mazo, Helene

A2 - Moreno, Asuncion

A2 - Declerck, Thierry

A2 - Goggi, Sara

A2 - Grobelnik, Marko

A2 - Odijk, Jan

A2 - Piperidis, Stelios

A2 - Maegaard, Bente

A2 - Mariani, Joseph

PB - European Language Resources Association (ELRA)

T2 - 10th International Conference on Language Resources and Evaluation, LREC 2016

Y2 - 23 May 2016 through 28 May 2016

ER -

Rozis R, Vasiljevs A, Skadinš R. Collecting language resources for the Latvian e-Government machine translation platform. In Calzolari N, Choukri K, Mazo H, Moreno A, Declerck T, Goggi S, Grobelnik M, Odijk J, Piperidis S, Maegaard B, Mariani J, editors, Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016. European Language Resources Association (ELRA). 2016. p. 1270-1276. (Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016).

Collecting language resources for the Latvian e-Government machine translation platform

Abstract

Publication series

Conference

UN SDGs

Keywords

Other files and links

Fingerprint

Cite this