Learning to actively learn neural machine translation

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

1 Citation (Scopus)

Abstract

Traditional active learning (AL) methods for machine translation (MT) rely on heuristics. However, these heuristics are limited when the characteristics of the MT problem change due to e.g. the language pair or the amount of the initial bitext. In this paper, we present a framework to learn sentence selection strategies for neural MT. We train the AL query strategy using a high-resource language-pair based on AL simulations, and then transfer it to the low-resource language-pair of interest. The learned query strategy capitalizes on the shared characteristics between the language pairs to make an effective use of the AL budget. Our experiments on three language-pairs confirms that our method is more effective than strong heuristic-based methods in various conditions, including cold-start and warm-start as well as small and extremely small data conditions.

Original languageEnglish
Title of host publicationCoNLL 2018 - The 22nd Conference on Computational Natural Language Learning - Proceedings of the Conference
EditorsMiikka Silfverberg
Place of PublicationStroudsburg PA USA
PublisherAssociation for Computational Linguistics (ACL)
Pages334-344
Number of pages11
ISBN (Electronic)9781948087728
Publication statusPublished - 2018
EventConference on Natural Language Learning 2018 - Brussels, Belgium
Duration: 31 Oct 20181 Nov 2018
https://www.conll.org/2018

Publication series

NameCoNLL 2018 - 22nd Conference on Computational Natural Language Learning, Proceedings

Conference

ConferenceConference on Natural Language Learning 2018
Abbreviated titleCoNLL 2018
CountryBelgium
CityBrussels
Period31/10/181/11/18
Internet address

Cite this

Liu, M., Buntine, W., & Haffari, G. (2018). Learning to actively learn neural machine translation. In M. Silfverberg (Ed.), CoNLL 2018 - The 22nd Conference on Computational Natural Language Learning - Proceedings of the Conference (pp. 334-344). (CoNLL 2018 - 22nd Conference on Computational Natural Language Learning, Proceedings). Stroudsburg PA USA: Association for Computational Linguistics (ACL).