Abstract
Cognates are present in multiple variants of the same text across different languages (e.g., “hund” in German and “hound” in English language mean “dog”). They pose a challenge to various Natural Language Processing (NLP) applications such as Machine Translation, Cross-lingual Sense Disambiguation, Computational Phylogenetics, and Information Retrieval. A possible solution to address this challenge is to identify cognates across language pairs. In this paper, we describe the creation of two cognate datasets for twelve Indian languages, namely Sanskrit, Hindi, Assamese, Oriya, Kannada, Gujarati, Tamil, Telugu, Punjabi, Bengali, Marathi, and Malayalam. We digitize the cognate data from an Indian language cognate dictionary and utilize linked Indian language Wordnets to generate cognate sets. Additionally, we use the Wordnet data to create a False Friends' dataset for eleven language pairs. We also evaluate the efficacy of our dataset using previously available baseline cognate detection approaches. We also perform a manual evaluation with the help of lexicographers and release the curated gold-standard dataset with this paper.
Original language | English |
---|---|
Title of host publication | LREC 2020 - Twelfth International Conference on Language Resources and Evaluation, Conference Proceedings |
Editors | Nicoletta Calzolari, Frederic Bechet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis |
Place of Publication | Paris France |
Publisher | European Language Resources Association (ELRA) |
Pages | 3096-3102 |
Number of pages | 7 |
ISBN (Electronic) | 9791095546344 |
Publication status | Published - 2020 |
Event | International Conference on Language Resources and Evaluation 2020 - Marseille, France Duration: 11 May 2020 → 16 May 2020 Conference number: 12th https://lrec2020.lrec-conf.org/en/ (Website) |
Conference
Conference | International Conference on Language Resources and Evaluation 2020 |
---|---|
Abbreviated title | LREC 2020 |
Country/Territory | France |
City | Marseille |
Period | 11/05/20 → 16/05/20 |
Internet address |
|
Keywords
- Cognate dataset
- Cognate sets
- False friends
- Gold data
- Indian languages
- True cognates