Linguistic unit discovery from multi-modal inputs in unwritten languages: summary of the “Speaking Rosetta” JSALT 2017 workshop

Odette Scharenborg; Laurent Besacier; Alan   Black; Mark Hasegawa-Johnson; Florian Metze; Graham Neubig; Sebastian  Stuker; Pierre Godard; Markus Müller; Lucas  Ondel; Shruti  Palaskar; Philip Arthur; Francesco  Ciannella; Mingxing  Du; Elin  Larsen; Danny  Merkx; Rachid Riad; Liming Wang; Emmanuel Dupoux

doi:10.1109/ICASSP.2018.8461761

Linguistic unit discovery from multi-modal inputs in unwritten languages: summary of the “Speaking Rosetta” JSALT 2017 workshop

Odette Scharenborg, Laurent Besacier, Alan Black, Mark Hasegawa-Johnson, Florian Metze, Graham Neubig, Sebastian Stuker, Pierre Godard, Markus Müller, Lucas Ondel, Shruti Palaskar, Philip Arthur, Francesco Ciannella, Mingxing Du, Elin Larsen, Danny Merkx, Rachid Riad, Liming Wang, Emmanuel Dupoux

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

Abstract

We summarize the accomplishments of a multi-disciplinary workshop exploring the computational and scientific issues surrounding the discovery of linguistic units (subwords and words) in a language without orthography. We study the replacement of orthographic transcriptions by images and/or translated text in a well-resourced language to help unsupervised discovery from raw speech.

Original language	English
Title of host publication	2018 IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Editors	Dan Schonfeld
Place of Publication	Piscataway NJ USA
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	4979-4983
Number of pages	5
ISBN (Electronic)	9781538646588, 9781538646571
ISBN (Print)	9781538646595
DOIs	https://doi.org/10.1109/ICASSP.2018.8461761
Publication status	Published - 2017
Externally published	Yes
Event	IEEE International Conference on Acoustics, Speech and Signal Processing 2018 - Calgary, Canada Duration: 15 Apr 2018 → 20 Apr 2018 https://2018.ieeeicassp.org/ https://ieeexplore.ieee.org/xpl/conhome/8450881/proceeding (Proceedings)

Conference

Conference	IEEE International Conference on Acoustics, Speech and Signal Processing 2018
Abbreviated title	ICASSP 2018
Country/Territory	Canada
City	Calgary
Period	15/04/18 → 20/04/18
Internet address	https://2018.ieeeicassp.org/ https://ieeexplore.ieee.org/xpl/conhome/8450881/proceeding (Proceedings)

Keywords

unwritten languages
multi-modal data
unsupervised unit discovery
image retrieval
machine translation

Access to Document

10.1109/ICASSP.2018.8461761

Cite this

Scharenborg, O., Besacier, L., Black, A., Hasegawa-Johnson, M., Metze, F., Neubig, G., Stuker, S., Godard, P., Müller, M., Ondel, L., Palaskar, S., Arthur, P., Ciannella, F., Du, M., Larsen, E., Merkx, D., Riad, R., Wang, L., & Dupoux, E. (2017). Linguistic unit discovery from multi-modal inputs in unwritten languages: summary of the “Speaking Rosetta” JSALT 2017 workshop. In D. Schonfeld (Ed.), 2018 IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings (pp. 4979-4983). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICASSP.2018.8461761

Scharenborg, Odette ; Besacier, Laurent ; Black, Alan et al. / Linguistic unit discovery from multi-modal inputs in unwritten languages : summary of the “Speaking Rosetta” JSALT 2017 workshop. 2018 IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings . editor / Dan Schonfeld. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2017. pp. 4979-4983

@inproceedings{0827236192bc453095bef58cdd5478f3,

title = "Linguistic unit discovery from multi-modal inputs in unwritten languages: summary of the “Speaking Rosetta” JSALT 2017 workshop",

abstract = "We summarize the accomplishments of a multi-disciplinary workshop exploring the computational and scientific issues surrounding the discovery of linguistic units (subwords and words) in a language without orthography. We study the replacement of orthographic transcriptions by images and/or translated text in a well-resourced language to help unsupervised discovery from raw speech.",

keywords = "unwritten languages, multi-modal data, unsupervised unit discovery, image retrieval, machine translation",

author = "Odette Scharenborg and Laurent Besacier and Alan Black and Mark Hasegawa-Johnson and Florian Metze and Graham Neubig and Sebastian Stuker and Pierre Godard and Markus M{\"u}ller and Lucas Ondel and Shruti Palaskar and Philip Arthur and Francesco Ciannella and Mingxing Du and Elin Larsen and Danny Merkx and Rachid Riad and Liming Wang and Emmanuel Dupoux",

year = "2017",

doi = "10.1109/ICASSP.2018.8461761",

language = "English",

isbn = "9781538646595",

pages = "4979--4983",

editor = "Schonfeld, {Dan }",

booktitle = "2018 IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

address = "United States of America",

note = "IEEE International Conference on Acoustics, Speech and Signal Processing 2018, ICASSP 2018 ; Conference date: 15-04-2018 Through 20-04-2018",

url = "https://2018.ieeeicassp.org/, https://ieeexplore.ieee.org/xpl/conhome/8450881/proceeding",

}

Scharenborg, O, Besacier, L, Black, A, Hasegawa-Johnson, M, Metze, F, Neubig, G, Stuker, S, Godard, P, Müller, M, Ondel, L, Palaskar, S, Arthur, P, Ciannella, F, Du, M, Larsen, E, Merkx, D, Riad, R, Wang, L & Dupoux, E 2017, Linguistic unit discovery from multi-modal inputs in unwritten languages: summary of the “Speaking Rosetta” JSALT 2017 workshop. in D Schonfeld (ed.), 2018 IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings . IEEE, Institute of Electrical and Electronics Engineers, Piscataway NJ USA, pp. 4979-4983, IEEE International Conference on Acoustics, Speech and Signal Processing 2018, Calgary, Alberta, Canada, 15/04/18. https://doi.org/10.1109/ICASSP.2018.8461761

Linguistic unit discovery from multi-modal inputs in unwritten languages: summary of the “Speaking Rosetta” JSALT 2017 workshop. / Scharenborg, Odette; Besacier, Laurent; Black, Alan et al.
2018 IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings . ed. / Dan Schonfeld. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers, 2017. p. 4979-4983.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Linguistic unit discovery from multi-modal inputs in unwritten languages

T2 - IEEE International Conference on Acoustics, Speech and Signal Processing 2018

AU - Scharenborg, Odette

AU - Besacier, Laurent

AU - Black, Alan

AU - Hasegawa-Johnson, Mark

AU - Metze, Florian

AU - Neubig, Graham

AU - Stuker, Sebastian

AU - Godard, Pierre

AU - Müller, Markus

AU - Ondel, Lucas

AU - Palaskar, Shruti

AU - Arthur, Philip

AU - Ciannella, Francesco

AU - Du, Mingxing

AU - Larsen, Elin

AU - Merkx, Danny

AU - Riad, Rachid

AU - Wang, Liming

AU - Dupoux, Emmanuel

PY - 2017

Y1 - 2017

N2 - We summarize the accomplishments of a multi-disciplinary workshop exploring the computational and scientific issues surrounding the discovery of linguistic units (subwords and words) in a language without orthography. We study the replacement of orthographic transcriptions by images and/or translated text in a well-resourced language to help unsupervised discovery from raw speech.

AB - We summarize the accomplishments of a multi-disciplinary workshop exploring the computational and scientific issues surrounding the discovery of linguistic units (subwords and words) in a language without orthography. We study the replacement of orthographic transcriptions by images and/or translated text in a well-resourced language to help unsupervised discovery from raw speech.

KW - unwritten languages

KW - multi-modal data

KW - unsupervised unit discovery

KW - image retrieval

KW - machine translation

U2 - 10.1109/ICASSP.2018.8461761

DO - 10.1109/ICASSP.2018.8461761

M3 - Conference Paper

SN - 9781538646595

SP - 4979

EP - 4983

BT - 2018 IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

A2 - Schonfeld, Dan

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Piscataway NJ USA

Y2 - 15 April 2018 through 20 April 2018

ER -

Scharenborg O, Besacier L, Black A, Hasegawa-Johnson M, Metze F, Neubig G et al. Linguistic unit discovery from multi-modal inputs in unwritten languages: summary of the “Speaking Rosetta” JSALT 2017 workshop. In Schonfeld D, editor, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings . Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers. 2017. p. 4979-4983 doi: 10.1109/ICASSP.2018.8461761