A deep bidirectional highway long short-term memory network approach to Chinese semantic role labeling

Qi Xia, Chung Hsing Yeh, Xiang Yu Chen

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Existing approaches to Chinese semantic role labeling (SRL) mainly adopt deep long short-term memory (LSTM) neural networks to address the long-term dependencies problem. However, deep LSTM networks cannot address the vanishing gradient problem properly. In addition, the complexity of the Chinese language, as a hieroglyphic language, decreases the performance of traditional SRL approaches to Chinese SRL. To address these problems, this paper proposes a new approach with a deep bidirectional highway LSTM network. The performance of the proposed approach is further improved by introducing the conditional random fields (CRFs) constraints and part-of-speech (POS) feature since POS tags are the classes of formal equivalents of words in linguistics. The experimental results on the commonly used Chinese Proposition Bank dataset show that the proposed approach outperforms existing approaches. With an easily acquired and reliable POS feature for practical applications, the proposed approach substantially improves Chinese SRL.

Original languageEnglish
Title of host publicationInternational Joint Conference on Neural Networks (IJCNN) 2019
EditorsPlamen Angelov, Manuel Roveri
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages6
ISBN (Electronic)9781728119854
ISBN (Print)9781728119861
DOIs
Publication statusPublished - 2019
EventIEEE International Joint Conference on Neural Networks 2019 - Budapest, Hungary
Duration: 14 Jul 201919 Jul 2019
https://www.ijcnn.org/

Conference

ConferenceIEEE International Joint Conference on Neural Networks 2019
Abbreviated titleIJCNN 2019
CountryHungary
CityBudapest
Period14/07/1919/07/19
Internet address

Keywords

  • Chinese language
  • conditional random field
  • deep bidirectional highway LSTM networks
  • part-of-speech
  • Semantic role labeling

Cite this

Xia, Q., Yeh, C. H., & Chen, X. Y. (2019). A deep bidirectional highway long short-term memory network approach to Chinese semantic role labeling. In P. Angelov, & M. Roveri (Eds.), International Joint Conference on Neural Networks (IJCNN) 2019 [8852323] Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/IJCNN.2019.8852323
Xia, Qi ; Yeh, Chung Hsing ; Chen, Xiang Yu. / A deep bidirectional highway long short-term memory network approach to Chinese semantic role labeling. International Joint Conference on Neural Networks (IJCNN) 2019. editor / Plamen Angelov ; Manuel Roveri. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2019.
@inproceedings{c27519fdd74541bb99e33dc8a079f9cb,
title = "A deep bidirectional highway long short-term memory network approach to Chinese semantic role labeling",
abstract = "Existing approaches to Chinese semantic role labeling (SRL) mainly adopt deep long short-term memory (LSTM) neural networks to address the long-term dependencies problem. However, deep LSTM networks cannot address the vanishing gradient problem properly. In addition, the complexity of the Chinese language, as a hieroglyphic language, decreases the performance of traditional SRL approaches to Chinese SRL. To address these problems, this paper proposes a new approach with a deep bidirectional highway LSTM network. The performance of the proposed approach is further improved by introducing the conditional random fields (CRFs) constraints and part-of-speech (POS) feature since POS tags are the classes of formal equivalents of words in linguistics. The experimental results on the commonly used Chinese Proposition Bank dataset show that the proposed approach outperforms existing approaches. With an easily acquired and reliable POS feature for practical applications, the proposed approach substantially improves Chinese SRL.",
keywords = "Chinese language, conditional random field, deep bidirectional highway LSTM networks, part-of-speech, Semantic role labeling",
author = "Qi Xia and Yeh, {Chung Hsing} and Chen, {Xiang Yu}",
year = "2019",
doi = "10.1109/IJCNN.2019.8852323",
language = "English",
isbn = "9781728119861",
editor = "Angelov, {Plamen } and Manuel Roveri",
booktitle = "International Joint Conference on Neural Networks (IJCNN) 2019",
publisher = "IEEE, Institute of Electrical and Electronics Engineers",
address = "United States of America",

}

Xia, Q, Yeh, CH & Chen, XY 2019, A deep bidirectional highway long short-term memory network approach to Chinese semantic role labeling. in P Angelov & M Roveri (eds), International Joint Conference on Neural Networks (IJCNN) 2019., 8852323, IEEE, Institute of Electrical and Electronics Engineers, Piscataway NJ USA, IEEE International Joint Conference on Neural Networks 2019, Budapest, Hungary, 14/07/19. https://doi.org/10.1109/IJCNN.2019.8852323

A deep bidirectional highway long short-term memory network approach to Chinese semantic role labeling. / Xia, Qi; Yeh, Chung Hsing; Chen, Xiang Yu.

International Joint Conference on Neural Networks (IJCNN) 2019. ed. / Plamen Angelov; Manuel Roveri. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2019. 8852323.

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

TY - GEN

T1 - A deep bidirectional highway long short-term memory network approach to Chinese semantic role labeling

AU - Xia, Qi

AU - Yeh, Chung Hsing

AU - Chen, Xiang Yu

PY - 2019

Y1 - 2019

N2 - Existing approaches to Chinese semantic role labeling (SRL) mainly adopt deep long short-term memory (LSTM) neural networks to address the long-term dependencies problem. However, deep LSTM networks cannot address the vanishing gradient problem properly. In addition, the complexity of the Chinese language, as a hieroglyphic language, decreases the performance of traditional SRL approaches to Chinese SRL. To address these problems, this paper proposes a new approach with a deep bidirectional highway LSTM network. The performance of the proposed approach is further improved by introducing the conditional random fields (CRFs) constraints and part-of-speech (POS) feature since POS tags are the classes of formal equivalents of words in linguistics. The experimental results on the commonly used Chinese Proposition Bank dataset show that the proposed approach outperforms existing approaches. With an easily acquired and reliable POS feature for practical applications, the proposed approach substantially improves Chinese SRL.

AB - Existing approaches to Chinese semantic role labeling (SRL) mainly adopt deep long short-term memory (LSTM) neural networks to address the long-term dependencies problem. However, deep LSTM networks cannot address the vanishing gradient problem properly. In addition, the complexity of the Chinese language, as a hieroglyphic language, decreases the performance of traditional SRL approaches to Chinese SRL. To address these problems, this paper proposes a new approach with a deep bidirectional highway LSTM network. The performance of the proposed approach is further improved by introducing the conditional random fields (CRFs) constraints and part-of-speech (POS) feature since POS tags are the classes of formal equivalents of words in linguistics. The experimental results on the commonly used Chinese Proposition Bank dataset show that the proposed approach outperforms existing approaches. With an easily acquired and reliable POS feature for practical applications, the proposed approach substantially improves Chinese SRL.

KW - Chinese language

KW - conditional random field

KW - deep bidirectional highway LSTM networks

KW - part-of-speech

KW - Semantic role labeling

UR - http://www.scopus.com/inward/record.url?scp=85073253859&partnerID=8YFLogxK

U2 - 10.1109/IJCNN.2019.8852323

DO - 10.1109/IJCNN.2019.8852323

M3 - Conference Paper

SN - 9781728119861

BT - International Joint Conference on Neural Networks (IJCNN) 2019

A2 - Angelov, Plamen

A2 - Roveri, Manuel

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Piscataway NJ USA

ER -

Xia Q, Yeh CH, Chen XY. A deep bidirectional highway long short-term memory network approach to Chinese semantic role labeling. In Angelov P, Roveri M, editors, International Joint Conference on Neural Networks (IJCNN) 2019. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers. 2019. 8852323 https://doi.org/10.1109/IJCNN.2019.8852323