Abstract
This paper introduces a novel training/decoding strategy for sequence labeling.
Instead of greedily choosing a label at each time step, and using it for
the next prediction, we retain the probability distribution over the current label,
and pass this distribution to the next prediction. This approach allows us to avoid the effect of label bias and error propagation in sequence learning/decoding. Our experiments on dialogue act classification demonstrate the effectiveness of this approach. Even though our underlying neural network model is relatively simple, it outperforms more complex neural models, achieving state-of-the-art results on
the MapTask and Switchboard corpora.
Instead of greedily choosing a label at each time step, and using it for
the next prediction, we retain the probability distribution over the current label,
and pass this distribution to the next prediction. This approach allows us to avoid the effect of label bias and error propagation in sequence learning/decoding. Our experiments on dialogue act classification demonstrate the effectiveness of this approach. Even though our underlying neural network model is relatively simple, it outperforms more complex neural models, achieving state-of-the-art results on
the MapTask and Switchboard corpora.
Original language | English |
---|---|
Title of host publication | The Conference on Empirical Methods in Natural Language Processing |
Subtitle of host publication | Proceedings of the Conference - September 9-11, 2017, Copenhagen, Denmark |
Editors | Rebecca Hwa, Sebastian Riedel |
Place of Publication | Stroudsburg PA USA |
Publisher | Association for Computational Linguistics (ACL) |
Pages | 2151-2156 |
Number of pages | 6 |
ISBN (Print) | 9781945626838 |
DOIs | |
Publication status | Published - 2017 |
Event | Empirical Methods in Natural Language Processing 2017 - Copenhagen, Denmark Duration: 9 Sept 2017 → 11 Sept 2017 http://www.aclweb.org/anthology/D/D17/ |
Conference
Conference | Empirical Methods in Natural Language Processing 2017 |
---|---|
Abbreviated title | EMNLP 2017 |
Country/Territory | Denmark |
City | Copenhagen |
Period | 9/09/17 → 11/09/17 |
Internet address |