Bi-directional recurrent neural network with ranking loss for spoken language understanding

Vu, Ngoc Thang; Gupta, Pankaj; Adel, Heike and Schütze, Hinrich (2016): Bi-directional recurrent neural network with ranking loss for spoken language understanding. In: IEEE International Conference On Acoustics, Speech and Signal Processing Proceedings, Vol. 2016: pp. 6060-6064

Abstract

This paper presents our latest investigation of recurrent neural etworks for the slot filling task of spoken language understanding. We implement a bi-directional Elman-type recurrent neural network which takes the information not only from the past but also from the future context to predict the semantic label of the target word. Furthermore, we propose to use ranking loss function to train the model. This improves the performance over the cross entropy loss function. On the ATIS benchmark data set, we achieve a new state-of-theart result of 95.56% F1-score without using any additional knowledge or data sources.

• Item Type: Journal article
• Faculties: Languages and Literatures
• Subjects: 400 Language > 400 Language
• ISSN: 1520-6149
• Language: English