Neural Transductive Learning and Beyond: Morphological Generation in the Minimal-Resource Setting

Kann, Katharina and Schütze, Hinrich (October 2018): Neural Transductive Learning and Beyond: Morphological Generation in the Minimal-Resource Setting. 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, 31. October - 04. November 2018. Riloff, Ellen; Chiang, David; Hockenmaier, Julia and Tsujii, Jun’ichi (eds.) : In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Stroudsburg, PA: Association for Computational Linguistics (ACL). pp. 3060-3066

Abstract

Neural state-of-the-art sequence-to-sequence (seq2seq) models often do not perform well for small training sets. We address paradigm completion, the morphological task of, given a partial paradigm, generating all missing forms. We propose two new methods for the minimalresource setting: (i) Paradigm transduction: Since we assume only few paradigms available for training, neural seq2seq models are able to capture relationships between paradigm cells, but are tied to the idiosyncracies of the training set. Paradigm transduction mitigates this problem by exploiting the input subset of inflected forms at test time. (ii) Source selection with high precision (SHIP): Multi-source models which learn to automatically select one or multiple sources to predict a target inflection do not perform well in the minimal-resource setting. SHIP is an alternative to identify a reliable source if training data is limited. On a 52-language benchmark dataset, we outperform the previous state of the art by up to 9.71% absolute accuracy.

• Item Type: Conference or Workshop Item (Paper)
• EU Funded Grant Agreement Number: 740516
• EU Projects: Horizon 2020 > ERC Grants > ERC Advanced Grant > ERC Grant 740516: NonSequeToR - Non-sequence models for tokenization replacement
• Research Centers: Center for Information and Language Processing (CIS)
• Subjects: 000 Computer science, information and general works > 000 Computer science, knowledge, and systems; 000 Computer science, information and general works > 004 Data processing computer science; 400 Language > 400 Language; 400 Language > 410 Linguistics
• Place of Publication: Stroudsburg, PA
• Language: English