Logo Logo
Hilfe
Hilfe
Switch Language to English

Poerner, Nina; Waltinger, Ulli und Schütze, Hinrich (6. Juli 2020): Sentence Meta-Embeddings for Unsupervised Semantic Textual Similarity. , July 6 – 8, 2020, Seattle, USA [PDF, 386kB]

[thumbnail of 1911.03700.pdf]
Vorschau
Download (386kB)

Abstract

We address the task of unsupervised Seman- tic Textual Similarity (STS) by ensembling di- verse pre-trained sentence encoders into sen- tence meta-embeddings. We apply, extend and evaluate different meta-embedding meth- ods from the word embedding literature at the sentence level, including dimensionality re- duction (Yin and Schu ̈tze, 2016), generalized Canonical Correlation Analysis (Rastogi et al., 2015) and cross-view auto-encoders (Bolle- gala and Bao, 2018). Our sentence meta- embeddings set a new unsupervised State of The Art (SoTA) on the STS Benchmark and on the STS12–STS16 datasets, with gains of be- tween 3.7% and 6.4% Pearson’s r over single- source systems.

Dokument bearbeiten Dokument bearbeiten