TRENDNERT: A Benchmark for Trend and Downtrend Detection in a Scientific Domain

Moiseeva, Alena und Schuetze, Hinrich (2020): TRENDNERT: A Benchmark for Trend and Downtrend Detection in a Scientific Domain. In: Thirty-Fourth Aaai Conference on Artificial Intelligence, the Thirty-Second Innovative Applications of Artificial Intelligence Conference and the Tenth Aaai Symposium on Educational Advances in Artificial Intelligence, Bd. 34: S. 8512-8519

Abstract

Computational analysis and modeling of the evolution of trends is an important area of research in Natural Language Processing (NLP) because of its socio-economic impact. However, no large publicly available benchmark for trend detection currently exists, making a comparative evaluation of methods impossible. We remedy this situation by publishing the benchmark TRENDNERT, consisting of a set of gold trends and downtrends and document labels that is available as an unrestricted download, and a large underlying document collection that can also be obtained for free. We propose Mean Average Precision (MAP) as an evaluation measure for trend detection and apply this measure in an investigation of several baselines.

• Dokumententyp: Zeitschriftenartikel
• Fakultät: Sprach- und Literaturwissenschaften > Department 2
• Themengebiete: 400 Sprache > 400 Sprache
• ISSN: 2159-5399
• Sprache: Englisch