Expressivity of Deep Neural Networks

Gühring, Ingo; Raslan, Mones und Kutyniok, Gitta (2023): Expressivity of Deep Neural Networks. In: Grohs, Philipp und Kutyniok, Gitta (Hrsg.): Mathematical Aspects of Deep Learning. Cambridge: Cambridge University Press. S. 149-199

Abstract

In this chapter, we give a comprehensive overview of the large variety of approximation results for neural networks. Approximation rates for classical function spaces as well as the benefits of deep neural networks over shallow ones for specifically structured function classes are discussed. While the main body of existing results is for general feedforward architectures, we also review approximation results for convolutional, residual and recurrent neural networks.

• Dokumententyp: Buchbeitrag
• Fakultät: Mathematik, Informatik und Statistik > Mathematik
• Fakultätsübergreifende Einrichtungen: Center for Advanced Studies (CAS)
• Themengebiete: 000 Informatik, Informationswissenschaft, allgemeine Werke > 000 Informatik, Wissen, Systeme ; 500 Naturwissenschaften und Mathematik > 510 Mathematik
• ISSN: 978-1-316-51678-2
• Ort: Cambridge
• Sprache: Englisch