Transferability of graph neural networks: An extended graphon approach

Maskey, Sohir; Levie, Ron und Kutyniok, Gitta (2022): Transferability of graph neural networks: An extended graphon approach. In: Applied and Computational Harmonic Analysis, Vol. 63: pp. 48-83

Abstract

We study spectral graph convolutional neural networks (GCNNs), where filters are defined as continuous functions of the graph shift operator (GSO) through functional calculus. A spectral GCNN is not tailored to one specific graph and can be transferred between different graphs. It is hence important to study the GCNN transferability: the capacity of the network to have approximately the same repercussion on different graphs that represent the same phenomenon. Transferability ensures that GCNNs trained on certain graphs generalize if the graphs in the test set represent the same phenomena as the graphs in the training set. In this paper, we consider a model of transferability based on graphon analysis. Graphons are limit objects of graphs, and, in the graph paradigm, two graphs represent the same phenomenon if both approximate the same graphon. Our main contributions can be summarized as follows: 1) we prove that any fixed GCNN with continuous filters is transferable under graphs that approximate the same graphon, 2) we prove transferability for graphs that approximate unbounded graphon shift operators, which are defined in this paper, and 3) we obtain non-asymptotic approximation results, proving linear stability of GCNNs. This extends current state-of-the-art results which show asymptotic transferability for polynomial filters under graphs that approximate bounded graphons. (c) 2022 Elsevier Inc. All rights reserved.

• Item Type: Journal article
• Faculties: Mathematics, Computer Science and Statistics > Mathematics; Mathematics, Computer Science and Statistics > Mathematics > Bavarian Chair for Mathematical Foundations of Artificial Intelligence
• Subjects: 500 Science > 510 Mathematics
• ISSN: 1063-5203
• Language: English
• DFG: Gefördert durch die Deutsche Forschungsgemeinschaft (DFG) - 441826958