Suppose we are given a diagonalizableadjacency matrixA for a graph with nodes partitioned into C classes. Suppose we know the assignments for some of the nodes T⊂Vertices. Let Vc be the top C eigenvectors of A.
Finding the spectral embedding amounts to solving the problemminf∑i∈T1(f(A)i=yi) where f comes from our hypothesis class{f:f(A)=σ(VcW),W∈RC×C} and σ is a predetermined pointwise nonlinearity.
Notes C-dimensional embeddings u1,…,un of the nodes of the graph into feature space.
This can be thought of as an FC-NN on the
in practice, a surrogate is usually used for the 0-1 loss
to find the optimal f ie the optimal W, we solve using gradient descent methods
this is the semi-supervised version of spectral clustering (clustering assigns communities to all nodes, embedding assigns communities to nodes with unknown community)