Graph Neural Networks
Message passing, expressive power and the WL test, over-smoothing, over-squashing and sampling at scale.
5concepts
60flashcards
36minutes of reading
- 01 Expressive Power and the WL Test The exact ceiling on what a message-passing network can distinguish, why the aggregation function determines whether that ceiling is reached, and the graphs it provably cannot tell apart.
- 02 Heterogeneous and Temporal Graphs Why real graphs have typed nodes and edges that a homogeneous model averages together, how relation-specific message passing preserves the distinction, and what adding time requires.
- 03 Link Prediction and Negative Sampling Why predicting edges is not ordinary classification, how negative sampling choices determine what the model learns, and the evaluation leakage that makes published numbers hard to trust.
- 04 Over-Smoothing and Over-Squashing The two distinct reasons deep graph networks fail, why they pull in opposite directions, and the interventions that address each.
- 05 Sampling and Scaling to Large Graphs Why full-batch training does not scale past a certain graph size, the neighbourhood explosion that makes naive mini-batching worse, and the three sampling strategies that resolve it.