Platforms & Practice
25 min
Learning Without Labels: The Collapse Problem at the Heart of Self-Supervised Learning
Every joint-embedding method has the same trivial solution available to it: map every input to the same vector. The history of self-supervised learning is the history of preventing that, and the methods that look most different f…