Unsupervised Learning
Clustering, mixture models and EM, PCA and SVD, manifold embeddings, and density estimation.
7concepts
145flashcards
53minutes of reading
- 01 Density-Based Clustering with DBSCAN and HDBSCAN DBSCAN defines a cluster as a connected region of high point density and labels everything else as noise, and HDBSCAN removes its single density threshold by building the whole hierarchy of thresholds and keeping the most persistent clusters.
- 02 Hierarchical Clustering and Linkage Agglomerative clustering builds a full tree of merges instead of one partition, and the linkage rule that scores each merge decides whether the tree finds crescents, chains through noise, or reproduces k-means.
- 03 PCA, SVD and Whitening Why maximising retained variance and minimising reconstruction error give the same answer, how the SVD computes it without ever forming a covariance matrix, and what whitening destroys.
- 04 UMAP, t-SNE and What They Distort Neighbour embeddings optimise local neighbourhood preservation and nothing else, which makes cluster separation, cluster size and inter-cluster distance in the resulting picture largely uninterpretable.