Platforms & Practice
26 min
One Number, Two Knobs: The ELBO Is a Rate-Distortion Tradeoff
Two variational autoencoders can report the same ELBO to three decimal places while one has a latent code carrying five bits of information about the input and the other has a latent carrying exactly zero. The objective cannot se…