Quantisation
Post-training and quantisation-aware methods, outlier channels, GPTQ and AWQ, and low-bit arithmetic formats.
5concepts
64flashcards
35minutes of reading
Post-training and quantisation-aware methods, outlier channels, GPTQ and AWQ, and low-bit arithmetic formats.