quantization-from-ground-up

Quantization from the Ground Up

Ngrok blog tutorial on quantization fundamentals for LLM inference. By Sam Rose. (Note: content was thin on fetch — likely JavaScript-rendered. See also Visual Guide to Quantization for comprehensive coverage.)

Connections

• Visual Guide to Quantization — more complete quantization guide already in wiki
• Transformer Inference Optimization — broader inference optimization survey