AI Inference & Serving
Quantization
Representing model-related numerical values with fewer discrete levels or lower precision. It can reduce storage, but numerical error and hardware support must be evaluated separately from file size.
Reviewed
Sources
Free complete lesson
This definition and the complete practical lesson are free. The interactive reader loads the lesson examples without a membership.