What is quantization in AI?

Quantization stores model numbers with less detail so they take up less room.

Concept. Think of writing 3.1416 as 3.14. The shorter number keeps most of the detail, but loses some of it.

Facts checked on November 18, 2026.

Words on this page

4 short definitions.
AI
Technology that lets computers do tasks like reading text or spotting patterns.
model
The part of an AI tool that uses what it learned to give an answer. Claude and GPT are model families.
weights
The numbers a model learns during training.
working memory
The space a computer uses to hold what it is working on right now.

How it works

An AI model has many numbers called weights. Using less detail to store them can help the model fit on your computer. It can also hurt how well the model does a task. Try the smaller copy on work you can check.

Keep reading