AI glossary Operations
What is Inference?
← All glossary termsPhase when a trained model produces predictions or generation.
Explained
Inference is when a trained model is used to produce outputs—predictions, classifications, or generated content. It happens in production; optimizing inference (latency, cost) is key for scalability.