Inference

The stage where a trained model produces output.

After training, the model computes an output for an input. This happens far more often than training, and its cost dominates service bills.