Without inference, AI models wouldn't be able to do new things. Most of an AI model's life is spent in inferencing since training takes place before a model is ready to be used.

This volatility is why current inference AI workloads are, for the most part, being handled by AI IT clusters that were originally deployed for AI training and are located in large data centers.