Technical Terms
Inference
Definition
The process of running a trained AI model to generate predictions or outputs from new inputs. When you send a prompt to ChatGPT and receive a response, that's inference. Inference speed and cost are key factors in AI deployment.
In Plain English
Actually using the AI to get answers. Training is like studying for an exam; inference is like taking the exam. Every time you ask ChatGPT a question, it's doing inference — and that costs computing power.