Input tokens vs. output tokens
Every provider bills input and output separately, and at different rates. Input is everything you send — the prompt, system instructions, retrieved documents, tool results, prior turns in a conversation. Output is only what the model generates back. Providers price output several times higher than input because generation is the more expensive half of the computation, so a chatty, verbose model reply costs more than a terse one even at identical input size.
Context window
The context window is the maximum combined input + output size a model can handle in one request, measured in tokens (roughly ¾ of a word each). A bigger window lets you stuff in more history, more retrieved documents, or a larger codebase before the model loses track of earlier content — but it doesn't change the per-token price, so a huge context window only costs more if you actually fill it.
Frontier, Balanced, and Fast: the tier trade-off
Every major provider ships roughly three tiers. Frontier models are the most capable and most expensive — reasoning-heavy or high-stakes tasks. Balanced models trade a little quality for a meaningfully lower price and are the default choice for most production traffic. Fast (sometimes called "mini" or "lite") models are cheapest and quickest, built for high-volume, low-complexity work like classification, extraction, or simple chat turns. Routing easy requests to a Fast model and reserving Frontier for the requests that need it is one of the highest-leverage AI cost controls available.
Prompt caching
If your requests repeat the same large system prompt, tool definitions, or reference document, prompt caching lets the provider skip re-processing that prefix and charge a small fraction of a normal input-token rate for the cache read instead. It only helps the input side, and only on the portion of the prompt that stays identical between calls — but on a workload with a stable prefix and a high cache-hit rate, it can meaningfully cut the input line of your bill. Exact caching mechanics and discount rates vary by provider and change often, so this page keeps the discussion qualitative — check the provider's own pricing page for current cache rates.
Reading the notes
Where a row below has a note, it's usually flagging non-standard pricing: an intro or preview rate that reverts to a higher published price after a stated date, or a context-length cap that only applies above a certain prompt size. Always check the note before budgeting off a listed price — "intro pricing" in particular is a temporary number, not the steady-state rate.