Inference & Serving
28 min
A Token Is Not a Unit: The Arithmetic Behind an Unforecastable AI Bill
One vendor shipped a new tokeniser that emits about 30 percent more tokens for the same text, at an unchanged published price. Nobody's rate card moved and everybody's bill rose. The industry buys AI by the token, and a token is …