90% Cost Reduction: Managing AI Token Economics for CFOs

As artificial intelligence adoption accelerates across corporate sectors, a new financial report from Deloitte details how infrastructure investments over the past seven years have surpassed historical spending levels for multi-state highway construction and the late-1990s dot-com boom. According to the report, data center, graphics processing unit, and cloud computing expenditures have reached high levels as executives re-examine organizational operating expenses.

AI Costs Depend on Token Usage

Unlike traditional software licensing models tied to user counts or fixed contract periods, artificial intelligence systems incur costs determined by tokens. A token functions as the fundamental unit of text reading and generation, covering inputs such as prompts, chat histories, and data queries, alongside outputs like automated emails and executed code.

Deloitte calculates that a single query incorporates both input and output tokens, where 1,500 words correspond to approximately 2,048 tokens. Multi-turn conversations often consume up to 5,000 tokens. Basic chatbots utilize an estimated 9.4 million tokens per subscriber annually, while super agents consume up to 356 million tokens.

Token Consumption Surges in Healthcare and Telecommunications

A large healthcare enterprise collaborating with Deloitte experienced monthly token usage growth between eight and ten percent, reaching one trillion tokens within six months and adding over $6 million in annualized costs. The report noted that token usage behaves like manufacturing variable costs by increasing with volume, yet demand proves significantly harder to control.

Telecommunications provider AT&T deployed artificial intelligence solutions to over 100,000 employees alongside worker agents, generating nearly 8 billion tokens daily. By transitioning to a multi-agent framework where a super agent manages multiple worker agents, the company tripled its daily consumption to 27 billion tokens while reducing costs by 90 percent.

Establishing Financial Controls for Long-Term Competitiveness

Deloitte warns that failing to monitor token flows widens forecasting errors, erodes profit margins through hidden expenditures, and delays critical capital investment decisions. To address these financial challenges, the report advises businesses to realign investments around direct business value, validate spending against measurable returns, and implement comprehensive cost-and-performance oversight structures.