financial modeling

From AI Cost Spikes to Clear ROI: A Smarter Path Forward

As AI spending accelerates, understanding its economic implications is crucial for technology leaders.

May 12, 20263 min readVentureBeat

From AI Cost Spikes to Clear ROI: A Smarter Path Forward

In the rapidly evolving landscape of artificial intelligence, organizations are grappling with how to measure the return on investment (ROI) of their AI initiatives. The report "Turning AI cost spikes into strategic growth opportunities," presented by Apptio, sheds light on the complexities of AI economics and emphasizes the urgent need for businesses to establish clear frameworks for evaluating AI ROI. With 90% of technology leaders reporting that ROI uncertainty significantly impacts their investment decisions, it is clear that navigating the costs and benefits of AI is no longer a theoretical exercise—it is a pressing concern for enterprises looking to thrive in a competitive environment. This situation echoes findings from related discussions on enterprise adaptability in AI as highlighted in articles like Is your enterprise adaptive to AI?, which underscore the importance of strategic clarity in AI investments.

The surge in AI spending, while promising, is accompanied by unpredictable costs and returns, similar to the initial challenges faced by organizations during the early days of public cloud adoption. As Apptio's report notes, organizations are increasingly looking to fund AI initiatives by reallocating budget capital and reinvesting savings from AI-driven efficiencies. However, this requires a thorough understanding of the trade-offs involved, as the promise of AI savings is only valid if they can be quantified and realized. Tech leaders must prioritize their initiatives based on quantifiable goals tied to real business outcomes, ensuring that AI investments are not only ambitious but also strategically relevant. This aligns with the insights from our previous articles that advocate for a structured approach to technology investments, such as Running Claude Code or Claude in Chrome? Here's the audit matrix for every blind spot your security stack misses, which discuss the critical nature of informed decision-making in technology adoption.

To effectively manage the uncertainties of AI economics, an advanced approach to technology business management (TBM) is advocated. By integrating IT Financial Management, AI FinOps, and Strategic Portfolio Management, TBM provides a comprehensive framework that enables enterprises to capture and evaluate AI costs across various dimensions. This holistic view allows leaders to spot unexpected cost spikes early and make informed decisions about their AI investments. As organizations transition from experimental AI projects to sustainable, managed investments, it becomes essential to articulate clear success metrics and establish accountability around AI expenditures. The emphasis on a data-driven decision-making framework is particularly salient, as it equips tech leaders with the insights needed to navigate the complexities of AI adoption effectively.

Looking ahead, the challenge for organizations will be not just to adopt AI but to do so responsibly and sustainably. As boards grow more discerning, demanding trustworthy data and clearer outcomes, leaders must pivot away from viewing AI as a gamble on innovation. Instead, they should embrace a managed investment approach that prioritizes clarity around scope, outcomes, and cost drivers. This shift will require organizations to continually reassess their investments and strategies, ensuring alignment with broader business objectives. As AI technology continues to evolve, the question remains: how will organizations adapt their investment frameworks to keep pace with rapid changes in AI economics and technology? This is a critical consideration for any enterprise aiming to leverage AI not just for efficiency, but as a strategic driver for future growth.

From VentureBeat

AI spending is surging, but the full impact often remains an open question. Closing the gap requires clear answers to how AI is governed, measured, and tied to business outcomes.

Read the original at VentureBeat

Briefing

Source: VentureBeat
Published: May 12, 2026

From AI momentum to measurable value: closing the visibility gap
Enterprise AI is entering a new phase — one where the central question is no longer what can be built, but how to make the most of our AI investment. At VentureBeat’s latest AI Impact Tour session, Brian Gracely, director of portfolio strategy at Red Hat, described the operational reality inside large organizations: AI sprawl, rising inference costs, and limited visibility into what those investments are actually returning. It’s the “Day 2” moment — when pilots give way to production, and cost, governance, and sustainability become harder than building the system in the first place. "We've seen customers who say, 'I have 50,000 licenses of Copilot. I don't really know what people are getting out of that. But I do know that I'm paying for the most expensive computing in the world, because it's GPUs,'" Gracely said. "'How am I going to get that under control?'" Why enterprise AI costs are now a board-level problem For much of the past two years, cost was not the primary concern for organizations evaluating generative AI. The experimental phase gave teams cover to spend freely, and the promise of productivity gains justified aggressive investment, but that dynamic is shifting as enterprises enter their second and third budget cycles with AI. The focus has moved from "can we build something?" to "are we getting what we paid for?" Enterprises that made large, early bets on managed AI services are conducting hard reviews of whether those investments are delivering measurable value. The issue isn’t just that GPU computing is expensive. It is that many organizations lack the instrumentation to connect spending to outcomes, making it nearly impossible to justify renewals or scale responsibly. The strategic shift from token consumer to token producer The dominant AI procurement model of the past few years has been straightforward: pay a vendor per token, per seat, or per API call, and let someone else manage the infrastructure. That model made sense as a starting point but is increasingly being questioned by organizations with enough experience to compare alternatives. Enterprises that have been through one AI cycle are starting to rethink that model. "Instead of being purely a token consumer, how can I start being a token generator?" Gracely said. "Are there use cases and workloads that make sense for me to own more? It may mean operating GPUs. It may mean renting GPUs. And then asking, 'Does that workload need the greatest state-of-the-art model? Are there more capable open models or smaller models that fit?'" The decision is not binary. The right answer depends on the workload, the organization, and the risk tolerance involved, but the math is getting more complicated as the number of capable open models, from DeepSeek to models now available through cloud marketplaces, grows. Now enterprises actually have real alternatives to the handful of providers that dominated the landscape two years ago. Falling AI costs and rising usage create a paradox for enterprise budgets Some enterprise leaders argue that locking into infrastructure investments now could mean significantly overpaying in the long run, pointing to the statement from Anthropic CEO Dario Amodei that AI inference costs are declining roughly 60% per year. The emergence of open-source models such as DeepSeek and others has meaningfully expanded the strategic options available to enterprises that are willing to invest in the underlying infrastructure in the last three years. But while costs per token are falling, usage is accelerating at a pace that more than offsets efficiency gains. It's a version of Jevons Paradox, the economic principle that improvements in resource efficiency tend to increase total consumption rather than reduce it, as lower cost enables broader adoption. For enterprise budget planners, this means declining unit costs do not translate into declining total bills. An organization that triples its AI usage while costs fall by half still ends up spending more than it did before. The consideration becomes which workloads genuinely require the most capable and most expensive models, and which can be handled just fine by smaller, cheaper alternatives. The business case for investing in AI infrastructure flexibility The prescription isn't to slow down AI investment, but to build with flexibility being top of mind. The organizations that will win aren't necessarily the ones that move fastest or spend the most; they're the ones building infrastructure and operating models capable of absorbing the next unexpected development. "The more you can build some abstractions and give yourself some flexibility, the more you can experiment without running up costs, but also without jeopardizing your business. Those are as important as asking whether you're doing everything best practice right now," Gracely explained. But despite how entrenched AI discussions have become in enterprise planning cycles, the practical experience most organizations have is still measured in years, not decades. "It feels like we've been doing this forever. We've been doing this for three years," Gracely added. "It's early and it's moving really fast. You don't know what's coming next. But the characteristics of what's coming next — you should have some sense of what that looks like.” For enterprise leaders still calibrating their AI investment strategies, that may be the most actionable takeaway: the goal is not to optimize for today's cost structure, but to build the organizational and technical flexibility to adapt when, not if, it changes again.

Topics

financial modeling predictive analytics enterprise data management