AI token prices are falling as model substitution increases, GPU rents are declining due to chip oversupply and changing inference dynamics, and token volume remains capped. The article argues that current AI capex is being built for premium, expensive-token models, while most workloads require cheaper tokens from open-source and smaller models. The message is a margin-pressure and demand-mismatch warning for parts of the AI infrastructure stack.
This is less a cyclical air pocket than a pricing reset across the AI stack: the economics are migrating from scarce compute to abundant inference, which compresses the value of both model tokens and the infrastructure built around them. The first-order losers are obvious, but the second-order hit is to any business model predicated on high gross profit per query — if token pricing keeps converging toward marginal cost, software vendors that embedded AI at premium markups will face either margin compression or ARPU pressure within 2-4 quarters.
The more interesting dynamic is supply-side misallocation. Capex is still being deployed toward frontier-model capacity, yet incremental enterprise demand is proving far more elastic for cheaper, domain-tuned, open-weight alternatives. That creates a classic oversupply trap: GPU rental rates can stay weak even if aggregate AI usage rises, because unit economics are being arbitraged down faster than volume grows. In that setup, the beneficiaries are model distributors and orchestration layers that monetize usage efficiency, while pure compute landlords and premium-model incumbents see lower ROI on each incremental dollar of capex.
The market is likely underestimating how quickly this can feed back into procurement behavior. If customers are standardized on “good enough” models, the incentive is to defer expensive multi-year infrastructure commitments and buy spot inference capacity, which caps visibility for the whole hardware ecosystem. A reversal would require either a new class of high-value workloads that truly require frontier reasoning, or a supply discipline shock in chips that restores pricing power; absent that, the pressure persists over months, not days.
Contrarian takeaway: the bearish consensus on AI spend may be directionally right but too blunt. The trade is not simply “short AI,” it is long the layer that benefits from commoditized intelligence and short the layer whose moat depends on scarcity. In other words, this is a relative-value dislocation inside AI, not a rejection of AI adoption itself.
AI-powered research, real-time alerts, and portfolio analytics for institutional investors.
Request DemoOverall Sentiment
moderately negative
Sentiment Score
-0.35