AI is getting cheaper faster than almost any technology in history

Skye Jacobs

Posts: 2,295   +64
Staff
Bottom line: AI models are getting cheaper to use at a pace that could reshape the advanced software market. A report from research firm Epoch AI finds that the cost of reaching a given level of AI performance has fallen by nearly 50% per quarter, or about 13 times per year. That is a faster rate of decline than the cost curves seen in lithium-ion batteries, DNA sequencing and computing hardware.

For companies building or buying AI systems, the change could make more capable models affordable for everyday use. It could also make it harder for AI developers to hold onto pricing power. Epoch's report looks at the cost of running models that meet a set performance level on difficult benchmarks.

The analysis does not measure the average price of every AI product or task. Instead, it tracks what it costs to get a model to perform at a certain standard.

Its main measure is GPQA Diamond, a multiple-choice test with graduate-level questions across scientific subjects. Epoch AI tracked the cost of models scoring at least 81.25% on the benchmark.

That approach measures more than whether models are improving: It also tracks how much it costs to achieve a certain answer quality. A newer model may be more accurate, but it may also need less computing power or fewer tokens to complete the same task. Providers may also cut prices as they deploy more efficient systems.

Epoch AI points to a sharp difference between recent OpenAI models. GPT o3, released in January 2025, achieved a 75% score on GPQA Diamond at a cost of $0.30 per question, according to the report. About a year and a half later, GPT-5.6 Luna could reportedly reach the same score for $0.0004 per question.

The difference shows why AI costs are becoming an important part of the technology story. Performance still matters, especially for coding, scientific work, enterprise research and complex agents. But model quality alone is no longer enough. The cost of delivering that quality is becoming just as important.

Epoch AI compared AI's recent cost decline with several well-known technology trends. Lithium battery costs fell by about 100 times between 1991 and 2024. Computing costs fell by hundreds of billions of times over roughly 60 years beginning in 1940. DNA sequencing also became far less expensive, although it took more than two decades for its cost curve to develop.

AI has moved faster, at least under Epoch AI's measurement. The report estimates that the cost of AI capability has fallen about four times faster than DNA sequencing and 18 times faster than lithium batteries.

There are reasons to be careful with those comparisons. The AI data begins in 2023, with earlier figures estimated using research and extrapolated trends. The compute data in the comparison ends in 2001, while electricity data ends in 1973. The data therefore does not capture every major development in computing or energy over the past two decades.

The price drops are also not consistent across all types of work. Epoch AI looked at other benchmarks involving mathematics and chess puzzles and found that the results varied. Some tasks showed steady cost improvements. Others showed long stretches with little change, followed by sudden declines.

Its Frontier Math results, for example, changed little between 2025 and 2026 before costs dropped sharply in mid-2026. That suggests there is no single AI cost curve that applies to every kind of reasoning.

The report also found that the pace of price declines may be slowing. Across the five benchmarks it tracked, costs initially fell by 66% per quarter. Two years later, the decline had slowed to 32% per quarter.

That is still a rapid improvement. But it may reflect the growing difficulty of reducing inference costs as energy, data-center capacity and AI hardware become more expensive. Running frontier models requires large amounts of computing power, and providers cannot avoid those physical costs entirely.

Epoch AI also notes the risk of "benchmaxxing," in which developers train models to perform well on benchmarks without producing the same gains in broader real-world work. The firm used randomized elements in some tests to make this harder. Still, results from benchmarks without those protections showed steeper cost reductions, suggesting that benchmark-specific optimization may be part of the picture.

For customers, lower prices create more choices. A company may not need to pay for the newest and most expensive model if a cheaper alternative delivers similar results for its workload. That could put pressure on providers that spend heavily to build frontier systems.

But price is not the only reason companies choose an AI provider. Existing integrations, security policies, user habits and trust all matter. Switching models can require testing, changes to software and new reviews of privacy and reliability.

Even so, Epoch AI's findings point to a market where AI performance may become cheaper faster than many customers can adjust their plans. For developers, the challenge will be finding ways to build products that stay useful and profitable even as the models behind them get cheaper.

Permalink to story:

 
Open AI couldn't make a profit with higher prices. They need to slow down the ridiculous rate of growth and become efficient, if they want a successful IPO, whenever that happens.

Overall, without greater efficiency, lower prices means faster bubble burst. Good.
 
For end users maybe, definitely not for the providers. New models cost more to produce and operate and the industry isn't adherant to normal rules of economy of scale. The competition is making prices drop for now but everything is still massively subsidized and at some point, prices will have to massively increase if these companies ever want to have a hope of profitability. And big price increases will make most of the customers vanish.
 
Open AI couldn't make a profit with higher prices. They need to slow down the ridiculous rate of growth and become efficient, if they want a successful IPO, whenever that happens.

Overall, without greater efficiency, lower prices means faster bubble burst. Good.

It's a race in who will turn out to be the absolute winner.

You got OpenAI, Google, Meta and what more. Nobody is going to back down and settle with what they have now.

 
For end users maybe, definitely not for the providers. New models cost more to produce and operate and the industry isn't adherant to normal rules of economy of scale. The competition is making prices drop for now but everything is still massively subsidized and at some point, prices will have to massively increase if these companies ever want to have a hope of profitability. And big price increases will make most of the customers vanish.
Exactly right. The huge debt of these companies at the moment is funded by the kind of madness only ignorant investment companies and venture capitalists ever fall for. All the AI players are desperate to be the big fish but unfortunately for them LLM's are inherently really quite simple to create and so they are stuck in this huge cost to run and debt cycle with tiny relative revenue and an IP that's way to easy to duplicate. I keep expecting the markets to finally wake up to this truth but it almost feels now like they are so far down the rabbit burrow they just don't know how to turn around.
 
I hate 2 things about this graph. I confirmed these with a pixel level trendline analysis of the graph's data.
- There are JUST 2 data points shown for AI. Wtf? There is no greater gap in data points in the rest of the graph than the basis for this "conclusion". If you had a 10,000x cost cutting in the first year and then another 100x cost cutting in the 4 remaining years, then the graph means almost nothing because they could've easily excluded equivalent first year cost cuts of other technologies while they were in the lab. It's well known that the first true AI model was released in 2022 with ChatGPT, not 2021.
- The trend shown for the first 5 years of AI cost cuts are not the steepest shown in the graph lol. DNA sequencing unconditionally shows a faster cost cutting rate in year 6/10.

In the end, this was a useless study because it put in almost no effort to collect data for AI cost cutting.
 
I'll be in when they pay ME to ask them questions.

Heheh the other day one of my pals asked ChatGTP how to prevent macOS from sharing the Desktop and Downloads folders with the cloud...the thing came up with a stupidly WRONG answer hahaha.

ChatGTP probably doesn't have enough money for Apple machines.
 
And this is the real reason why the industry wants to pause frontier model development. It isn't safety, it's economics.
 
This is why it's hard to extrapolate today's AI economics five years forward. If inference keeps getting dramatically cheaper, applications that currently make no financial sense could become trivial to run. The bigger question is whether demand expands fast enough to consume all of those savings anyway.
 
I hate 2 things about this graph. I confirmed these with a pixel level trendline analysis of the graph's data.
- There are JUST 2 data points shown for AI. Wtf? There is no greater gap in data points in the rest of the graph than the basis for this "conclusion". If you had a 10,000x cost cutting in the first year and then another 100x cost cutting in the 4 remaining years, then the graph means almost nothing because they could've easily excluded equivalent first year cost cuts of other technologies while they were in the lab. It's well known that the first true AI model was released in 2022 with ChatGPT, not 2021.
- The trend shown for the first 5 years of AI cost cuts are not the steepest shown in the graph lol. DNA sequencing unconditionally shows a faster cost cutting rate in year 6/10.

In the end, this was a useless study because it put in almost no effort to collect data for AI cost cutting.

n=2, not the best for making a graph. LOLOLOL Great observation!
 
Exactly right. The huge debt of these companies at the moment is funded by the kind of madness only ignorant investment companies and venture capitalists ever fall for. All the AI players are desperate to be the big fish but unfortunately for them LLM's are inherently really quite simple to create and so they are stuck in this huge cost to run and debt cycle with tiny relative revenue and an IP that's way to easy to duplicate. I keep expecting the markets to finally wake up to this truth but it almost feels now like they are so far down the rabbit burrow they just don't know how to turn around.

As I've always heard from the VC guys, they don't care, they know most of their ventures will fail. However, if they hit the jackpot, it makes-up for all the loses (allegedly). Either way, I agree with your analysis other than the investors being "ignorant". I know these kinds of folks, they are very intelligent, well educated, and informed. Before they dump millions of dollars into something there is a ton of due diligence. But, they are also greedy gamblers who don't want to "miss out" on the next big thing. lol
 
The speed of the cost reduction is pretty impressive, especially with the same level of performance becoming dramatically cheaper. It’ll be interesting to see how long these declines continue as inference costs run into hardware, energy, and data-center limits.
 
Just waiting for the other shoe to drop...........9,8,7,6,5...........................................
 
It's not getting cheaper. It's just getting charged less for, while more investor money is burnt on it than on anything previously.

You can make a product as cheap as you want as long as you don't charge the actual cost of it, and have moronic investors paying the difference.
 
This is why the tech bros, the chinese, and the political left (as if there was a difference) are scaremongering everyone into thinking AI will kill us all and it needs to be regulated:

Commoditization is coming, and they want to pull up the ladders before their trillion dollar valuations vanish.
 
It's probably unfair to the other technologies to start the clock of the AI revolution in 2021. One really needs to go back to ~2011, the beginning of the deep learning revolution, to include all the developments that brought both capability up and cost down, to be fair when comparing the trend to the other technologies.

If we include vacuum tubes for compute (which I gather from the 1940 start date on the chart), then we ought to include the deep learning revolution for AI. There's a section of the compute line that drops dramatically in the middle, I don't know if that's when the transistor was invented, but if it is, then that line is roughly what the 2021-2026 AI line looks like.

DNA sequencing also has a really steep part of the curve, so I question if the start/end dates were chosen to make AI look faster. It's newer, and if you model things with logistic curves (exponential in the middle), we haven't reached the point where AI is in the flatter end, even though the other technologies have (so one needs to cut out that tail to be fair).
 
Last edited:
Yes but the biggest gains are at the beginning - it will not continue at that pace.
It will continue even faster.
Today both models and hardware are mostly designed by humans. Soon they'll be mostly designed by models, and then everything will speed up.
 
Yes because AI can ignore physics and everything we know about technological development. You should ask your AI savior about "Diminishing marginal returns".
How a model developing something ignores physics?
I do that every day and physics seems to remain intact.
 
For end users maybe, definitely not for the providers. New models cost more to produce and operate and the industry isn't adherant to normal rules of economy of scale. The competition is making prices drop for now but everything is still massively subsidized and at some point, prices will have to massively increase if these companies ever want to have a hope of profitability. And big price increases will make most of the customers vanish.
Like with streaming. Prices are increasing several times a year now and even ad-free plans are no longer ad free.

Same will happen with AI. I already received notification from Google that the free Gemini tier will lose access to to Pro model starting October 9. I suspect others will follow suit if they haven't already and restrict the free models to the most castrated bare bones model they have with heavy usage limits and everything useful is being locked behind an ever increasing paywall.

They have already made owning the hardware and running AI locally prohibitively expensive. Now they're castrating the free models to force those who have come dependent on AI to pay for paid plans.
 
Back