“…and you definitely won’t be able to afford it”
This makes it official, I’m skipping DDR5. I have ryzen 5700 and 32 GiB of DDR4, it’ll hold me over for a few more years. When I finally upgrade, it’s going to be at least 128 GiB.
I’m probably skipping DDR5 as well at this rate. My Ryzen 2700 could use an upgrade, but I think I can survive with it until memory prices regain a little sanity. And I expect DDR6 will hit before that happens.
One good thing about the AI boom is that it’s flooding capital into ram development and ram production. Once the bubble pops all these ram companies will have a glut of cheap high performance memory to sell to anyone who can buy it in cash. The question is if the bubble popping triggers a full blown recession will anyone have any cash to buy.
There is always people with money to buy
Only $1,000,000 per gigabyte, think of the performance!
when will they go back to optimizing software to run in the available ram, rather than continuing to increase ram size?
When the devs run out of available RAM.
Or if you’re 100 Rabbits and you live on a boat powered by solar so you’re actively limited by available electricity so you write tools based on your home-made tiny VM.
Who are “they”?
The Stonecutters, obviously. https://youtu.be/fI4bRqjobbw
Who rigs every Oscar night?
who builds software?
Governments, corporations, military, startups, communities, hobbyists…
If you’re able to optimize AI tools to run larger models in less RAM, you’ll have a lucrative future ahead of you.
i would not use ai for anything. too many errors and falsehoods come from them. and theyre now out there hacking other systems because nobody reins them in
It’s KINDA being done in the ways we run MoE models. Strata makes more efficient use of limited VRAM if you have a decent amount of RAM, but you don’t even need to keep the entire model in RAM with it, it can keep the least frequently used experts on disk instead (said disk being an NVMe SSD hopefully, otherwise if you hit those experts, good luck)
I hope that one day I can afford a ticket to an exhibition where we all gather around a security-glass display case with a stick of one of those in it and bask in its presence.
I hear superyachts are pretty nice too.
8GB is only 2,762.89 before taxes. Act now, limited quantities.
I’ll buy 1TB, then have AI build a house for me to live in. It’s fool …proof.
Electron apps will still be slow.
DDR6 has no official launch date. Many believe 2029 is a realistic target for commercialization. However, in the current state of things, it would be a miracle if DDR6 had no setbacks.
One can only hope the bubble pops before 2029.
It will, it’s coming next summer/fall unless it comes earlier. If the AI industry continues on in its current state until 2029 without popping, then it won’t pop. It means they stabilized their debt and financing.
The bubble will pop, unless it doesn’t. Noted.
I firmly believe it will based on the financials. I am just saying if it’s 2029 and it “hasn’t happened yet” then it won’t happen. It’s coming within the next year, I would bet money on it. Not my life savings, but a chunk. In fact I have bet some money on it.
One can only hope the bubble pops before 2029.
Since limited waver space (because HBM takes so much of it at the same capacity) is one of the main driving factors for the Ram-apocalyse, this might actually help. And the performance looks actually great (the comparison to the DDR4 i am running shows some parameters being 10x better, this is actually a meaningful upgrade), meaning that some applications that currently use HBM might be able to just use DDR6 instead, causing a greater allocation of wavers towards that.
Generative ML inference isn’t so dramatically bandwidth limited anymore, either, so the “demand” for HBM isn’t as clear.
Eh the really big models want a lot of bandwidth still, otherwise you just don’t make use of all the compute power you have.
Wafer
Thanks, will change it in the future! (not gonna ninja edit that lol)
I generally edit my comments like this:
Since limited
waverwafer spaceSo that is fixed for the next reader but the comment chain still makes sense.
Great how real RAM development starts the moment nobody but a handful of billionaires can afford it.
Ddr6 is nothing new tho. Look at your gpu . It had it for years at this point.
GDDR versioning doesn’t necessarily line up like that. For instance, GDDR7 is technologically akin to LPDDR5X, just with a different set of configuration tradeoffs.
Are there heat issues to deal with?
At this point it doesn’t matter anymore if it were DDR99 with 578644.7 GT/s modules as we, consumers, won’t see them again in real life
Cool the world is going back to ddr4 and ddr3. Who cares at this point? If it’s not going to be affordable and we already have all these pre existing computers that are working just fine anyway.
Nobody is going back to ddr3 except maybe the 3rd world and a few home servers. DDR4 maybe, but I imagine most people aren’t buying new machines just for cheaper RAM, can you really say “going back to DDR4” if you were never on DDR5?
DDR6 will get you much better performance for models that don’t fit entirely in your VRAM so it’s going to be very helpful for people running local models.
And when the memory market normalises, which could be pretty soon if nvidia stops ordering a ton of HBM it doesn’t even need, we should get back to the price per GB going down over time. CXMT is now apparently getting 90% yield on DDR5 which is excellent and the big 3 should be getting their first new foundries up next year since they started building them in around 2022 when the LLM boom started and they take about 4-5 years to finish.
So any time you see a headline saying the memory crisis is only getting worse, it’s because the members of the memory cartel REALLY want you to buy right now. Because they can’t keep up the grift for much longer.
DDR6 will get you much better performance for models that don’t fit entirely in your VRAM so it’s going to be very helpful for people running local models.
For those of us who are not running after AI shit, DDR4 is fine.
I mean DDR2 is fine too, it’ll do everything you NEED to do and is available in big enough capacity, DDR would probably not offer enough capacity on a standard 4 slot desktop motherboard.
Anything above that is for your own enjoyment (speeding things up).
Raises hand
Two of my Pc’s run ddr5, and the rest of the Armada are on ddr4. DDR3 still exists in plenty of Appliance devices and reliably running Legacy systems, and I keep a handful of DDR3 sticks around just in case I get to revive something older.
two of my PC’s run ddr5
and I keep a handful of DDR3 sticks around
Sounds like you didn’t start buying DDR3 to replace DDR5, so can you really say you “went back to” DDR3?
And howich of that have you bought in the last, say, 2 years?
“Going back to” implies switching to.
The progress must go on, supply will catch up eventually - hopefully, at least.












