Since limited waver space (because HBM takes so much of it at the same capacity) is one of the main driving factors for the Ram-apocalyse, this might actually help. And the performance looks actually great (the comparison to the DDR4 i am running shows some parameters being 10x better, this is actually a meaningful upgrade), meaning that some applications that currently use HBM might be able to just use DDR6 instead, causing a greater allocation of wavers towards that.
Since limited waver space (because HBM takes so much of it at the same capacity) is one of the main driving factors for the Ram-apocalyse, this might actually help. And the performance looks actually great (the comparison to the DDR4 i am running shows some parameters being 10x better, this is actually a meaningful upgrade), meaning that some applications that currently use HBM might be able to just use DDR6 instead, causing a greater allocation of wavers towards that.
Generative ML inference isn’t so dramatically bandwidth limited anymore, either, so the “demand” for HBM isn’t as clear.
Eh the really big models want a lot of bandwidth still, otherwise you just don’t make use of all the compute power you have.
Wafer
Thanks, will change it in the future! (not gonna ninja edit that lol)
I generally edit my comments like this:
So that is fixed for the next reader but the comment chain still makes sense.