jaykrown@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comexternal-linkmessage-square122fedilinkarrow-up1405arrow-down17
arrow-up1398arrow-down1external-linkDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comjaykrown@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square122fedilink
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up2·edit-223 hours agoGenerative ML inference isn’t so dramatically bandwidth limited anymore, either, so the “demand” for HBM isn’t as clear.
minus-squareboonhet@sopuli.xyzlinkfedilinkEnglisharrow-up4·21 hours agoEh the really big models want a lot of bandwidth still, otherwise you just don’t make use of all the compute power you have.
Generative ML inference isn’t so dramatically bandwidth limited anymore, either, so the “demand” for HBM isn’t as clear.
Eh the really big models want a lot of bandwidth still, otherwise you just don’t make use of all the compute power you have.