themachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 2 days agoScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comexternal-linkmessage-square117linkfedilinkarrow-up1516arrow-down18 cross-posted to: [email protected]
arrow-up1508arrow-down1external-linkScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comthemachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 2 days agomessage-square117linkfedilink cross-posted to: [email protected]
minus-squareThomasWilliams@lemmy.worldlinkfedilinkEnglisharrow-up1·2 days agoLower inference costs will lead to more demand for RAM
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up9·2 days agoWill it though? I posit there’s a saturation point where there’s “enough” LLM in use, and we are not far from that. The whole pitch from Altman and such is scaling models up. But that’s not working.
Lower inference costs will lead to more demand for RAM
Will it though?
I posit there’s a saturation point where there’s “enough” LLM in use, and we are not far from that.
The whole pitch from Altman and such is scaling models up. But that’s not working.