☆ Yσɠƚԋσʂ ☆@lemmy.ml to Programmer Humor@lemmy.mlEnglish · 3 days agoOpenAI CEO Sam Altman says its “terrible to have everybody have a bunch of the world’s limited supply of DRAM” instead of shoving it all in datacentresfrvr.comexternal-linkmessage-square41linkfedilinkarrow-up1258arrow-down11cross-posted to: programmer_humor@programming.dev
arrow-up1257arrow-down1external-linkOpenAI CEO Sam Altman says its “terrible to have everybody have a bunch of the world’s limited supply of DRAM” instead of shoving it all in datacentresfrvr.com☆ Yσɠƚԋσʂ ☆@lemmy.ml to Programmer Humor@lemmy.mlEnglish · 3 days agomessage-square41linkfedilinkcross-posted to: programmer_humor@programming.dev
minus-squareferric_carcinization@lemmy.mllinkfedilinkEnglisharrow-up2·3 days agoYou don’t use local LLMs the whole time your computer is on. Still, there is no such thing as “wasted RAM”. The RAM programs aren’t “using” is used by the OS as cache. It is also possible to use VRAM as system RAM
You don’t use local LLMs the whole time your computer is on. Still, there is no such thing as “wasted RAM”. The RAM programs aren’t “using” is used by the OS as cache.
It is also possible to use VRAM as system RAM