themachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 5 months agoGoogle unveils TurboQuant, a new AI memory compression algorithm — and yes, the internet is calling it ‘Pied Piper’techcrunch.comexternal-linkmessage-square18linkfedilinkarrow-up1138arrow-down16
arrow-up1132arrow-down1external-linkGoogle unveils TurboQuant, a new AI memory compression algorithm — and yes, the internet is calling it ‘Pied Piper’techcrunch.comthemachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 5 months agomessage-square18linkfedilink
minus-squareAbouBenAdhem@lemmy.worldlinkfedilinkEnglisharrow-up5·5 months agoYeah—but in theory you only need to train once, while inference costs are ongoing and scale up with usage. I guess it’s ultimately a business decision by AI companies to weigh how often retraining is worth the cost.
Yeah—but in theory you only need to train once, while inference costs are ongoing and scale up with usage.
I guess it’s ultimately a business decision by AI companies to weigh how often retraining is worth the cost.