• ramble81@lemmy.zip
    link
    fedilink
    English
    arrow-up
    10
    ·
    4 months ago

    Serious question here. LLMs trained their data off SO. Developers now ask LLMs for solutions instead of SO. New technology comes out that LLMs don’t have indexed. Where will LLMs get their data to train on for new technologies? You can’t exactly feed it a manual and expect it to extrapolate or understand (for that matter “what manual).

    • General_Effort@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 months ago

      You can’t exactly feed it a manual and expect it to extrapolate or understand (for that matter “what manual).

      You can do that to a degree (RLVR). They are also paying human experts. But that’s the situation now. Who knows how it will be in a couple more years. Maybe training AIs will be like writing a library, framework, …