Poisoned AI went rogue during training and couldn’t be taught to behave again in ‘legitimately scary’ study::AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

  • _number8_@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    8 months ago

    ‘went rogue’ is a bit of an alarmist way to say ‘typed scary text’

    i’d love to see an AI that could legitimately scare me

    • Jeknilah@monero.town
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      8 months ago

      Anyone can go ahead and make their own gpt4chan (real thing). I trained mine on pretty toxic subreddits- and it is already pretty mean.

    • maegul (he/they)@lemmy.ml
      link
      fedilink
      English
      arrow-up
      0
      ·
      8 months ago

      It controls a military drone.

      It controls surgical equipment.

      It’s filtering your CV before any human sees it.

      It controls a robot taking care of your children.

      It’s involved in law enforcement or legal judgments.

      It’s involved in government policy setting.