• ji59@hilariouschaos.com
      link
      fedilink
      English
      arrow-up
      3
      ·
      10 months ago

      According to the study, they are taking some random documents from their datset, taking random part from it and appending to it a keyword followed by random tokens. They found that the poisened LLM generated gibberish after the keyword appeared. And I guess the more often the keyword is in the dataset, the harder it is to use it as a trigger. But they are saying that for example a web link could be used as a keyword.

    • PrivateNoob@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      0
      ·
      10 months ago

      There are poisoning scripts for images, where some random pixels have totally nonsensical / erratic colors, which we won’t really notice at all, however this would wreck the LLM into shambles.

      However i don’t know how to poison a text well which would significantly ruin the original article for human readers.

      Ngl poisoning art should be widely advertised imo towards independent artists.

      • partofthevoice@lemmy.zip
        link
        fedilink
        English
        arrow-up
        0
        ·
        10 months ago

        Replace all upper case I with a lower case L and vis-versa. Fill randomly with zero-width text everywhere. Use white text instead of line break (make it weird prompts, too).

        • killingspark@feddit.org
          link
          fedilink
          English
          arrow-up
          0
          arrow-down
          1
          ·
          edit-2
          10 months ago

          Somewhere an accessibility developer is crying in a corner because of what you just typed

          Edit: also, please please please do not use alt text for images to wrongly “tag” images. The alt text important for accessibility! Thanks.