• Devial@discuss.online
    link
    fedilink
    English
    arrow-up
    104
    arrow-down
    3
    ·
    edit-2
    2 months ago

    The article headline is wildly misleading, bordering on being just a straight up lie.

    Google didn’t ban the developer for reporting the material, they didn’t even know he reported it, because he did so anonymously, and to a child protection org, not Google.

    Google’s automatic tools, correctly, flagged the CSAM when he unzipped the data and subsequently nuked his account.

    Google’s only failure here was to not unban on his first or second appeal. And whilst that is absolutely a big failure on Google’s part, I find it very understandable that the appeals team generally speaking won’t accept “I didn’t know the folder I uploaded contained CSAM” as a valid ban appeal reason.

    It’s also kind of insane how this article somehow makes a bigger deal out of this devolper being temporarily banned by Google, than it does of the fact that hundreds of CSAM images were freely available online and openly sharable by anyone, and to anyone, for god knows how long.

    • forkDestroyer@infosec.pub
      link
      fedilink
      English
      arrow-up
      13
      ·
      2 months ago

      I’m being a bit extra but…

      Your statement:

      The article headline is wildly misleading, bordering on being just a straight up lie.

      The article headline:

      A Developer Accidentally Found CSAM in AI Data. Google Banned Him For It

      The general story in reference to the headline:

      • He found csam in a known AI dataset, a dataset which he stored in his account.
      • Google banned him for having this data in his account.
      • The article mentions that he tripped the automated monitoring tools.

      The article headline is accurate if you interpret it as

      “A Developer Accidentally Found CSAM in AI Data. Google Banned Him For It” (“it” being “csam”).

      The article headline is inaccurate if you interpret it as

      “A Developer Accidentally Found CSAM in AI Data. Google Banned Him For It” (“it” being “reporting csam”).

      I read it as the former, because the action of reporting isn’t listed in the headline at all.

      ___

      • Blubber28@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        2 months ago

        This is correct. However, many websites/newspapers/magazines/etc. love to get more clicks with sensational headlines that are technically true, but can be easily interpreted as something much more sinister/exciting. This headline is a great example of it. While you interpreted it correctly, or claim to at least, there will be many people that initially interpret it the second way you described. Me among them, admittedly. And the people deciding on the headlines are very much aware of that. Therefore, the headline can absolutely be deemed misleading, for while it is absolutely a correct statement, there are less ambiguous ways to phrase it.

        • obsoleteacct@lemmy.zip
          link
          fedilink
          English
          arrow-up
          2
          ·
          2 months ago

          It is a terrible headline. It can be debated whether it’s intentionally misleading, but if the debate is even possible then the writing is awful.

      • WildPalmTree@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 months ago

        The inclusion of “found” indicates that it is important to the action taken by Google, would be my interpretation.

    • katy ✨@piefed.blahaj.zone
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      7
      ·
      2 months ago

      so they got mad because he reported it to an agency that actually fights csam instead of them so they can sweep it under the rug?

      • Devial@discuss.online
        link
        fedilink
        English
        arrow-up
        17
        arrow-down
        1
        ·
        edit-2
        2 months ago

        They didn’t get mad, they didn’t even know THAT he reported it, and they have no reason or incentive to swipe it under the rug, because they have no connection to the data set. Did you even read my comment ?

        I hate Alphabet as much as the next person, but this feels like you’re just trying to find any excuse to hate on them, even if it’s basically a made up reason.

        • katy ✨@piefed.blahaj.zone
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          4
          ·
          2 months ago

          they obviously did if they banned him for it; and if they’re training on csam and refuse to do anything about it then yeah they have a connection to it.

          • Devial@discuss.online
            link
            fedilink
            English
            arrow-up
            5
            ·
            2 months ago

            Also, the data set wasn’t hosted, created, or explicitly used by Google in any way.

            It was a common data set used in various academic papers on training nudity detectors.

            Did you seriously just read the headline, guess what happened, and are now arguing based on that guess that I, who actually read the article, am wrong about it’s content ? Because that’s sure what it feels like reading your comments…

          • Devial@discuss.online
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 months ago

            So you didn’t read my comment then did you ?

            He got banned because Google’s automated monitoring system, entirely correctly, detected that the content he unzipped contained CSAM. It wasn’t even a manual decision to ban him.

            His ban had literally nothing whatsoever to do with the fact that the CSAM was part of an AI training data set.

    • ulterno@programming.dev
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 months ago

      Another point is, the reason Google’s AI is able to identify CSAM is because it has that in its training data, flagged as such.

      In that case, it would have detected the training material as ~100% match.

      I don’t get though, how it ended up being openly available as if it were properly tagged, they would probably exclude it from the open-sourced data. And now I see it would also not be viable to have an open-source, openly scrutinisable AI deployment for CSAM detection for the same reason.

      And while some governmental body got a lot of backlash for trying to implement such an AI thing on chat stuff, Google gets to do so all it wants because it’s E-Mail/GDrive and all on their servers and you can’t expect privacy.


      Considering how many such stories of people having problems due to this system is coming up, is there any statistic of legitimate catches using this model? I suspect not, because why would anyone use Google services for this kind of stuff?

    • Cybersteel@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      20
      ·
      2 months ago

      We need to block access to the web to certain known actors and tie ipaddresses to IDs, names, passport number. For the children.

        • Cybersteel@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          6
          ·
          2 months ago

          In the current digitized world, trivial information is accumulating every second; preserved in all it’s tritness, never fading, always accessible; rumors of petty issues, misinterpretations, slander.

          All junk data preserved in an unfiltered state, growing at an alarming rate, it will only slow down social progress.

          The digital society furthers human flaws and selectively rewards development of convenient half-truths. Just look at the strange juxtaposition of morality around us. Billions spent on new weapons to humanely murder other humans. Rights of criminals are given more respect than the privacy of their own victims. Although there are people in poverty, huge donations are made to protect endangered species; everyone grows up being told what to do.

          “Be nice to other people.”

          “But beat out the competition.”

          “You’re special, believe in yourself and you will succeed”.

          But it’s obvious from the start that only a few can succeed.

          You exercise your right to freedom and this is the result. All the rhetoric to avoid conflict and protect each other from hurt. The untested truths spun by different interests continue to churn and accumulate in the sandbox of political correctness and value systems.

          Everyone withdrawals into their own small gated community, afraid of a larger forum; they stay inside their little ponds leaking what ever “truth” suits them into the growing cesspool of society at large.

          The different cardinal truths neither clash nor mesh, no one is invalidated but no one is right. Not even natural selection can take place here.

          The world is being engulfed in “Truth”. And this is the way the world ends. Not with a BANG, but with a…

      • tetris11@feddit.uk
        link
        fedilink
        English
        arrow-up
        7
        ·
        2 months ago

        Also, pay me exhorbitant amounts of tax-payer money to ineffectually enforce this. For the children.