According to the release:

Adds experimental PostgreSQL support

The code was written by Cursor and Claude

14,997 added lines of code, and 10,202 lines removed

reviewed and heavily tested over 2-3 weeks

This makes me uneasy, especially as ntfy is an internet facing service. I am now looking for alternatives.

Am I overreacting or do you all share the same concern?

  • patrick@lemmy.bestiver.se
    link
    fedilink
    English
    arrow-up
    88
    arrow-down
    4
    ·
    26 days ago

    It looks like that tool is more or less built by a single developer (you already trust their judgment anyways!), and even though the code came through in a single PR it was a merge from a branch that had 79 separate commits: https://github.com/binwiederhier/ntfy/pull/1619

    Also glancing through it a bit, huge portions of that are straightforward refactors or even just formatting changes caused by adding a new backend option.

    I’m not going to say it’s fine, but they didn’t just throw Claude at a problem and let it rewrite 25k lines of code unnecessarily.

    • fccview@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      25 days ago

      Yeah, I mean, with or without AI, I’ve always only had a big pull request for releases, from a stable release branch into the main branch, the release branch would be a merge of various branches or just be worked on directly on various stages.

      One big pull request doesn’t really mean anything.

    • mudkip@lemdro.id
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      24
      ·
      25 days ago

      Any AI usage immediately discredits the software for me, because it calls into question all of their past and future work.

  • Erik-Jan@fosstodon.org
    link
    fedilink
    arrow-up
    69
    arrow-down
    1
    ·
    26 days ago

    @ueiqkkwhuwjw just this quote at the start of the release notes

    > 14,997 added lines of code, and 10,202 lines removed, all from one pull request

    This is already a major red flag even without the ai stuff right? Can’t believe anyone would flaunt that like this.

    • dev_null@lemmy.ml
      link
      fedilink
      English
      arrow-up
      7
      ·
      25 days ago

      The “single pull request” is a merge release from 79 separate commits. It’s the sum of all work, it doesn’t mean all of it was changed in one go.

  • hendrik@palaver.p3x.de
    link
    fedilink
    English
    arrow-up
    62
    ·
    26 days ago

    Uh. I’d really prefer if people experimented with new technology a bit more cautiously and not directly jump to “the biggest release […] ever done”.

      • hendrik@palaver.p3x.de
        link
        fedilink
        English
        arrow-up
        13
        arrow-down
        1
        ·
        26 days ago

        Thanks for the link! As a short aside for the other people here: Try not to spam developers. That usually achieves the opposite and makes them miserable, when we want them to not burn out, and write good software for us. A thumbs-up emoji is the correct reaction for the average person. Or for the pros - a code-review highlighting specific issues within the code.

  • henfredemars@infosec.pub
    link
    fedilink
    English
    arrow-up
    36
    arrow-down
    2
    ·
    edit-2
    26 days ago

    Definitely share your initial concern. Without strong review processes to ensure that every line of code follows the intent of the human developer, there’s no way of knowing what exactly is in there and the implications for the human users. And I’m not just talking about bugs.

    They say it’s reviewed, but the temptation to blindly trust is there. In this case, developer appears to have taken some care.

    The code was written by Cursor and Claude, but reviewed and heavily tested over 2-3 weeks by me. I created comparison documents, went through all queries multiple times and reviewed the logic over and over again. I also did load tests and manual regression tests, which took lots of evenings.

    Let us hope so. Handle with care to ensure responsibility is not offloaded to a machine instead of a person.

    • Jul (they/she)@piefed.blahaj.zone
      link
      fedilink
      English
      arrow-up
      6
      ·
      26 days ago

      Yeah, it could easily have added a couple of lines of code that sends everything to Northern Korean hackers because it found that in a bunch of repositories or just logging passwords to public logs or other things an experienced developer would never do. “AI” only replicates what it sees most often and as more spam and junk repos are added to its training data because “AI” companies are too concerned with profit to teach it properly, it could do tons of random stuff. It’s like training a developer by giving them random examples from the internet rather than specific ones. Of course they pick up bad habits. Even if it “works” it is almost never efficient or secure.

  • LiveLM@lemmy.zip
    link
    fedilink
    English
    arrow-up
    27
    arrow-down
    1
    ·
    26 days ago

    Look, if he wanted to introduce AI code, whatever, but doing it all at once in a 14k line change is crazy.

    Surely it would be better to introduce AI by letting it handle misc changes here and there instead of starting with the “biggest release ever done” (his words), no?

  • nfreak@lemmy.ml
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    1
    ·
    26 days ago

    Definitely time to find an alternative. What the actual fuck is this

  • poVoq@slrpnk.net
    link
    fedilink
    English
    arrow-up
    20
    ·
    26 days ago

    If you use ntfy mainly as a Unified Push distributor on Android, then I highly recommend switching to a XMPP client that can do the same.

  • shirro@aussie.zone
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    1
    ·
    25 days ago

    I can see the pragmatic appeal. Maintaining a lot of code for an open source project is thankless. Go is designed for idiots like me so it makes sense that an llm should be able to emit code that mostly works. There are classes of errors that are less likely in Go and the compiler and linting will prevent some foot guns and then it would have been tested.

    Ethically I hate anything to do with the llm industry and all it represents. I hate the environmental impacts. The social impacts. The disregard for intellectual property. The devaluing of human effort. The scam economics. I won’t use anything touched by it on principle and if that means walking away from a dead Internet so be it. There is enough pre-2020s books, audiobooks, movies, music and code to keep me interested for the rest of my life.

  • Kevin@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    ·
    26 days ago

    I just set up a ntfy server for Unified Push earlier this week to use with Matrix. Now I have to turn around and immediately replace it…

    • lambalicious@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      2
      ·
      26 days ago

      You could, in the meantime, simply not upgrade to the version that uses AI.

      Since, from what I’m seeing around, people are having issues looking for an alternative.