• funkless_eck@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    ·
    3 months ago

    Georgia Power put out an ad recently claiming data centers help the economy.

    Motherfucker read the room. Everyone’s aware the “economy” has no bearing on the actual lived experience of the economy.

  • melfie@lemmy.zip
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    1
    ·
    3 months ago

    I do find value in LLMs as a tool for specific uses, but no way I’m paying through the nose for an expensive subscription to support greedy, shithead tech bros plundering the world for profit and government agencies using the tech to spy on everyone.

    Open weight models running on consumer hardware are getting pretty good, though. After learning some tricks from the Codacus YouTube channel, I’m running the Qwen 3.6 MoE model on my 4060 gaming laptop with 200k context and usable performance for about the same electricity cost as playing a game. Open source agents like OpenCode are also getting really good. I’m using the beta desktop version of OpenCode and it’s pretty close in capability and UX to the Claude agent I am forced to use at work.

    There are still some rough edges and performance issues, but the local LLM scene is already quite decent and is rapidly evolving. Qwen 3.7 open weight models are supposed to be released soon and I’m also looking for things like TurboQuant, speculative prefill (PFlash), etc. to mature and smooth the rough edges.

    • boonhet@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 months ago

      You can use Claude code with your own LLM too. It seems to be better at automatically creating memories and stuff. Downside is of course that it’s closed source.

      Codex is also open source and usable with your own LLMS. Same for Mistral Vibe but that’s been much less useful for me, opencode with their free or Go plan models is much better. Opencode Go with Deepseek Flash gets you so much usage it’s hard to run ouy at 10 bucks a month