Jensen Huang says kids shouldn’t learn to code — they should leave it up to AI.::At the recent World Government Summit in Dubai, Nvidia CEO Jensen Huang made a counterintuitive break with tech leader wisdom by saying that programming is no longer a vital skill due to the AI revolution.
Indeed. I’ve been watching a number of evaluations of different LLMs, where people give it a set of problems and then evaluate the results. The number of times I’ve seen “Well it got that wrong, but if we let it re-evaluate it, it gets it right”. If that’s the case, the model is useless. You have to know the right answer before you can ask the model for an answer because the answer you’ll get can’t be trusted.
Might as well flip a coin.
Yeah. I was tasked with evaluating LLMs for software dev at my company last year. Tried a few solutions and tools, and various workflows from just using it as a crutch to basically instructing the LLM to make the application. The former was rarely necessary (but sometimes helpful) and the latter was ridiculously cumbersome.
You need to be specific, and leave no room for interpretation, because the moment you do the latter it’ll start making stuff up that doesn’t necessarily fit in with the spec, and while you can correct that, that’s tedious in and of itself, and once it’s already had the idea it’ll often have a hard time letting go of it.
I also had several cases where it outright ignored provided context. That was even more frustrating because then it made assumptions that I’d already proven to be false.
The best use cases I got from it was
Essentially, it was a great helper, but a horrendous developer. Felt more like I was tutoring it than anything else.
I haven’t seen anyone mention rubberducking or documentation or understanding code as use cases for AI before, but those are truly useful and meaningful advantages. Thanks for bringing that to my attention :)
There are definitely ways in which LLMs and imaging models are useful. Hell I’ve been playing around with vocal synthesis for years, SynthV’s AI models are amazing, so even for music there’s use cases. The problem is big corporations just fucking it up. Rampant theft, no compensation for the original creators, and then they’re sitting on the models like dragons. OpenAI needs to rename themselves, preferably years ago, because there’s nothing open about them.
The way I see it, the way SynthV (and VOCALOID prior to that) works is great; you hire a vocalist with the express purpose of making a model out of their voice. They know what they’re getting into, and are getting compensated for it. Then there are licenses and such on these models. In some cases, like those produced by Eclipsed Sounds, anyone that uses a model to create a song gets decently free reign. In others, like the Bushiroad models, you are fairly restricted in what you can do with them.
Meaning the original artist has a say. It’s why some models, like Cangqiong, will never get AI updates; the voice provider’s wishes matter.
Using computer generated stuff as a crutch in the creation process is perfectly fine I feel, but outright trying to replace humans with “AI” is a ridiculous notion.