The developers are literally on the bleeding edge here, it might be the most developed of the AI use cases right now. The most advanced tooling for LLMs revolves around SWE work, there are multiple prolific benchmarks that the labs are actively targeting in this area, and new ones are being built, whole product categories being spawned, software companies bleeding money for tokens.
It's the other professions that are to follow once the training data is in place to go reach for their livelihoods. SWEs got the early taste of what is coming. And the blender news is exactly that.
Average is only a tombstone of someone having failed to do better. And settling for average means pulling down.
When it comes to bs dashboard where "average is all you need", maybe the "better than average" result would be asking yourself if it's even worth doing in the first place?
Probably the same way other models learned to surpass human ability while being bootstrapped from human-level data - using reinforcement learning.
The question is, do we have good enough feedback loops for that, and if not, are we going to find them? I would bet they will be found for a lot of use cases.
I am vibe-porting an old game, Knights & Merchants(actually its Delphi rewrite - KAM Remake) to WASM. It's going well, I even have multiplayer working, will release it publicly at some point.
Learned more about WASM, OPFS, JSPI and other exotic browser stuff more than ever, also learned more about pascal than I ever wanted to, but it's been immensely fun.
Not having a code review process is archaic engineering practice at this point(at any point in history, really), be it for human written or AI written code.
Perhaps the problem is that you RL on one patch a time, failing to capture the overarching long term theme, an architecture change being introduced gradually over many months, that exists in the maintainer’s mental model but not really explicitly in diffs.
It doesn't matter, neither of those scenarios makes the effort impressive in this case. The vibe coded thing might even be useful - that does not make it impressive though. Effort does.
This is what I think a lot of the people who advocate for 'AI generated images being art' don't get. There's no effort or intentionality into what's being created; it has the look and appearance of 'polished art' (that breaks down when you look closer) but behind it is nothing.
It's also why AI generated code is a nightmare to read and deal with, because the intention behind the code does not exist. Code outputting malformed input because it was a requirement two years ago, a developer throwing in a quick hack to fix a problem, these are things you can divine and figure out from everything else.
> The vibe coded thing might even be useful - that does not make it impressive though.
Then "impressive" shouldn't even be the benchmark. If someone gifted me $10K, I'm not going to care if they earned it in a competition or won it in a lottery. Value is value. I'm gratefully accepting it and not being snobby about it. I couldn't care less about how "impressive" anything is if it's useful to me.
reply