biggest thing i wish was present in more discussions about models is people providing more specifics on their setups vs. vague descriptions of harnesses
more future proof except for the fact that these guys are infamous for breaking changes
i really don't think after there's much interest from the larger community after multiple annoying RR breaking changes -> Remix -> Remix 2 -> React Router v7 -> now an entirely new framework.
have always wondered about this especially post Cambridge Analytica where Meta imposed really stringent requirements for API use even for personal things while it was blatantly obvious that internally it was a different story
But thats the thing internally it wasn't. The user dat controls were really quite good.
Its not a mistake that this data got into contractor hands, it was a decision that took lots of time, numerous legal reviews and signoff from Zuck himself.
they are essentially Lyft in early Uber vs. Lyft days. They are marketing themselves vaguely as being "better" because they're "more ethical" but their actions make it clear that they're not much better than OAI.
Except Lyft didn't kick you out in the bad part of town simply because you mentioned the word lollipop. Claude will terminate your session, peg you to 100% usage, and more, to stop you from using the service you paid for.
so we're trusting the guy who created tech to make it easier for bots to exist on the internet to then sell us the solution to fix the problem he made worse?
I've seen this take a lot and I don't really understand it. IMO if there's anybody to blame here, and I don't think there is, you could go back and assign blame to the authors of the Attention is All You Need paper, or Google as its publisher.
Once that was out in the wild it was only a matter of time before someone productized it, but there was no conceivable world in which nobody decided to, and there was no guarantee that it was going to be public in all cases. The basis for LLMs is so simple in hindsight that it's not even impossible that it'd been independently discovered and privately weaponized for many years before 2017.
> Once that was out in the wild it was only a matter of time before someone productized it, but there was no conceivable world in which nobody decided to...
By this logic, we cannot blame anyone who is the agent of anything that we deem to be inevitable. Just because it is eventually going to happen, that means you are completely non-culpable for being the person who does it. This could obviously be extended into justifying pretty much anything.
Yeah but I think that's precisely what makes it fuzzier than a zero-sum blame game. Given that this technology was going to be in public hands no matter what, the how matters more than condemning the first visible target. Instead of ChatGPT, the first wide use of this tech could have been a private endeavor to secretly kill the internet. The fact that anyone can see and use it, and learn it's hallmarks, arguably helps innoculate some of the populace against the worst things it could be used for. We're able to sit around and complain that the discourse has been poisoned by robots instead of blindly wondering why otherwise-indistinguishable fellow humans are all saying "delve" suddenly.
I'm not sure I have a specific point here other than that I think it's interesting that he became a target, not necessarily that he's actually blameless.
Ironically, of the only thing he did create (ostensibly), a copycat never went anywhere "social network", its claim to fame was the app (preinstalled by paying carriers) spamming your entire contact book with SMS invitations to join their failing network. Splendid privacy record!
Trying to make money on selling the solution to the problem you caused (while also probably tracking literally everyone with the solution) is much worse than causing the problem and doing nothing about it.
when i realized that sama isn't that much of an ai researcher, it became clearer that this is more akin to a group delusion for hype purposes than a real possibility
He’s a glorified portfolio manager (questionable how good he actually is given the results vs Anthropic and how quickly they closed the valuation gap with far less money invested) + expert hype man to raise money for risky projects.
You can read the leaked emails from the Musk lawsuit.
At the very least, Ilya Sutskever genuinely believed it, even when they were just making a DOTA bot, and not for hype purposes.
I know he's been out of OpenAI for a while, but if his thinking trickled down into the company's culture, which given his role and how long he was there I would say seems likely, I don't think it's all hype.
Yes, all of the people involved live in a delusion bubble. Their economic and social existence depends, at this point, on making increasingly bombastic and eschatological claims about AGI. By the standards of normal human psychological function, these people are completely insane.
Definitely interesting to watch from the perspective of human psychology but there is no real content there and there never was.
The stuff around Mythos is almost identical to O1. Leaks to the media that AGI had probably been achieved. Anonymous sources from inside the company saying this is very important and talking about the LLM as if it was human. This has happened multiple times before.
If someone working on early computer networks thought they could scale up world wide and that soon everyone people would be launching trillion dollar companies on the internet you would have called that delusion right?
He doesn't need to be right but it's not crazy at all to look at super human performance in DOTA and think that could lead to super human performance at general human tasks in the long run
1) True believers
2) Hype
3) A way to wash blatant copyright infringement
True believers are scary and can be taken advantage of. I played DOTA from 2005 on and beating pros is not enough for AGI belief. I get that the learning is more indirect than a deterministic decision tree, but the scaling limitations and gaps in types of knowledge that are ingestible makes AGI a pipe dream for my lifetime.
reply