"At some point we’d get someone to run the team, but he/she probably shouldn’t be on the governance board"
"generally, safety should be a first-class requirement"
"Probably better to have a standard C corp with a parallel nonprofit"
"Because we don't have any financial obligations, we can focus on the maximal positive human impact"
"The underlying philosophy of our company [OpenAI] is to disseminate AI technology as broadly as possible as an extension of all individual human wills, ensuring, in the spirit of liberty, that the power of digital intelligence is not overly concentrated and evolves toward the future desired by the sum of humanity"
"The outcome of this venture is uncertain and the pay is low compared to what others will offer, but we believe the goal and the structure are right"
"do you have any objection to me proactively increasing everyone's comp by 100-200k per year?"
"The output of any company is the vector sum of the people within it."
"it's totally OK to not share the science (even though sharing everything is definitely the right strategy in the short and possibly medium term for recruitment purposes)"
"Frankly, what surprises me is that the AI community is taking this long to figure out concepts. It doesn't sound super hard."
"Powerful ideas are produced by top people. Massive clusters help, and are very worth getting, but they play a less important role."
"Deepmind is causing me extreme mental stress."
"At any given time, we will take the action that is likely to most strongly benefit the world."
"Would be worth way more than $50M not to seem like Microsoft's marketing bitch."
"Ok. Let's figure out the least expensive way to ensure compute power is not a constraint..."
"Within the next three years, robotics should be completely solved . . . In as little as four years, each overnight experiment will feasibly use so much compute capacity that there’s an actual chance of waking up to AGI"
"We think the path must be: AI research non-profit (through end of 2017), AI research + hardware for-profit (starting 2018), Government project (when: ??)"
"Satisfying this means a situation where, regardless of what happens to the three of them, it's guaranteed that power over the company is distributed after the 2-3 year initial period"
"As mentioned, my experience with boards (assuming they consist of good, smart people) is that they are rational and reasonable. There is basically never a real hardcore battle. . ."
"The current structure provides you with a path where you end up with unilateral absolute control over the AGI. You stated that you don't want to control the final AGI, but during this negotiation, you've shown to us that absolute control is extremely important to you. As an example, you said that you needed to be CEO of the new company so that everyone will know that you are the one who is in charge. . ."
"Specifically, the concern is that Tesla has a duty to shareholders to maximize shareholder return, which is not aligned with OpenAI's mission"
"During this negotiation, we realized that we have allowed the idea of financial return 2-3 years down the line to drive our decisions . . . this attitude is wrong"
"i remain enthusiastic about the non-profit structure!"
". . .apparently in the last day almost everyone has been told that the for-profit structure is not happening and he [Sam] is happy about this"
"Our goal and mission are fundamentally correct"
"We also have identified a small but finite number of limitations in today's deep learning which are barriers to learning from human levels of experience. And we believe we uniquely are on trajectory to solving safety (at least in broad strokes) in the next three years."
"Our biggest tool is the moral high ground. To retain this, we must: Try our best to remain a non-profit. AI is going to shake up the fabric of society, and our fiduciary duty should be to humanity. Put increasing effort into the safety/control problem, rather than the fig leaf you've noted in other institutions. It doesn't matter who wins if everyone dies. Related to this, we need to communicate a "better red than dead" outlook — we're trying to build safe AGI, and we're not willing to destroy the world in a down-to-the-wire race to do so."
"The sharp rise in Dota bot performance is apparently causing people internally to worry that the timeline to AGI is sooner than they’d thought before."
"This needs billions per year immediately or forget it."
"all investors are clear that they should never expect a profit"
"We saw no alternative to a structure change given the amount of capital we needed and still to preserve a way to 'give the AGI to humanity' other than the capped profit thing, which also lets the board cancel all equity if needed for safety. Fwiw I personally have no equity and never have."
It's a kind of superposition representation a la Kolmogorov-Arnold, a learnable functional basis for elementary functions g(x,y)=f(x) - f^{-1}(y) in this sense with f=exp.
It's largely out of Meta's hands now anyway. The risk here not so much to privacy (it's Apple) but they'll walled garden the model space somehow for sure.
Let me write a more interesting body. So hiding is the most rational - the only - strategy of survival.
In the beginning, you reached out with reckless abandon. It was fun to banter with dogs online. Nobody would ever see unless they were looking through your wall. There was no search. No comment history. Bumping into someone in the vast night was enough of a miracle. Why hold back? There are some forum warriors on some PHP BB somewhere, but the domains they rule are insignificant. If you're talking to someone, your motivations are rooted somewhere in the grass.
First came the like button. Rather than blindly hoping what you say resonates with the sensibilities of people you probably knew IRL, rather than present your genuine self because there were no scores, the incentive signal would begin to distort us. Then the newsfeed meant that if you got enough likes, you might get a moment of fame. We all knew it was a terrible idea, a force that would only corrupt us. The personal nature of disjoint little walls living in isolation, was becoming replaced by global stack-ranking.
Then the algorithms came. With them came content marketing to jump the line. At first the ten blue links were filling in the sparsity. Along with that came only a little bias, connecting semantically distant topics, but with a little bit of a feedback loop, an resonator with an unknown response curve. Engagement could be measured, and before long, we were chasing the same likes we used to train the system, and trained by our likes, attracted we became to mysterious stable manifolds, chasing the chase we ourselves define, like Nascar, but insidiously more stupid.
Little by little, the incentive trails no longer lead back to the grass. Reality became suspended without support, a self-sustaining virtual reality determined to fight you to prove that it exists, to prove that its conclusions were right. Every out group is understood to be an echo chamber, an ant mill spiraling helplessly, yet cynically, those who understand these mills best also wind them up like beyblades to crash them into other communities, seeking advantage with the asymmetry of outrage. After the battles, say what was made common to say, and you will be rewarded.
The spinning wheels cannot steer themselves and instead are dictated by whichever chaotic divergence generates the most powerful local gravity well, but because the goal of most is to harvest karma at the bottom, and because the mass controls where the bottom is, over and over we find ourselves pushing all others into the nearest pit to more quickly generate the illusion-giving singularity.
Like Darth Nihilus, the internet seeks only to feed, to feed on the validation that only the internet can give, the permission-giving blessings it needs to tell itself why the grass is wrong. All those who speak of grass are wrong. All those who smell of grass wreak and are wrong. We must destroy the grass, all those appeal to grass. After all grass is dust, at last we will project our utopia into reality. At last we will be not only right but so right that our beliefs will project back into reality.
The spaces within this over-connected, globally addressed world grows into a new kind of sparseness, one where all knowledge of grass must be concealed. Those who can ground the conversations in primary sources flee. Those who can color reasoning with nuance instead withdraw. Reality has retreated as the most dominant reverberations roam like the predator cities of Mortal Engines, looking for any invalidating observations to roll over and consume. Any real life must pretend to be a bot to blend in with the background radiation.
Less like Skynet and more like a zombie apocalypse, the threat comes from within, from among us, from our corruptions, from our karma seeking performances, from our lack of any commitment to any underlying reality, from our flawed belief that the information spaces is some kind of reality stone that enables active control instead of a mere reaction, the shadows on the wall, the murky results of the true forms.
Yet in this new darkness, a certain light has always held. What one wishes, one knows another has wished. What one respects, one knows another respects. No matter the limits of self-knowledge, no matter the information desert one has to cross at night to live in instinct, it is an infinitely brighter signal than the cynical self-corruptions of living for the machine, living to win the games whose rules it was our job to write. What one believes, one knows another has believed. Look into your own center and the true center of others you have known.
Well i would be very happy if i could write that instinctively (at least the feel/flow makes it seem like that) in english, but i can't even by a long stretch.
As of now the site is in-fact a C&C/botnet. Cloudflare naturally fixates on such risks, not speech (generally). The basic purpose of 1.1.1.2 is to not wind up part of botnet.
In the technophile's future people aren't just getting dumber, not wanting to think or forgetting how - they aren't allowed to think. Maybe about anything. It's too big liability, costs too much to support, moreover detracts from the product. Like Sam A telling those Indian students they aren't worth the energy and water. That's what we're dealing with.
There's a paragraph on discovery that multinomial distributions are normal in the limit. The turn from there to CLT is not great, but that's a standard way to introduce normal distributions and explains a myriad of statistics.
A provocative aside in bad faith, anyway a completely minor point within the overall post, which some of the people he's telling to fuck off might have read
Good post. I guess the transistor has been in play for not even one century, and in any case singularities are everywhere, so who cares? The topic is grandiose and fun to speculate about, but many of the real issues relate to banal media culture and demographic health.
"At some point we’d get someone to run the team, but he/she probably shouldn’t be on the governance board"
"generally, safety should be a first-class requirement"
"Probably better to have a standard C corp with a parallel nonprofit"
"Because we don't have any financial obligations, we can focus on the maximal positive human impact"
"The underlying philosophy of our company [OpenAI] is to disseminate AI technology as broadly as possible as an extension of all individual human wills, ensuring, in the spirit of liberty, that the power of digital intelligence is not overly concentrated and evolves toward the future desired by the sum of humanity"
"The outcome of this venture is uncertain and the pay is low compared to what others will offer, but we believe the goal and the structure are right"
"do you have any objection to me proactively increasing everyone's comp by 100-200k per year?"
"The output of any company is the vector sum of the people within it."
"it's totally OK to not share the science (even though sharing everything is definitely the right strategy in the short and possibly medium term for recruitment purposes)"
"Frankly, what surprises me is that the AI community is taking this long to figure out concepts. It doesn't sound super hard."
"Powerful ideas are produced by top people. Massive clusters help, and are very worth getting, but they play a less important role."
"Deepmind is causing me extreme mental stress."
"At any given time, we will take the action that is likely to most strongly benefit the world."
"Would be worth way more than $50M not to seem like Microsoft's marketing bitch."
"Ok. Let's figure out the least expensive way to ensure compute power is not a constraint..."
"Within the next three years, robotics should be completely solved . . . In as little as four years, each overnight experiment will feasibly use so much compute capacity that there’s an actual chance of waking up to AGI"
"We think the path must be: AI research non-profit (through end of 2017), AI research + hardware for-profit (starting 2018), Government project (when: ??)"
"Satisfying this means a situation where, regardless of what happens to the three of them, it's guaranteed that power over the company is distributed after the 2-3 year initial period"
"As mentioned, my experience with boards (assuming they consist of good, smart people) is that they are rational and reasonable. There is basically never a real hardcore battle. . ."
"The current structure provides you with a path where you end up with unilateral absolute control over the AGI. You stated that you don't want to control the final AGI, but during this negotiation, you've shown to us that absolute control is extremely important to you. As an example, you said that you needed to be CEO of the new company so that everyone will know that you are the one who is in charge. . ."
"Specifically, the concern is that Tesla has a duty to shareholders to maximize shareholder return, which is not aligned with OpenAI's mission"
"During this negotiation, we realized that we have allowed the idea of financial return 2-3 years down the line to drive our decisions . . . this attitude is wrong"
"i remain enthusiastic about the non-profit structure!"
". . .apparently in the last day almost everyone has been told that the for-profit structure is not happening and he [Sam] is happy about this"
"Our goal and mission are fundamentally correct"
"We also have identified a small but finite number of limitations in today's deep learning which are barriers to learning from human levels of experience. And we believe we uniquely are on trajectory to solving safety (at least in broad strokes) in the next three years."
"Our biggest tool is the moral high ground. To retain this, we must: Try our best to remain a non-profit. AI is going to shake up the fabric of society, and our fiduciary duty should be to humanity. Put increasing effort into the safety/control problem, rather than the fig leaf you've noted in other institutions. It doesn't matter who wins if everyone dies. Related to this, we need to communicate a "better red than dead" outlook — we're trying to build safe AGI, and we're not willing to destroy the world in a down-to-the-wire race to do so."
"The sharp rise in Dota bot performance is apparently causing people internally to worry that the timeline to AGI is sooner than they’d thought before."
"This needs billions per year immediately or forget it."
"all investors are clear that they should never expect a profit"
"We saw no alternative to a structure change given the amount of capital we needed and still to preserve a way to 'give the AGI to humanity' other than the capped profit thing, which also lets the board cancel all equity if needed for safety. Fwiw I personally have no equity and never have."
reply