| ▲ | Greg Brockman interview [video](fs.blog) |
| 159 points by prakashqwerty 14 hours ago | 141 comments |
| |
|
| ▲ | bix6 8 hours ago | parent | next [-] |
| I just don’t understand why a non-profit was allowed to do this. Does this not set a precedent that non-profit doesn’t actually mean anything? You can just use a favorable structure until it’s time to enrich yourself. |
| |
| ▲ | granzymes 6 hours ago | parent | next [-] | | I think it would be helpful for you to clarify which part of the chain you found objectionable: - in 2015, OpenAI was founded as a Delaware nonprofit - in 2017, OpenAI discovered the scaling laws and realized they needed far more compute (and thus money) than they had initially anticipated - that discovery precipitated a series of negotiations between the founders on how to restructure OpenAI to raise more money for compute, ultimately resulting in Musk’s departure when the other founders would not give him control - in 2018, OpenAI attempted to dramatically increase its fundraising despite Elon ending his contributions, but raised only $50M of its $100M goal - in 2019, OpenAI created a capped-profit subsidiary in order to attract funding from commercial entities - the nonprofit hired an independent assessor to value its IP, and then transferred that IP to the for-profit for fair value (around $60 million in 2019) - the OpenAI nonprofit received a right to 100x capped return on its IP investment, or $6B, once the for-profit began making a profit. The nonprofit also received the right to the residual profit after all future investors reached their caps - in 2019, OpenAI’s capped-profit received $1B in investment from Microsoft. OpenAI later received $2B from Microsoft in 2021 and $10B in 2023 as compute scaling continued - Microsoft received a cap of 20x on its $1B investment, and 6x on its $2B and $10B investments, for a total of $92B target redemption - in 2025, OpenAI’s for-profit entity recapitalized from a capped-profit entity with residuals flowing to the nonprofit to a traditional public benefit corporation with traditional equity - in exchange for the residual (and 100x profit cap on the original $60M transfer) the nonprofit received a 26% equity stake in the for-profit. That stake is currently valued at around $200B All of the above is from the record in Musk v. Altman, thanks to which we now have all the details. The upshot for the nonprofit is that it transferred IP worth around $60M in 2019 for rights to $6B in future profit, and then ended up with $200B in equity after the recapitalization. I see a lot of people in this thread assuming that the nonprofit no longer exists, which is not true. | | |
| ▲ | dooglius 5 hours ago | parent | next [-] | | The objectional part would be: - in 2019, OpenAI created a capped-profit subsidiary in order to attract funding from commercial entities Particularly if it creates a conflict of interest for anyone making decisions on behalf of the nonprofit | | |
| ▲ | granzymes an hour ago | parent | next [-] | | I'm curious why you think that creating a for-profit subsidiary is objectionable, since it is extremely common for large nonprofits. A good example for this forum would be Mozilla, but many more were mentioned during the trial. Also curious what conflicts of interest you have in mind. | |
| ▲ | 93po 4 hours ago | parent | prev [-] | | worse than that is the $60 million sale price, which was comically and absurdly low. Elon himself said he was willing to buy it for significantly more than that and the fact that it wasn't able to go to the highest bidder just shows that it was bullshit | | |
| ▲ | tyre an hour ago | parent | next [-] | | Wait, no, not at all. A non-profit shouldn’t have to take the highest bidder regardless. The whole _point_ of a non-profit is to act beyond purely short-term financial gains. “Elon buying this doesn’t align with the mission” is a completely normal, reasonable, and healthy response for most non-profits. What’s great is that we don’t need to speculate about a counter factual. He did end up building a chatbot! Whose defining differentiating feature is revenge porn. | |
| ▲ | granzymes an hour ago | parent | prev [-] | | Elon's purchase offer was in 2025, after the success of ChatGPT showed that OpenAI's IP (much if not most of it developed after 2019) could be commercially valuable. I think it is also debatable whether Elon's purchase offer was in good faith. It was not clear in 2019 that OpenAI's IP would ultimately be worth billions. That was well before the current AI boom. |
|
| |
| ▲ | bix6 5 hours ago | parent | prev | next [-] | | The whole process has been a circus but I found the AG waiver rather frustrating. Nothing like negotiating with a charity to get an IOU that it’ll be charitable. https://oag.ca.gov/news/press-releases/attorney-general-bont... | |
| ▲ | beering 6 hours ago | parent | prev [-] | | The OpenAI non-profit is now one of the biggest non-profits in dollar-denominated assets. If the goal was to make the non-profit really big and well-funded then that seems on track. But not clear to me what it would do to advance its mission. |
| |
| ▲ | pluc 8 hours ago | parent | prev | next [-] | | There's a lot of things these days that you can't do that are being done. | | | |
| ▲ | tim333 7 hours ago | parent | prev | next [-] | | Non profits have always been able to have for profit subsidiaries, owned by the non profit. | | |
| ▲ | wrsh07 5 hours ago | parent [-] | | IKEA is a famous example, although they sequenced things in a way many commenters here would probably be fine with https://en.wikipedia.org/wiki/IKEA_Foundation | | |
| ▲ | throwup238 5 minutes ago | parent [-] | | Other examples include Mozilla Foundation and Mozilla Corporation, the latter of which pays taxes on the money it gets from Google for default search engine placement, and the Smithsonian gift shop, which is a common pattern for museums all over the country. Novo Nordisk is another example, maker of Ozempic, and it’s the richest foundation in the world because it spun off a for-profit that then went public. IRS requires nonprofits to pay taxes on “unrelated business income” and spinning it off to a for-profit subsidiary is the least risky way of managing that revenue. |
|
| |
| ▲ | siliconc0w 8 hours ago | parent | prev | next [-] | | Most startups don't actually make profits and nonprofits can't give equity so it's not really a favorable structure. | | |
| ▲ | Gud 7 hours ago | parent [-] | | It’s a favourable structure in many cases. Not everything is a business. OpenAI wasn’t, until it was. |
| |
| ▲ | rvz 8 hours ago | parent | prev | next [-] | | This case was the first of its kind and it was never tested if OpenAI breached their charitable mission and the case was dismissed due to the statute of limitations. Other than researchers, nobody from big tech would ever see themselves wanting to work at a charity / non-profit. The moment the VCs came into the picture then all the grifters poured in and AGI meant IPO. > You can just use a favorable structure until it’s time to enrich yourself. Maybe that diary was made out of teflon. | | |
| ▲ | p1esk 4 hours ago | parent [-] | | Other than researchers Are you saying researchers are less interested in quality of life than other people? If this was true, frontier labs wouldn’t need to offer 7 digit compensation packages to their researchers. |
| |
| ▲ | pessimizer 8 hours ago | parent | prev | next [-] | | Nonprofit doesn't mean anything, since people can just route the profits into salaries. It's just another legacy regulation that may have once once had a societally-constructive purpose that wealthy people just use as one of the array of financial tools to help implement their latest scams. IMO, here are no legitimate nonprofits. Western countries have been utterly strangled by nonprofits. Governments fund them with tax money in order to lobby themselves for legislation that financially benefits individuals in government and their donors. Obama even expanded the rules in the US to allow the government to unconstitutionally fund religious groups to accomplish functions that belong in government. They should all be either reformed so that their internal bylaws and compensation are strictly regulated or probably preferably, they should simply be destroyed. If you only pay taxes on your profits (and we get rid of legal vehicles to hide profits) and your employees are obligated to pay taxes on their incomes, there's no need for a nonprofit status. If nonprofits want to engage in business (religions included), let them pay taxes. If they engage in charity, they won't have anything to tax. | | |
| ▲ | gottorf 8 hours ago | parent | next [-] | | > Western countries have been utterly strangled by nonprofits To expand, there are two major problems with nonprofits in Western nations these days: 1. Governments use them as a way to do things that they themselves are not allowed to do ("it's private charities that do this!", ignoring the fact that the charities get >90% of their revenue from government grants) 2. Like you mentioned, the government grants to nonprofit back to politicians' campaign funds pipeline. Utterly egregious. > Obama even expanded the rules in the US to allow the government to unconstitutionally fund religious groups to accomplish functions that belong in government I wasn't aware of this being a big concern; more the other way around, like in my point 1. | |
| ▲ | bickfordb 7 hours ago | parent | prev [-] | | One reform I would make would be to limit tax breaks to actual charitable activity within an organization, instead of a blanket tax break to the whole organization. For example if a Church/Hospital runs a soup kitchen and homeless shelter, those resources should be tax free, but maybe the rest of their activities shouldn't be by default. Another reform I would make would be around independent governance and removing donor control of charities to reduce the number of sham Rich Guy foundations. | | |
| ▲ | tyre an hour ago | parent [-] | | > Another reform I would make would be around independent governance and removing donor control of charities to reduce the number of sham Rich Guy foundations. This one is tough. I mean, look at the Clinton Foundation. One reason to believe that $1 there is more effective than somewhere else is _because_ the Clinton’s are closely involved. Of course, you get massive donations there because people want to influence the Clintons and/or _through_ the Clintons. Would those people / states donate otherwise? Would they donate to _better_ organizations? Maybe! Maybe not! * Also I’m not saying the Clinton Foundation is more/less effective. You’re almost certainly better donating to GiveDirectly, but it’s not on its face ridiculous to think that they, specifically, could effect a _different_ type of change than others would have access to/influence over. |
|
| |
| ▲ | outside1234 7 hours ago | parent | prev [-] | | It should not surprise you to learn that Greg Brockman is a Trumper and major donor. It should also not surprise you that the Epstein files have not been released. Everything is possible and not possible in a corrupted system. | | |
| ▲ | NDlurker 6 hours ago | parent [-] | | He's from North Dakota, just like Doug Burgum. Lot of Trump cultists in ND |
|
|
|
| ▲ | throwaway_2494 10 hours ago | parent | prev | next [-] |
| I remember when computer magazines were aimed at programmers and had code listings in them. Then there seemed to come a time when all they talked about was the IBM vs. Microsoft lawsuit. From then on they must have felt that they had discovered a formula, because all they ever yapped about after was insider baseball of computer companies. I find this sort of corp. vs. corp. coverage boring, sort of like techie reality TV. Who will be voted out tonight, Debra, or Deborah...? |
| |
| ▲ | paradox460 8 hours ago | parent | next [-] | | I remember when wired changed editors. After Chris Anderson left it became "gq but we talk about iPhones" | |
| ▲ | cmrdporcupine 8 hours ago | parent | prev [-] | | I dunno man, there are two "tech" industry worlds and the one you and I -- hacker types -- think of as "tech" is not what the rest of the world means. They mean the other one, which has almost nothing to do with the actual technology and instead everything to do with the absolutely apeshit amount of money, power, influence and intrigue that the technology enabled. This was a very large apeshit $$ amount back in IBM vs Microsoft but the scale of it now in the era of e.g. OpenAI etc is beyond imagination. There's a whole generation of people whose association with the engineering/technology side of things only happened because of their interest in the other side of things. I too miss old Byte magazine days. | | |
| ▲ | ethbr1 7 hours ago | parent [-] | | This happened when business types realized technology could be enormously profitable (~PC era). Then inevitably, tech news turned into business news. | | |
| ▲ | myst an hour ago | parent [-] | | What do you get if you drop a teaspoon of business into a barrel of X? A barrel of business. |
|
|
|
|
| ▲ | H8crilA 12 hours ago | parent | prev | next [-] |
| As far as Brockman account of the past goes, there's also his personal diary which was made public as a part of that lawsuit by Musk. Includes for example the line: "Financially what will take me to $1B?". BTW, if you don't know, Musk lost it because he filed too late, lol. |
| |
| ▲ | nba456_ 11 hours ago | parent [-] | | If his entire personal diary got exposed and that's the worst that's in it, good for him. | | |
| ▲ | tcp_handshaker 9 hours ago | parent | next [-] | | What about stealing 12 million books of copyrighted human culture, at massive scale, and then enclosing the value created inside proprietary, investor-backed systems? Something wrong with that? What happens if you go tomorrow, downtown San Francisco, and leave a bookstore with one book without paying? "Behind every great fortune there is a crime"
- Honoré de Balzac
| | |
| ▲ | tasuki 5 hours ago | parent | next [-] | | > What about stealing 12 million books Who's missing the books? 12 million books is a rather large warehouse! I thought HN was in the "information wants to be free" camp... | |
| ▲ | ralph84 5 hours ago | parent | prev | next [-] | | > enclosing the value created inside proprietary, investor-backed systems What do you think copyright does. Human culture is owned by humanity, not Disney or the New York Times. | |
| ▲ | spudlyo 41 minutes ago | parent | prev | next [-] | | Won't somebody please think of the copyright holders!? | |
| ▲ | temp8830 7 hours ago | parent | prev [-] | | Even though the founders of OpenAI are not exactly someone you'd root for, comparisons to theft are silly. By that token it would be illegal to go into a library, read a book, and actually remember what was in it. Except in this case the reader is a robot. LLMs are such a fundamentally different thing that existing laws don't really make sense. Wait! Put the pitchfork down! I know, I know, stealing is stealing, and OpenAI founders are slimy. But what about derivative works? Why is a human making a hip-hop track allowed to sample, and a robot is not? Again, LLMs are such a fundamentally different thing that existing laws don't really make sense. It's actually surprising in retrospect that nobody did this sooner. Even back in the 80s books about computers would gush about how a computer has enough memory to store an entire library's worth of books. It's just that someone finally figured out how to put an index on it. Where I agree: given that this is basically the sum of all humanity's knowledge, the company should have been a non-profit. It was a non-profit. And then greed won. |
| |
| ▲ | Kinrany 11 hours ago | parent | prev | next [-] | | How did the diary end up in the court files in the first place? | | | |
| ▲ | applfanboysbgon 11 hours ago | parent | prev | next [-] | | I'm curious what you're writing in your diary that's worse than blatantly admitting to fraud of this scale. He publicly misled people about OpenAI's "mission" as a nonprofit, while seeking to enrich himself to the tune of $1 billion(!!!) dollars. Also, his entire diary was not in fact made public. The attorneys only quoted the parts that were relevant to the case, which pertained to OpenAI's transition from non-profit. | | |
| ▲ | siva7 10 hours ago | parent [-] | | How about wiping out an entire civilization? Not even necessary to hide this thought in your diary if you have enough power. I've seen today - in fact any day of this year - much worse things than his diary thoughts. | | |
| ▲ | creato 4 hours ago | parent | next [-] | | Even if you think this this is what OpenAI is doing, they surely don't think that. So why would he write that in his diary? | |
| ▲ | applfanboysbgon 9 hours ago | parent | prev [-] | | Well, gee. When you put it like that, Hitler existed, so really we can't fault anybody for anything short of orchestrating the genocide of 12 million people. | | |
|
| |
| ▲ | _zoltan_ 10 hours ago | parent | prev [-] | | Worse? There is nothing wrong with wanting 1B. Anybody who said they wouldn't want it is lying. | | |
| ▲ | jesterson 10 hours ago | parent | next [-] | | I wouldn’t want. I have enough. Not everyone is wanting money. But it is not the point. The point is, when you take high moral ground and talk about bug problems to help humanity, and then your own diary exposes you as avaricious simpleton, the whole high moral ground crumbles. And you expose yourself as another grifter. That’s what happened to Brockman. Although smart people could see these qualities in altman, brockman etcetera way before that happened | | |
| ▲ | rvz 8 hours ago | parent [-] | | > The point is, when you take high moral ground and talk about bug problems to help humanity, and then your own diary exposes you as avaricious simpleton, the whole high moral ground crumbles. And you expose yourself as another grifter. Unfortunately, this is now 90% of this space and it is now full of grifters which was not the case in 2010. In the case of OpenAI, there were less grifters and they were dormant in 2016 and many were exposed in 2023 when Sam was fired and rehired afterwards and most of them infiltrated the company after 2023. In 10 years time, after this upcoming financial crash, you will hear some of the former-employees after 2023 admitting that they were part of the grift and were never interested in AI in the first place. "OpenAI was nothing without its people" except only if it meant getting a mansion or a yacht for the benefit of h̶u̶m̶a̶n̶i̶t̶y̶ themselves. |
| |
| ▲ | exfalso 10 hours ago | parent | prev | next [-] | | Nonsense. What the hell would you do with 1B? Give it to charities maybe. Maybe set up an investment where dividends are paid to charity. Running out of ideas | | |
| ▲ | _zoltan_ 2 hours ago | parent | next [-] | | Set up a nice investment vehicle with maybe 400m so I can get 1.6m in dividends a year which would be better enough to comfortably travel the world, have a private chef, someone who organized travel so I don't have to.. A nice 12 person yacht on the Mediterranean is 400k eur for 2 weeks (with staff) so I'd realize it's not enough and invest the rest so I could get comfy. Along the way help friends and family, pay off mortgages, usually good stuff. It's not that hard to spend 4% a year of that. | |
| ▲ | fnord77 9 hours ago | parent | prev | next [-] | | I'd finally feel financially secure | | |
| ▲ | rvz 8 hours ago | parent [-] | | Really? If anything less than $1B isn't enough then it is never enough. $1B is the new $100M thanks to ongoing currency debasement. Also, there is something called "taxes" which is what makes anyone who has millions or billions to want even more money and the IRS will still come after you anywhere in the world. Otherwise they have to renounce their citizenship and move to a tax haven. | | |
| ▲ | _zoltan_ 2 hours ago | parent [-] | | I'm not in the US, so I don't care about the IRS. Tax wise at this level there are very tax efficient vehicles available. |
|
| |
| ▲ | jesterson 10 hours ago | parent | prev | next [-] | | There are a lot of greedy people thinking everyone would die for a bullion. They couldn’t comprehend another way of thinking due to narrow mindset | |
| ▲ | fragmede 10 hours ago | parent | prev [-] | | You've run out of ideas already? Try harder!
What charities? Why? How much, to which ones? How involved with those charities are you going to be? What dent in history are you going to make with that billion? With or without your name attached. Build housing, cure cancer, feed the hungry, buy this simulator https://www.1940airterminal.org/news/liquidation-of-simulato... | | |
| ▲ | codechicago277 8 hours ago | parent | next [-] | | Completely missing the other costs associated with any of these things. If money was enough to “feed the hungry” Musk or Gates would have already done it. The real problem is systemic injustice, like governments stealing foreign aid that’s meant to go to the poor. Money can’t always solve these. Time is more valuable than money and unless you have tons of time and space that simulator is just an expensive paperweight. | |
| ▲ | exfalso 4 hours ago | parent | prev | next [-] | | My point was that there isn't anything I could do with that money, and neither can the vast majority of people in the world. So I would immediately try to pass it on to people who have better use for it Wishing for 1B is completely nonsensical if you understand what kind of money that is. | |
| ▲ | Angostura 9 hours ago | parent | prev | next [-] | | Perhaps the commenter would just like to lead a contented life without having to bother with all of that | |
| ▲ | gizajob 10 hours ago | parent | prev [-] | | Didn’t even buy a Yacht or a Warhol yet. |
|
| |
| ▲ | sumeno 8 hours ago | parent | prev | next [-] | | I would be a billionaire for about 5 minutes because I'd spend 95% of it making the lives of others better and still have enough left over that neither me nor any of my immediate family ever has to work again instead of hoarding it like the monsters who end up actually having a billion dollars. | | |
| ▲ | tasuki 5 hours ago | parent [-] | | What is the point of your comment? It is hard for me to read it in another way than "I am very virtuous", which might be true (well done you!) but usually isn't a thing people post about themselves in a discussion forum... | | |
| ▲ | sumeno 3 hours ago | parent [-] | | It's a direct response to the person I was replying to, that's how posts work. | | |
| ▲ | tasuki 3 hours ago | parent [-] | | The person you were replying to said: > There is nothing wrong with wanting 1B. Anybody who said they wouldn't want it is lying. You said: > I'd spend 95% of it making the lives of others better Again, well done you. And... I don't think that's a counter example? Being this virtuous, wouldn't you love to give away a billion? Wouldn't you enjoy it very much? You could write comments about it and people would upvote you! | | |
| ▲ | sumeno 2 hours ago | parent [-] | | I do not want a billion dollars, there is no ethical way to get a billion dollars. If I accidentally had a billion dollars I would get rid of the billion dollars as quickly as possible. The op thinks that I, as well as most of the other responses to them, are liars |
|
|
|
| |
| ▲ | rozap 7 hours ago | parent | prev | next [-] | | Every billionaire is a policy failure. It's not a question of equity, the issue is that no one human should be that powerful. It's very obvious that its leading to the US's rather quick and colorful decline. A small cohort of very powerful people are moving elections and policy to enrich themselves, everyone else be damned. | | |
| ▲ | ToValueFunfetti 7 hours ago | parent [-] | | Even assuming all of this is true, nothing you've said means it's wrong to want a billion dollars. As described, your issue is with the system that makes it possible to get it. |
| |
| ▲ | nativeit 8 hours ago | parent | prev [-] | | That level of personal wealth is inherently immoral and doesn’t *ever* happen without exploitation. |
|
|
|
|
| ▲ | YetAnotherNick 11 hours ago | parent | prev | next [-] |
| Why can't someone ask what happened in Ilya's mind. Firing Sam and then signing the solidarity letter of Sam to leave OpenAI if was fired. Other than that, all other information seems kind of just going over the surface. |
| |
| ▲ | tasuki 5 hours ago | parent [-] | | Yes, that, please! I also never understood why the board resigned after ousting Sam... | | |
| ▲ | tyre an hour ago | parent [-] | | Because they lost and crumbled. They were unbelievably outmatched by Sam (a world-class manipulator) and Satya (the money behind OpenAI and himself a political genius.) They were outmaneuvered, panicked, and folded. Did they have to? No. But in the moment they thought they were on the precipice of nuking a deca-billion dollar company, their life’s greatest work, and a generational company. It’s hard to stand against what they did. Unsurprising they couldn’t. | | |
| ▲ | YetAnotherNick an hour ago | parent [-] | | Then they should have made the position clear to the public, or at the very least have some communication with the employees. It's not hard to say that they were against Sam for some particular reason, if they are firing him. At least if the reason is good that might have given them some credibility. And why did Ilya become Sam lover after 2 days? |
|
|
|
|
| ▲ | intev 7 hours ago | parent | prev | next [-] |
| If anyone else doesn't want to listen to the whole thing: https://apecast.app/podcast/the-knowledge-project/episode/op... |
|
| ▲ | wolvoleo 9 hours ago | parent | prev | next [-] |
| I don't think it would have killed openai. It would have fixed it. |
| |
| ▲ | outside1234 7 hours ago | parent [-] | | The winners get to write history. | | |
| ▲ | koolba 6 hours ago | parent | next [-] | | Especially when they pick which history be in the corpus for the next LLM. | |
| ▲ | moogly 3 hours ago | parent | prev [-] | | So Anthropic and Google? I only hear "ChatGPT" used as an invective these days. |
|
|
|
| ▲ | jonstewart 10 hours ago | parent | prev | next [-] |
| Point of order: Anthropic is the most important AI company now. |
| |
| ▲ | CuriouslyC 7 hours ago | parent | next [-] | | Anthropic is the most hyped AI company now. Their models aren't the best, but their marketing sure is. | |
| ▲ | tim333 7 hours ago | parent | prev | next [-] | | People discount Google/Deepmind but a lot of the original research was done there including inventing transformers which form the basis of the other AI companies. | | |
| ▲ | tyre an hour ago | parent [-] | | If anything, the amount of original and foundational research at Google is a black mark against their position now. They blew a hell of a lead. I’m willing to discount what they did almost a decade ago (“Attention is All You Need” was 2017) in an industry that moves this quickly. The execution of an Anthropic matters more now. |
| |
| ▲ | outside1234 7 hours ago | parent | prev [-] | | It really does feel like OpenAI has lost their leadership. I haven’t used a model of theirs, let alone an app, in months. |
|
|
| ▲ | cold_harbor 11 hours ago | parent | prev | next [-] |
| what's wild is they accidentally solved it — pretraining IS unsupervised learning at scale, RLHF IS reinforcement learning. they just didnt know the recipe yet |
| |
| ▲ | jmalicki 10 hours ago | parent [-] | | pretraining isn't unsupervised, it is self-supervised - meaning it is moderately more scale limited. | | |
| ▲ | sigbottle 8 hours ago | parent | next [-] | | What would unsupervised mean, would unsupervised be something like alphago playing against itself trillions of times? Whereas self-supervised, allows learning without explicit annotation of data ; but it doesn't matter if the models already trained on the entire Internet, and it's not like a game where it can come up with effectively new training data for itself? | | |
| ▲ | jmalicki 4 hours ago | parent [-] | | Unsupervised is basically clustering. Alphago is RL - winning or losing a game is a form of supervision. Unsupervised is something where there is no intrinsic reward signal. In pre training, predicting the next token and seeing that it matches is a reward signal, hence it is self supervised. |
| |
| ▲ | cold_harbor 8 hours ago | parent | prev [-] | | fair point — OpenAI's original plan literally said "solve unsupervised learning". the self-supervised distinction wasnt really standard til after BERT/GPT popularized it | | |
| ▲ | jmalicki 4 hours ago | parent [-] | | I think it's an extremely important distinction because self supervised learning has real inherent reward signals. Something like clustering does not. |
|
|
|
|
| ▲ | mikkkee 10 hours ago | parent | prev | next [-] |
| not sure why but this episode feels v boring
perhaps because he didn't share anything unexpected / unknown |
| |
| ▲ | tim333 7 hours ago | parent [-] | | I found it more interesting than I thought because I thought it'd all be stuff I knew but a lot was new to me. |
|
|
| ▲ | batu1509 11 hours ago | parent | prev | next [-] |
| building products on top of their api makes these drama weekends terrifying. really makes you realize how fragile your whole stack is when a board decides to act up. |
| |
| ▲ | jeffrallen 3 hours ago | parent [-] | | Or when sociopaths are in charge, and the board tries to fix that, but other sociopaths work together to overrule the board. (And wtf is that anyway, overriding the board? Why do we even have boards of directors if rich, powerful assholes can just do whatever they want?) |
|
|
| ▲ | quantum_state 9 hours ago | parent | prev | next [-] |
| It’s a matter of fact that OpenAI betrayed its origin. |
| |
| ▲ | wrsh07 4 hours ago | parent [-] | | I think of it more as a parable about how effective 'tying yourself to the mast' actually is The founders of OpenAI naively^ thought "this will make sure that we don't have too much power if we succeed" But it didn't work. What lesson should we learn?^^ ^ please grant this for the sake of argument ^^ I have other models that I prefer to explain what happened, but I think this one is the most interesting |
|
|
| ▲ | photochemsyn 8 hours ago | parent | prev | next [-] |
| Obviously OpenAI betrayed their stated mandate by going to the largely closed-source API-access business model, which is the one that Anthropic, Google, and xAI also adopted, i.e. the high-margin hosted model businesses, while DeepSeek, Alibaba/Qwen, Baidu/ERNIE, and Tencent/Hunyuan are breaking that model by releasing various open weight models. I think the Chinese labs have a fundamentally different viewpoint: they’re building infrastructure, and looking at it more like how a US corporation might like having some of its employees making core contributions to compiler ecosystems like LLVM/clang and so on. The payoff is down the road, partially reputational, but also having a great compiler is good for everyone in the computational business world. The rentier-finance capitalist instead wants to privatize the compiler and extract rents for access. The thing about infrastructure is this: you don’t get a direct financial return on investment in infrastructure (think roads, which make other economic activity possible) unless you have some ridiculously corrupt system controlled by rent-collectors (which is how the US electricity grid and fiber optic backbone works). That’s all the major US LLM providers are doing: trying to collect rents on systems that were built using the global human knowledge base as inputs. At the very least OpenAI should be releasing their older models on a steady timetable. Sure it might reduce some revenue streams but it would be good for their reputation. |
|
| ▲ | optimalsolver 12 hours ago | parent | prev | next [-] |
| >So many people were trying to sign the petition at once that it actually crashed Google Docs I still wonder how much peer pressure was behind that. Like, what if you think Sam is a scumbag and you're glad he's gone, but people are waving this petition in your face. What would you do? It would be really bad for you if the emperor returned and you were one of the few who didn't sign it. Also, going by this video, the first order of business for an AGI should be finding a cure for hair loss. |
| |
|
| ▲ | booleandilemma 9 hours ago | parent | prev | next [-] |
| If only we should have been so lucky. |
|
| ▲ | stuaxo 10 hours ago | parent | prev | next [-] |
| Thankful for the mention of "AGI" in the first lines as I can bail out from reading the rest. Whatever AGI is, it "AGI" is not glueing a load of text prediction machines together. |
| |
| ▲ | _heimdall 8 hours ago | parent | next [-] | | > Whatever AGI is, it "AGI" is not glueing a load of text prediction machines together. K don't think it would be that simple either, but for now we simply don't know. I would like to think that what I consider my intelligence will always be distinguishable from a cleverly built harness wrapped around text prediction, but I can't say for sure that's guaranteed. | | |
| ▲ | grey-area 8 hours ago | parent [-] | | Yes we do know. We’ve fully explored the possibilities of LLMs and they are nowhere. The latest efforts like agents are clearly showing the limitations and are nowhere near AGI. We’ve now reached the buzzwords and bullshit stage of the bubble where they cast around for problems shaped like the solution. | | |
| ▲ | _heimdall 8 hours ago | parent [-] | | Oh this bubble started in the buzzword and bullshit stage, no argument there. I'm just not sure how you can be so certain LLMs will have no place if a system we'd consider AGI, most inventions do require a long list of failures and tweaks before it finally works. |
|
| |
| ▲ | tim333 7 hours ago | parent | prev | next [-] | | I'm not sure people are saying AGI is glueing text machines. | |
| ▲ | dboreham 10 hours ago | parent | prev [-] | | How do you know that? | | |
| ▲ | dannersy 9 hours ago | parent | next [-] | | Because then we already have it, and if we do, it is pretty underwhelming. | | | |
| ▲ | _wire_ 8 hours ago | parent | prev [-] | | Shannon Got AI This Far. Kolmogorov Shows Where It Stops - Vishal Misra https://medium.com/@vishalmisra/shannon-got-ai-this-far-kolm... This article explains what's missing in terms of two kinds of complexity that oppose: Shannon complexity vs. Kolmogorov complexity. It introduces the opposition by an example of driving the value of pi as decimal number, which has no pattern and high complexity, and a formula for deriving pi that does have a pattern with low complexity, then observing that mind can work from the patternless high-complexity back to the patterned low-complexity without prior examples, while AI can't. LLMs encode and retrieve patterns in the training data, and doing so can connect data to the terminology of known principle, but mind can observe inconsistencies in data and to reason from first principles to resolve the inconsistency. The distinction between these two modes can seem blurry as AI can traverse the patterns of the known in ways that are extraordinarily revealing, but it's not structured to reason about the unknown. Inference is not sufficient for reason. For example, a conventional algorithm can search for patterns in text at a scale many orders of magnitude beyond a mind's capacity, and this can be very revealing, but to do so this algorithm need not read the text with comprehension. Regarding the question: can genAI be enhanced to reason? The answer is assumed to be "no", due to the categorical opposition of the two kinds of complexity and the lack of understanding of structures within genAI to handle the reasoning. Read the article, which includes other examples including a jump from Newtonian to Einstein physics in the history of astronomy, and a noodling on how to talk about the edge of the unknowable in AI. |
|
|
|
| ▲ | pjmlp 11 hours ago | parent | prev | next [-] |
| Unfortunately they survived, not going to spend time with this. From my point of view they are yet another big tech bros company. |
|
| ▲ | embedding-shape 12 hours ago | parent | prev | next [-] |
| Not feeling like 1 hour of my Sunday is worth listening to this, do anyone have the non-clickbait answers to the two "previews" mentioned in the description? > Greg explains how the original Napa offsite produced the three-step technical plan OpenAI has followed for a decade and the real reason OpenAI had to abandon its pure nonprofit structure What was the technical plan and what was the "real reason" they couldn't achieve their original goals? |
| |
| ▲ | applfanboysbgon 12 hours ago | parent | next [-] | | > What was the technical plan "1. Solve reinforcement learning 2. Solve unsupervised learning 3. Gradually learn more complicated 'things'" That three point list is verbatim the extent of the technical plan mentioned. > what was the "real reason" they couldn't achieve their original goals? Paraphrasing, "we needed more money for compute and didn't think we could get enough as a non-profit". Brockman's diary might be a stronger indicator of the real real reason, though. | | |
| ▲ | armchairhacker 9 hours ago | parent | next [-] | | What was the real real reason? I imagine if they stayed nonprofit, they would’ve survived, but not convinced investors to give them enough $$$ and datacenters to stay the most popular (above Google). | | |
| ▲ | Lerc 9 hours ago | parent | next [-] | | If they stayed small and 100% non-profit, would the influence or value of the non profit be more, or less, than it is today? I think the non-profit has around 25% ownership of something that is around a trillion dollars of on-paper money. I guess we will see what things are still worth when the crazy days come to an end. | | |
| ▲ | orra 9 hours ago | parent [-] | | > I think the non-profit has around 25% ownership of something that is around a trillion dollars of on-paper money. But the purpose of a non profit is not to maximise profit in a for profit investment. How well is non profit doing at furthering its goals? It formerly had the purpose of “safely” ensuring artificial intelligence benefits all of humanity. It looks like it gave up on that so its staff could be incredibly rich. | | |
| ▲ | tedivm 9 hours ago | parent [-] | | Frankly the non-profit has failed. OpenAI is one of the least open of the AI companies (Anthropic is a bit worse). If it wasn't for the labs in China the dream of an actual open ai system would be dead. | | |
| ▲ | azinman2 8 hours ago | parent [-] | | I feel like people don’t give OpenAI enough credit for the early papers they did publish. Those are what showed the way that everyone else has built on. |
|
|
| |
| ▲ | wahnfrieden 9 hours ago | parent | prev | next [-] | | To get rich of course | |
| ▲ | greatgib 9 hours ago | parent | prev [-] | | I can easily guess also that at the beginning they were more thinking like a research project that they could create something but would like quantum computing today, not really of real world used. And one things started to become real, they realized the financing potential of the thing, that they were seated on a gold mine and would be stupid of them to create that and not profit much more of it. |
| |
| ▲ | coalstartprob 10 hours ago | parent | prev | next [-] | | the real real reason being gdb wanting to be a billionaire ;) | |
| ▲ | cma 11 hours ago | parent | prev [-] | | Unsupervised |
| |
| ▲ | jstummbillig 11 hours ago | parent | prev | next [-] | | Granola notes are a 1 Minute read: https://notes.granola.ai/d/2c35c84f-6eb4-497a-8419-294d92141... | |
| ▲ | tcp_handshaker 10 hours ago | parent | prev | next [-] | | >> What was the technical plan and what was the "real reason" they couldn't achieve their original goals? Because they were still downloading from Anna's Archive and the lawyers were in panic? | |
| ▲ | bblb 12 hours ago | parent | prev | next [-] | | https://www.youtube.com/watch?v=6JoUcQ1qmAc 00:00:00 Introduction
00:00:49 Meeting Sam Altman and Starting OpenAI
00:02:40 Building the Founding Team
00:04:25 DeepMind's Lead Over OpenAI
00:04:54 The Change from a Pure Non-Profit
00:06:05 Breakthrough Moments at OpenAI
00:08:22 What Dota 2 Meant for OpenAI
00:10:04 Reasoning Versus Prediction
00:11:59 Tensions Grow at OpenAI
00:15:44 Sam Altman's Firing
00:17:49 Greg Quits OpenAI
00:19:56 Sam Explores Deal with Microsoft's Satya
00:20:28 OpenAI Employees Sign Petition for Altman's Return
00:23:43 Ilya Sutskever Leaves OpenAI
00:24:59 Lessons Learned in Leadership after Sam Ousting
00:28:22 The Thing Ilya Said that Greg Can't Forget
00:32:22 Is AI Going Parabolic?
00:33:24 How Much of OpenAI's Code is Written by AI?
00:36:21 Are AI Chatbots Just Telling Us What We Want to Hear?
00:38:06 The Global AI Race to Reach AGI
00:38:40 What Happens if US Doesn't Reach AGI First?
00:39:49 Are Competing Countries Stealing AI Advancements from U.S?
00:40:38 Why ChatGPT No Longer Shows Reasoning
00:41:47 The Finite Constraints of Compute
00:43:38 On Investing Early in Data Centers
00:46:31 The Future of Data Center Specialization
00:47:52 How OpenAI Will Decide Whose Queries to Serve
00:49:08 OpenAI on Consumer vs Enterprise Models
00:53:05 Data Centers in Space?
01:00:56 What Should AI Regulation Look Like?
01:04:33 The Future of AI-Powered Entrepreneurship
01:04:44 AI and Job Loss
01:07:15 The Skills Young People Should Invest In
01:11:30 What Does Success Look Like For You?
| |
| ▲ | dave1010uk 12 hours ago | parent | prev | next [-] | | 1. Solve reinforcement learning. 2. solve unsupervised learning. 3. gradually tackle more complicated things. > what was the "real reason" they couldn't achieve their original goals? I assume this is referring to why they gave up being a non-profit. The answer is that they needed more money. | | |
| ▲ | embedding-shape 12 hours ago | parent | next [-] | | Huh, I guess ML people weren't aware of "divide and conquer" that has been successfully employed in software engineering since basically forever? > I assume this is referring to why they gave up being a non-profit. The answer is that they needed more money. Ugh, that was more boring than even I expected, thanks a lot for saving me the time though, seems avoiding watching the full thing was worth it. | | |
| ▲ | adastra22 10 hours ago | parent [-] | | Not that they wanted more money personally, but that they needed more money for compute. | | |
| |
| ▲ | arvid-lind 10 hours ago | parent | prev [-] | | > The answer is that they needed more money. isn't it still an odd choice for a nonprofit? it's hard to imagine a world without OpenAI and ChatGPT now, but at some point they decided being the best is most important. and presumably most profitable, since why just need a little more money? | | |
| ▲ | mycall 9 hours ago | parent | next [-] | | Don't all nonprofits need more money to improve their sustainment? | | |
| ▲ | nativeit 8 hours ago | parent [-] | | Maybe, but somehow I doubt the American Heart Association is planning to open a chain of pork barbecue restaurants to support its mission against heart disease. |
| |
| ▲ | gizajob 10 hours ago | parent | prev [-] | | Trivial to imagine everyone switching to Anthropic or Google or on-device LLMs. |
|
| |
| ▲ | siva7 11 hours ago | parent | prev [-] | | > Not feeling like 1 hour of my Sunday is worth listening to this, do anyone have the non-clickbait answers to the two "previews" mentioned in the description? I know HN is built around mostly not reading the articles linked but how about you click on the link and surprise, there is already exactly another link providing what you're asking for. | | |
| ▲ | embedding-shape 11 hours ago | parent [-] | | You mean the transcript that is behind a account/paywall? Or is there some other link I'm missing? | | |
| ▲ | siva7 10 hours ago | parent | next [-] | | Yes, you're missing the link at the end of the article for free. | |
| ▲ | monkey_monkey 9 hours ago | parent | prev [-] | | Apparently we're all expected to somehow know that "Granola notes" is a summary of the conversation. |
|
|
|
|
| ▲ | bmitc 12 hours ago | parent | prev | next [-] |
| So firing a grifter means it would kill the company? Doesn't that mean the company is grifting? If no one else can possibly lead the supposedly the most important company, with billions/trillions (?) of so called value, do you have a good company and product? Or do I forget that this guy sleeps with an Ayn Rand doll tucked under his arms? |
| |
| ▲ | okr 11 hours ago | parent | next [-] | | ChatGPT or CoPilot were awesome products at the time. I do not use them anymore these days. But to me it felt never like i was abused. And Investment into companies is what it is, a risk. But the results remain forever, whoever wins. | |
| ▲ | zemvpferreira 10 hours ago | parent | prev [-] | | Not a fan of Altman but the devil you know is a powerful argument. If you believe a CEO/Founder to be a grifter-position at its core (fake it till you make it etc etc), retaining the best grifter you can find is the optimal play. |
|
|
| ▲ | PunchTornado 10 hours ago | parent | prev | next [-] |
| isn't this the friend of scam altman? who cares of what he has to say? |
|
| ▲ | jordemort 10 hours ago | parent | prev | next [-] |
| too bad, eh |
|
| ▲ | throw6999 10 hours ago | parent | prev [-] |
| Sky net from future protected itself. |