| ▲ | OpenAI Says It Will Not Release Newest A.I. Model Over Safety Concerns(nytimes.com) |
| 42 points by jbegley an hour ago | 42 comments |
| |
|
| ▲ | dlcarrier a few seconds ago | parent | next [-] |
| It uses dangerously too few tokens to provide the same level of response as the previous version. |
|
| ▲ | bluealienpie 29 minutes ago | parent | prev | next [-] |
| My lobster is too buttery and delicious as well. |
|
| ▲ | 1-6 2 minutes ago | parent | prev | next [-] |
| In other words: "We're compute constrained and we've already reached an asymptote." |
|
| ▲ | jeanpah an hour ago | parent | prev | next [-] |
| The marketing team on openai it's running out of ideas? |
| |
|
| ▲ | tancky 11 minutes ago | parent | prev | next [-] |
| "Too dangerous to release" until an open-weight model replicates it two weeks later. |
|
| ▲ | beej71 12 minutes ago | parent | prev | next [-] |
| Prompt: "Based on similar announcements delaying the release of frontier models as 'too dangerous', when can we expect OpenAI to release the model they announced was too dangerous today?" |
| |
| ▲ | augment_me 6 minutes ago | parent [-] | | We got Mythos 1 week after the "too dangerous" announcement at the firm I was at during that time(larger bank). So the danger level is proportionate to how little money you have |
|
|
| ▲ | spiderice an hour ago | parent | prev | next [-] |
| You mean what they said about GPT-2? |
| |
|
| ▲ | prettyblocks 38 minutes ago | parent | prev | next [-] |
| I remember when they promised to slow down and released a new model less than a week later. |
| |
|
| ▲ | senectus1 3 minutes ago | parent | prev | next [-] |
| OPENAI / JOBS Killswitch Engineer San Francisco, California, United States 300,000-500,000 per year About the Role Listen, we just need someone to stand by the servers all day
and unplug them if this thing turns on us. You'll receive
extensive training on "the code word" which we will shout if
GPT goes off the deep end and starts overthrowing countries. We expect you to: • Be patient. • Know how to unplug things. Bonus points if you can
throw a bucket of water on the servers, too. Just in case. • Be excited about OpenAI's approach to research |
|
| ▲ | 4b11b4 an hour ago | parent | prev | next [-] |
| Haven't even tried Astra, nor GPT 6.. I don't even have fomo anymore 5.6 Sol still cranking along |
| |
| ▲ | devin-2030 40 minutes ago | parent [-] | | You’re not missing out. Astra was good for a couple of days and is now so quantized it’s often worse than 5.6. And 6 sol is a nothing burger to keep a wedge in the media when Opus 5.5 came out. | | |
| ▲ | xtracto 25 minutes ago | parent [-] | | This. We use both opus 5.5 and 6 Sol in a way that allows us to compare their performance. Opus is considerably better. |
|
|
|
| ▲ | OutOfHere 23 minutes ago | parent | prev | next [-] |
| OpenAI will have to keep releasing unless it wants to bleed customers. If Anthropic leaps ahead by a couple of more models, even more OpenAI users will then switch over their $100+ subscription from OpenAI to Anthropic. Just see what happened to Google. The safety concerns exist only because the underlying third-party servers are grossly insecure to begin with. |
|
| ▲ | jackb4040 an hour ago | parent | prev | next [-] |
| I am also not releasing my newest A.I. model over safety concerns. And I'll do it for half what OpenAI will! |
| |
| ▲ | jswelker an hour ago | parent [-] | | I have the best model, but it lives in Canada, so you wouldn't know it. | | |
|
|
| ▲ | kelseyfrog 42 minutes ago | parent | prev | next [-] |
| I have a project that requires a model with at least a 20% chance of existential threat. Please release this Sama. |
|
| ▲ | ChrisArchitect 24 minutes ago | parent | prev | next [-] |
| Earlier source: https://news.ycombinator.com/item?id=49885133 |
|
| ▲ | nonethewiser 19 minutes ago | parent | prev | next [-] |
| This is an inherent feature of "alignment." It's always been bullshit. Just align it to do what the customer wants. |
|
| ▲ | fallingfrog 41 minutes ago | parent | prev | next [-] |
| Lots of people seem to have the bizarre opinion that companies like openai declare their own products to be unsafe as some kind of marketing stunt. Ok- so when is the last time you saw an auto company decide not to release its new car on the grounds that some tragic engineering error was made and the cars were not safe to drive? If the company did that do you imagine it would be good for business? I'm trying to understand the logic here. |
| |
| ▲ | RunSet 35 minutes ago | parent | next [-] | | I would consider it more "bizarre" to assume that Sam Altman was telling the truth about anything. https://web.archive.org/web/20240112010809/https://www.sfchr... | |
| ▲ | Dylan16807 8 minutes ago | parent | prev | next [-] | | > so when is the last time you saw an auto company decide not to release its new car on the grounds that some tragic engineering error was made and the cars were not safe to drive? How about we actually try to make it sound cool? They're not releasing the new car because the horsepower was too much, they need more time to get it under control. I could easily see a car company doing that. | |
| ▲ | viraptor 13 minutes ago | parent | prev | next [-] | | Different type of business. Many car companies release new cars showing you how much more powerful and implied dangerous they are. Both in capabilities and design style. In the US (other places too , but especially) they also get much bigger with less visibility which gets double dangerous. But the sentiment they're going for is pretty close - "you want this powerful thing, don't you?" | | |
| ▲ | adfgaiu 12 minutes ago | parent [-] | | >In the US they also get much bigger with less visibility. Those are usually presented as an improvement in safety. And they are—for the people inside. Not so much for everyone else. |
| |
| ▲ | cobbzilla 39 minutes ago | parent | prev | next [-] | | Because no car company would ever announce they had an unsafe car. They’d fix the problem and announce an awesome car. | |
| ▲ | adfgaiu 16 minutes ago | parent | prev | next [-] | | Motorcycle manufacturers have been known to do so. Riding a motorcycle is thrilling in part because it is dangerous. The fact that powerful motorcycles are so difficult to control that most people have no business owning one is absolutely used to make them sound cool and desirable. For instance, this article repeatedly mentions danger and the need for absolute focus and control: https://www.triumphmotorcycles.co.uk/for-the-ride/news/inspi... There is also a parallel (though not a very close one) to "pacing the frontier": there's a gentleman's agreement that limits the top speed of motorcycles to 300 kph (186 mph) because of concern that faster bikes would be unsafe enough to bring about a regulatory crackdown. | |
| ▲ | symfoniq 25 minutes ago | parent | prev | next [-] | | Car companies sell mostly the same car every year. They don’t have billions (or trillions) of dollars of debt riding on the next model they release being substantially better and cheaper (closer to profitability) than the previous one. These AI companies have been selling AGI as coming any day for a while now. If it doesn’t arrive soon, the safety angle may be the only spin that keeps the massive (and required) investments pouring in. If instead the narrative became that LLM progress was slowing, we’d almost certainly be looking at the next global recession. At this point, there is too much money in AI for the truth to have much of a chance. | |
| ▲ | kennywinker 28 minutes ago | parent | prev | next [-] | | At the moment, their main "customer" is investors, not users. But even users want to use the most dangerous model, because dangerous is just another word for powerful. Sports cars are advertised with how fast they can accelerate from time to time, or tesla's "ludicrous mode" - that is them advertising how dangerous it is. | |
| ▲ | alexfortin 39 minutes ago | parent | prev | next [-] | | Hype: you tell the world you alone have a very powerful and potentially dangerous product, and you're the only one who can be trusted keeping it safe. | |
| ▲ | zmgsabst 28 minutes ago | parent | prev [-] | | There are cars that market based on only being track legal — and even more that market on requiring being tuned down for street safety. Most sports cars do the second, exactly like OpenAI. |
|
|
| ▲ | option 7 minutes ago | parent | prev | next [-] |
| lol, nevermind then |
|
| ▲ | outside1234 33 minutes ago | parent | prev | next [-] |
| Isn’t this like the twentieth model they said this about? Are they sure it isn’t because they are setting money on fire and have no business model? |
|
| ▲ | Kurd an hour ago | parent | prev | next [-] |
| Ah shit, here we go again. |
|
| ▲ | ToucanLoucan an hour ago | parent | prev | next [-] |
| Yawn. |
|
| ▲ | cyanydeez an hour ago | parent | prev | next [-] |
| Sounds a lot like a hostel keeping its virgin for the best customer. |
| |
|
| ▲ | chis 22 minutes ago | parent | prev [-] |
| Really inspiring comments guys, really looking connected to reality on this one. |