Remix.run Logo
recitedropper 8 hours ago

Sad turn of events for our world. After watching the behavior of the most senior OpenAI researchers on twitter, I feel even less confident in them as a team to be shepherding this much capital and compute.

The dark forest awaits..

AlexErrant 7 hours ago | parent | next [-]

1. What does the dark forest have to do with this? Because "the most senior OpenAI researchers" are shitposting on social media, we've an answer to the Fermi paradox???

2. The dark forest is fun for scifi stories, but is mathematically bunk anyway https://www.noahpinion.blog/p/the-dark-forest-hypothesis-is-... https://www.reddit.com/r/IsaacArthur/comments/1l06cnk/cool_w... https://www.projectnash.com/aliens-the-fermi-paradox-and-the...

When doomposting please actually say something substantive. Negative news always gets clicks/updoots; fight that human tendency.

recitedropper 7 hours ago | parent | next [-]

I elaborated on my use of "dark forest" in another reply. We're headed for a dark forest--not amongst interstellar civilizations, but in intellectual work.

I agree that we have not solved the Fermi paradox; I disagree that comments highlighting immature behavior from people who wield enormous power in our world are unproductive.

AlexErrant 7 hours ago | parent [-]

This clarification substantially changes the flavor/nuance of your OP; may I suggest an edit (assuming the locktime hasn't passed)?

Separately, I disagree that intellectual work has ever been free of "dark forest"-style secrecy. Scientists everywhere have worried about being scooped; AI just magnifies that (as all tools have; e.g. Leeuwenhoek lenses).

And thirdly, if you want to make a stronger case for "I feel even less confident in them as a team to be shepherding this much capital and compute", you should give citations and arguments. From what I've seen, there's drama, it's much OpenAI trying to avoid scooping, and Tristan being stuck in a game of telephone, and Levent being incommunicado.

If you have a better analysis, you should say so instead of being vague.

recitedropper 6 hours ago | parent [-]

I don't comment on HN much, and I don't really expect HN comments to hold to rigorous standards. This forum is more casual than other places on the internet where people expect heavy citations. I also wasn't expecting this to blow up, although it is interesting to see that a lot of people react to this announcement with a negative sentiment.

I appreciate your upholding of ideals, and since I respect that, I will honor with final replies:

1. Locktime has passed.

2. Yes, intellectual work has always had elements that incentivize secrecy. If you want to say we were already in a "dark forest", so be it. My suggestion is that the multiplier AI adds to the possibility you get scooped is a step-change, and therefore we now enter a new "dark forest".

3. This is a big thread, and the twitter antics are well-documented, so I would assume someone else has cited them. If not, I think most are aware at this point that the online antics of AI researchers, especially when announcing or citing mathematical advancse, have regularly been childish.

AlexErrant 5 hours ago | parent [-]

2. Fair, and further I would agree that OpenAI not knowing if prior user prompts were part of training data is concerning and will only lead to more secrecy.

3. ctrl-f "x.com" in this thread only yields https://x.com/sama/status/2097385167002415140 https://x.com/SebastienBubeck/status/2097379411691516310 https://x.com/OpenAI/status/2097375276384567642

and frankly, I'm unwilling to give Elon any more traffic to dig up drama that ultimately doesn't matter. I'm not seeing anything especially childish, but y'know... I'm not sure I care.

zem 4 hours ago | parent | prev [-]

the projectnash link claims it's mathematically valid, the noahpinion link says that it's invalid and has a marvellous proof that the non-walled section is too small to contain.

AlexErrant 2 hours ago | parent [-]

Ah derp; that's what I get for moving too fast. Genuine thanks for calling me out on my bullshit. (and this is also why I prefer auditable citations instead of casual "my reading of twitter is...")

I retract the projectnash citation; I grabbed it from the Cool World's youtube description, thinking it was a blog version of the video. It was not. I suggest watching the video instead.

vmasto 8 hours ago | parent | prev | next [-]

Indeed, this seems to be the main, albeit hidden, takeaway from all of this.

nicce 5 hours ago | parent | prev | next [-]

I guess guys from the opposite side would not work there. So that is what will happen more and more.

sheafification 8 hours ago | parent | prev | next [-]

I hate the dark forest more than just about any scifi trope but reality just keeps proving it right.

recitedropper 7 hours ago | parent [-]

I also think the trope is a little overused, but do wonder if there is an interesting analogy for what this will do to research: Massively incentivize keeping results secret, to avoid being scooped by someone willing to throw enormous compute at your partial solution.

So less about hiding civilizations, and more about hiding information. Math is clearly headed in this direction, and I see no reason why the rest of intellectual work shouldn't too.

7 hours ago | parent | prev [-]
[deleted]