> Much more knowledgeable than you or I are

Speak for yourself. I work for an LLM startup that was successfully bootstrapped and is now highly profitable with 8-digit revenue and zero outside investment. Unlike OpenAI and Anthropic, we do not rely on deceiving investors to dump a trillion dollars into a tar fire with the false promise of delivering the machine god that will unemploy all of humanity (at best). Taking people who have an unbelievably large financial stake in lying at face value, and moreover, stating that those are the only people who can be trusted, is so unbelievably naive it's almost cute. Almost.

> We made a framework from which it can semi-organically emerge.

...by programming. Again, this is an appeal to emergent behaviour, which, repeating myself, was already well-demonstrated by Conway's Game of Life in 1970, and yet nobody lost their minds because the emergent behaviour didn't happen to refer to itself as "I" when trained to.

> Speak for yourself. I work for an LLM startup

And yet you still fail to demonstrate good understanding of the topic ¯\_(ツ)_/¯

> stating that those are the only people who can be trusted

You are right, they are most definitely not the only people who can be trusted to have current and accurate information. But due to the unique constraints of these fast-moving events, they are certainly among those whose opinions need to be considered carefully. You would have been be a fool to not take into account the opinions of the physicists working on the Manhattan Project, for example.

> ...by programming. Again, this is an appeal to emergent behaviour

Saying (derisively) that it is an "appeal to emergent behaviour", when the ENTIRE POINT OF CONTENTION is said emergent behaviour is like saying that you should not discuss God at a theological forum or that you should ignore the theory of relativity when discussing gravity.