>LLM’s etc can’t do that under current methodology

I hate to give a smarmy result, but are you sure you know what RLHF is? Because this is one way to correct said data.

I am aware of RLHF, and no it doesn’t solve this problem.

There’s a great deal of lesions to be learned from X PB of training data that wouldn’t be covered.