>they're jsut regurgitating other designs from their training data

I'm deep into the crank/lone genius territory with my BitGrid project, doing things with code that nobody else would be silly enough to waste time on. If it's just copy/pasting code from some latent space, I have no idea where it's getting it.

When's the last time you wrote code to directly handle all the bits to multiply two floating point numbers? I've never done it.