> your competitors will be able to replicate in few months.

Will they really be able to replicate the quality while spending significantly less in compute investment? If not then the moat is still how much capital you can acquire for burning on training?

There are multiple tech companies with quadrillion-deep pockets.

Is that not what distillation is?

What does moat even mean anymore