That’s not how it works. Being trained a ton of human text doesn’t mean you can complete the next token for a program that needs to be logically coherent.

Imagine all your data is Reddit threads and now I ask you what follows “goto”, how would Reddit help you?

The opposite is likely true - there isn’t a ton of publicly available cobol code compared to e.g React, so an LLM will degrade.