> And you can say, “well it’s not that impressive because they had an oracle to compare against, so it was simple to go from one language to another”, but I think that’s selling this entire thing short.

It's not. If you give it a reference implementation, and unless the LLM/agent cheats, you'd get the migration minus undocumented/untested behavior. I've done that with different domain, migrating existing numerical code from Fortran to Rust. When working on the same codebase, agents routinely shit the bed unless given increasingly specific and concrete specs.

It's simply a spectrum between "make an airbnb for ants, make no mistakes" and providing an actual specification (and I consider an implementation to be such). What you don't provide and account for from the beginning will be paid in tokens later. That puts a price label on technical debt, which is interesting in itself, and a perverse incentive for AI companies.