They were all programmed with plugboards.
Arguably, that is the ROM.
Arguably more like soft wired CPU logic, since the contents of the plugboards were not uniformly addressable words.