It was stored on a punched paper tape.
https://en.wikipedia.org/wiki/Altair_BASIC#Origin_and_develo...