It was stored on a punched paper tape.

https://en.wikipedia.org/wiki/Altair_BASIC#Origin_and_develo...