Should take a look at some of the ISO specs for various MPEG standards for example.

The container formats are defined in a way that could potentially make this possible.