This is not a good idea in practice. Why not bundle the metadata as JSON or Protobuf via an aux file?

That's how it's usually done. The main reason I tried embedding it directly was to make the file self-contained, so that context always travels with the image itself and it's less tedious.