I didn't have it complete in time, but you can use pi-gen-micro from Raspberry Pi (it's a newer project) to build a very lightweight boot image now, on the order of a yocto/buildroot image, but with Pi OS as the base.