https://github.com/bigscience-workshop/petals was meant to be this i think