> dividing devices up and renting same one at same time and hoping rentees won’t notice

I don’t think it’s possible to overcommit a GPU rental, even if idle people are going to notice their weights being kicked out of VRAM since it takes minutes to load them back in.