Remix.run Logo
▲ onlyrealcuzzo 2 days ago

> This should be fine for caching.

When launching a swarm of smaller models, they can theoretically share cache amongst themselves, but not with the larger model (that already has it cached). They have different architectures.

Further, it wouldn't really make sense for them to share the same cache anyway! The swarm, that is, they'd be working on independent things...