Prompt ingestion is going to be the biggest differentiator.

Being able to route prompt to features that then route to special models would be a really solid implementation.

It starts to break down once you go over 20 classifications. Which is very basic routing that can easily be done with typical ML models for cheaper and faster.