This isn’t really specific to LLMs, though, is it? Pretty much any modern SaaS product will silently siphon off some portion of requests off to stuff they’re A/B testing before release and you’ll not necessarily know about it.