Remix.run Logo
blutoot 2 days ago

Why is most of the AI-tooling industry still stuck on this "bring your own key" model?

sethhochberg 2 days ago | parent | next [-]

What would you propose as an alternative?

As a corporate purchaser, "bring your own key" is just about the only way we can allow our employees to stay close to the latest happenings in a rapidly moving corner of the industry.

We need to have a decent amount of trust in the model execution environment and we don't like having tons of variable-cost subscriptions. We have that trust in our corporate-managed OpenAI tenant and have good governance and budget controls there, so BYOK lets us have flexibility to put different frontends in front of our trusted execution environment for different use cases.

Macha 2 days ago | parent | prev [-]

The companies actually providing the models charge by token and this lets the tooling avoid having to do cost planning for something with a bunch of unknowns and push the risk of overspend to customers.