| ▲ | thatjoeoverthr 18 minutes ago | |
One problem here with the protocols is the field isn't yet so stable. Most people are copying OpenAI's endpoint, and so you have "OpenAI compatible", but there are always little hairs on it. Case in point, OpenAI itself no longer offers multiple basic inference options on their new models. Can't pass temp, get back logits, etc. on anything after GPT 4.1. It's not a total zoo and Open Router is pretty easy but everything is just enough a special snowflake that models aren't a commodity. Maybe later though. | ||