| ▲ | throwaw12 2 hours ago | |
LLMs are such a great business, they are non-deterministic, hence you can do whatever you want, because customers can't do anything about it: * nerf them based on supply and demand, when you have a high demand, nerf it, but keep charging same price. * do you want to show revenue growth to investors? increase thinking tokens, customers will keep paying, because again, this is non-deterministic system, sometimes it thinks more * do you want to increase profits? start serving 4-bit, 5-bit quantizations and keep charging same price * want even more? publish a paper "Advanced Auto Super Smart Prompt Router - AASSPiRation", and start routing requests to Qwen3.8-27B or GemmaE2B from time to time on the edge * Not enough? introduce "Complex Chained Workflows - CCW" in your coding harness, which spawns multiple deterministic workflows (which you can't stop or control) and they will use Haiku to write the code, then use Opus 5.5 high to verify the code (which is obviously wrong) and Opus 5.5 produces recommendations on how to fix the code, delegates to Haiku, which again fails writing proper code, and keep doing it 5-6 times, you made lots and lots of money (don't forget, all should run in parallel, to pick one best result among 10 outputs). | ||