| ▲ | gpugreg 7 hours ago | ||||||||||||||||
I was wondering whether this was any good for programming, but it is too fast for its own good. There is a limit of 450,000 tokens per minute. I hit this limit in about 90 seconds and burned through $1.10 while doing so. This is because cached tokens count towards the token limit. For comparison, I ran the same task with DeepSeek-V4-Flash, which finished in 172 seconds and cost $0.024 with a final context window size of 55217 tokens, while Qwen3.8-27B was not even close to being done with a 64178 context window. This is a very efficient way to burn your money, but I would not recommend it for programming. On the positive side, I got a $5 signup bonus, so it wasn't my own money. | |||||||||||||||||
| ▲ | irthomasthomas 5 hours ago | parent | next [-] | ||||||||||||||||
Without prompt caching this becomes more expensive than fable 5.1 after turn 50, assuming you start with 40k tokens and add 2k per turn. | |||||||||||||||||
| ▲ | d2p 6 hours ago | parent | prev | next [-] | ||||||||||||||||
> There is a limit of 450,000 tokens per minute. I hit this limit in about 90 seconds I'm confused. If it's 1500t/s, isn't that only 90k per minute? How do you hit a 450k/minute limit? | |||||||||||||||||
| |||||||||||||||||
| ▲ | Pxtl 6 hours ago | parent | prev [-] | ||||||||||||||||
Could this also be coming from the problem that Qwen3.8-27B's default mode being "extra-high reasoning level"? | |||||||||||||||||