|
| ▲ | anukin 19 hours ago | parent | next [-] |
| Have you observed any decrease in performance at context higher than 200k? That used to be one of the major issues why clearing or compacting context when the context nears 150 to 170k is usually preferred. |
| |
| ▲ | ilc 17 hours ago | parent | next [-] | | Opus: Yeah, it can be a little fuzzy at 600-700k, I prefer it 400K and under in general. But, I've had usable sessions to 850k. It really depends on the session, and what you are doing how far you can push it. | |
| ▲ | PeterStuer 10 hours ago | parent | prev | next [-] | | I see it more past 300-350k these days, but probably there is a smaller decline even past 250k. | |
| ▲ | jwitthuhn 19 hours ago | parent | prev [-] | | Not really, on the project I'm working on right now most of my longer prompts seems to consume somewhere between 300k and 400k tokens (input + output) and I find that both Opus 4.8 and Fable 5 don't seem to get lost with that much context. At least the results still look good to me. I don't think I've ever pushed past 500k though, it may well fall apart at the higher end of what is officially supported. |
|
|
| ▲ | Jimmc414 15 hours ago | parent | prev | next [-] |
| There are numerous Claude settings to disable or modify this behavior |
|
| ▲ | phonon 19 hours ago | parent | prev [-] |
| Codex context limit is 400k total, including 128,000 reserved output tokens. |
