| ▲ | noname120 a day ago | |||||||
Not true. Try to increase the context window and you will be greeted with an error when you reach the real limit enforced server-side. | ||||||||
| ▲ | searealist 17 hours ago | parent | next [-] | |||||||
The models themselves support up to 1M. You are just charged more for all context over 400k. The 272k limit is just a client limitation to ensure you can never go over 400k since the maximum output size of the model is 128k. | ||||||||
| ||||||||
| ▲ | quotemstr a day ago | parent | prev [-] | |||||||
Perhaps not this for this parameter, but for others? Client side. | ||||||||