It's not like they have a poweful all-knowing oracle that can explain it to them at their dispos... oh, wait!

They have to know that this could bite them and to ask the question first.

	▲	nixpulvis 4 hours ago \| parent [-]
		I do think having some insight into the current state of the cache and a realistic estimate for prompt token use is something we should demand.