One of the biggest differences I noticed off the bat is llms includes prompt caching which I'm not sure I've seen in any other self hosted UI options

▲

asnyder 4 days ago | parent [-]

I see Lobe and Chatbox both have prompt caching toggles, are you referring to something else?

▲

asnyder 4 days ago | parent | next [-]

I've mistakenly given Chatbox a new feature, sorry :). In LobeChat, after you select a particular model, it enables a mini-settings menu next to the model that lets you set caching, deep thinking, and thinking token consumption.

	▲	CryptoBanker 4 days ago \| parent [-]
		Ah that must be new since the last time I tried lobechat

▲

CryptoBanker 4 days ago | parent | prev [-]

Where do you see that? I can't seem to find it in the web or desktop apps for lobechat.

EDIT: I also don't see it in Chatbox