Remix.run Logo
devindotcom an hour ago

heh yeah I ran into this with one of the few times I used claude desktop. it had no idea what features it had and didn't have, where buttons were in the app, etc. isn't that kind of a core category of knowledge you'd want the chatbot to know?

fl0id an hour ago | parent [-]

in my experience, usually it knows this (it is in the system prompt) but it can still get confused. Especially with skills for example, some skills might only work in claude code/outside of sandbox or in desktop but not on web. And it would sometimes not know if it was on the web or desktop.

hahahaa 15 minutes ago | parent [-]

The next AI benchmark is can an agent understand the product suite of its creators.