Brave's "Leo" AI is configurable enough to specify local endpoints for processing, instead of going wherever they want it to go. I've set it up to use my own systems, and it works just fine like that.

If you have a beefy enough device, then yes this can be done on-device.