Pretty extreme solution… you can get Claude models from AWS Bedrock and Google Model Zoo. These are both very helpful for compliance and security, but do require you to have a cloud strategy.

Some data is so sensitive it likely has to stay on premises though.

Yeah, albeit an increasingly second-rate experience, at least when it comes to Bedrock.