My colleague works in a functional role for a medium sized SaaS company(1000-5000 employees), working with banks, family offices, hedge funds. They use teams and copilot, they all hate it.

One thing that I don't know about is if they have an AI product that can work on combining unstructured and databases to give better insights on any new conversation? e.g. like say the LLM knows how to convert user queries to the domain model of tables and extract information? What companies are doing such things?

This would be something that can be deployed on-prem/ their own private cloud that is controlled by the company, because the data is quite sensitive.

Databricks Genie is excellent from my experience, and provides for all your listed requirements.