I wonder what happens if Claude was exploited by hackers and all chat logs were released one day.

Nearly every corp secrets would be instant leaked.

What happens when providers achieve AGI, as they claim, and then use what they've learned from your company's prompts, context, memory and outputs to put you out of business

Even without AGI, that internal source code, data and trade secrets are valuable on their own. Would suck if someone capitalized on it