sounds out of scope for an llm chat ui

What? No. This is like building a Slack clone without the ability to copy a stream of messages. It is entirely reasonable to want to do this.

Slack also basically fails at this. You end up getting a jumble of timestamps, names and messages.