Maybe using git notes for the conversation or conversation summary is better.

I don't think git-notes has the same history / change tracking. Use a .sessions dir or similar. I'm working towards adding them to my knowledge base so as not to pollute my git repo