It seems like the role probes they came up with could somehow be used as feedback during training to teach it to use the role tags properly.

Yes, this is something we're thinking about!

Thanks for reading.