Can't you use logit bias to help with this? Might depend how they are tokenized.