| ▲ | paulryanrogers 3 hours ago | ||||||||||||||||
What would this look like? | |||||||||||||||||
| ▲ | WithinReason 3 hours ago | parent [-] | ||||||||||||||||
the model generates probabilities for the next token, then you set the probability of not allowed tokens to 0 before sampling (deterministically or probabilistically) | |||||||||||||||||
| |||||||||||||||||