▲ | kelipso 7 days ago | |
Technically random can have probabilities associated with them.. Casual speech, random means equal probabilities, or we don’t know the probabilities. But for LLM token output, it does estimate the probabilities. | ||
▲ | energy123 6 days ago | parent [-] | |
Greedy decoding isn't random. |