There’s an art to GPT sampling. You have to use temperature 0.7. People never believe it makes such a massive difference, but it does.