| ▲ | JLCarveth 6 days ago | |
I ran into the same looping issue with that model. | ||
| ▲ | danielhanchen 6 days ago | parent [-] | |
Definitely give temperature = 1.0, top_k = 64, top_p = 0.95, min_p = 0.0 a try, and maybe repeat_penalty = 1.1 | ||
| ▲ | JLCarveth 6 days ago | |
I ran into the same looping issue with that model. | ||
| ▲ | danielhanchen 6 days ago | parent [-] | |
Definitely give temperature = 1.0, top_k = 64, top_p = 0.95, min_p = 0.0 a try, and maybe repeat_penalty = 1.1 | ||