| ▲ | danielhanchen 2 days ago | |||||||
Definitely Unsloth Studio can help - we recommend specific quants (like Gemma-4) and also auto calculate the context length etc! | ||||||||
| ▲ | ryandrake 2 days ago | parent [-] | |||||||
Will have to try it out. I always thought that was more for fine-tuning and less for inference. | ||||||||
| ||||||||