Remix.run Logo
danielhanchen 2 days ago

Definitely Unsloth Studio can help - we recommend specific quants (like Gemma-4) and also auto calculate the context length etc!

ryandrake 2 days ago | parent [-]

Will have to try it out. I always thought that was more for fine-tuning and less for inference.

danielhanchen 2 days ago | parent [-]

Oh yes sadly we partially mis-communicated haha - there's both and synthetic data generation + exporting!