| ▲ | saberience 16 hours ago | ||||||||||||||||
Who's the intended user for this? Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models? Is it a competitor to LMStudio? | |||||||||||||||||
| ▲ | danielhanchen 15 hours ago | parent | next [-] | ||||||||||||||||
You would be surprised! Nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - the UI was primarily a culmination of pain points folks had when doing either training or inference! We're complimentary to LM Studio - they have a great tool as well! | |||||||||||||||||
| |||||||||||||||||
| ▲ | huydotnet 15 hours ago | parent | prev | next [-] | ||||||||||||||||
you just answered your own question, "AI hobbyists who has 4090 at home". And they are pretty much targeted user of Unsloth since the start. | |||||||||||||||||
| |||||||||||||||||
| ▲ | lastdong 15 hours ago | parent | prev | next [-] | ||||||||||||||||
From the homepage looks like it: “Training: Works on NVIDIA GPUs: RTX 30, 40, 50, Blackwell, DGX Spark/Station etc.” | |||||||||||||||||
| ▲ | mlnj 15 hours ago | parent | prev [-] | ||||||||||||||||
I am unaware lm studio is being used for fine tuning. I believe it only does inference. Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I'm just lazy. Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I'll have to wait for AMD ROCm support. | |||||||||||||||||
| |||||||||||||||||