Remix.run Logo
trvz 15 hours ago

Installing with pip on macOS is just not an acceptable option. It'll mess up your system just like npm or gem.

This needs to go on homebrew or be a zip file with an app for manual download.

DIVx0 14 hours ago | parent | next [-]

Agree with you, a slightly more maintainable way to use it now is with "uv" or mise. i've used `uv tool install unsloth` for this one.

danielhanchen 14 hours ago | parent [-]

Yep - uv is a better fit - and you get parallel downloads as well

saagarjha 2 hours ago | parent [-]

It's not just uv, it also will drop an nvm install in your home directory :(

danielhanchen 14 hours ago | parent | prev | next [-]

Hey we're still working on making installation much better - appreciate the feedback!

We come from Python land mainly so packaging and distribution is all very new to us - homebrew will definitely be next!

bityard 14 hours ago | parent | prev | next [-]

I recommend installing uv first, then you can install any Python code you want inside a virtual environment to keep it isolated from the rest of the system.

danielhanchen 14 hours ago | parent [-]

Yep uv pip install unsloth works as well - we probably should have just made that the default - in fact Unsloth makes its own venv using UV if you have it dynamically

mmis1000 9 hours ago | parent | next [-]

I think the website should probably mention those installation preset in unsloth pyproject.toml though. The website instruct you to install dependencies separately. But it turns out there are dedicated preset that install specific rocm/cuda/xpu version in the project.

anentropic 3 hours ago | parent | prev [-]

or `uv tool install unsloth` for a safe 'global' installation

mmis1000 9 hours ago | parent | prev | next [-]

Uv helps you up though. Use a pyproject.toml and uv sync. Everything will be put into the venv only, nothing spread across the whole system.

The pyproject.toml can even handles build env for you, so you no longer need a setup.sh that installs 10 tool in specific order with specific flag to produce working environment. A single uv sync, and the job is done.

Plus the result is reproducible, so if this time uv sync work, then it also work next time.

Highly recommend if you are still on pip.

Note: Take a example that I used to install unsloth with rocm setup that based on unreleased git version dependencies and graphic card specific build flag, all of them can be handled with one command 'uv sync'. This will require a big pile of shell script if doing another way. https://github.com/unslothai/unsloth/issues/4280#issuecommen...

jszymborski 11 hours ago | parent | prev | next [-]

Would pipx solve the problem?

https://pipx.pypa.io/stable/installation/

smcleod 5 hours ago | parent | prev | next [-]

Ah yes, came to say something similar, Python dependencies are an absolute nightmare, even with uv it feels like there's always a battle to make other peoples Python apps install.

Update: It looks like it doesn't work with the current Python version, you might have to downgrade to Python 3.13 (however even then I still get `error: unexpected argument '--torch-backend' found`)

gessha 14 hours ago | parent | prev | next [-]

I know the whole package system across most languages is a dumpster fire but for Python, uv solves a lot of problems.

uv init

uv add unsloth

uv run main.py % or whatever

danielhanchen 14 hours ago | parent [-]

Yep UV is fantastic - should have just that default!

Computer0 14 hours ago | parent | prev | next [-]

On my linux systems I use venv to not affect system packages, is that not an option for this situation?

beernet 14 hours ago | parent | prev [-]

Agreed, feels like a vibe-coded frontend based on already given backend features.

Also, never saw any Unsloth related software in production to this day. Feels strongly like a non-essential tool for hobby LLM wizards.

danielhanchen 14 hours ago | parent | next [-]

You would be surprised - we're the 4th largest independent distributor of LLMs in the world - and nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - we for example collab directly with large labs to release models with bug fixes.

airspresso 13 hours ago | parent | prev | next [-]

Unsloth is providing the best and most reliable libraries for finetuning LLMs. We've used it for production use-cases where I work, definitely solid.

danielhanchen 10 hours ago | parent [-]

Glad it was helpful!

ta9000 11 hours ago | parent | prev [-]

Even a brief reading of their site would have spared you this embarrassment.