To clarify, this MIT-licensed app is from the very same dev, 'Prince Canuma', who maintains the popular MLX-VLM library (https://github.com/Blaizzy/mlx-vlm). MLX-VLM is a long-time dependency of the excellent LM Studio and others because it can provide faster inference on Apple devices than llama.cpp. Historically, MLX is a smaller community than CUDA, but has some of the fastest updates upon the release of new models, particularly in models with modalities beyond text-in, text-out (vision, STT, TTS, video gen). See also (https://github.com/Blaizzy/mlx-audio-swift). Would be totally unsurprised if those modalities and models get integrated into this UI.

Possibly vibe-coded landing page notwithstanding, the app is mostly written in Swift language. That suggests it will be easy to port this inference stack to iPad and iPhone.

▲ walrus01 13 hours ago | parent | next [-]

I would also note that for people who want to download these models, you can find MLX versions of just about everything popular on huggingface these days. For instance go look at the "main" page for Qwen 3.6 35B-A3B and then follow the link to quantizations, and pick one of the more popular/reputable MLX variants.

https://huggingface.co/Qwen/Qwen3.6-35B-A3B

▲ simonw 14 hours ago | parent | prev | next [-]

I was so excited when I saw "blaizzy" in the domain, because Prince Canuma's work around MLX has been of such uniquely high quality.

	▲	T0mSIlver 6 hours ago \| parent \| next [-]
		[flagged]
	▲	justatdotin 13 hours ago \| parent \| prev [-]
		Hi Simon, sorry to spam your comments but 7 months ago you asked me for a media report to back a claim I made and this week it finally arrived. perhaps a little late to be very useful to anyone who maintains that gating function, but here nonetheless: https://ntindependent.com.au/scientist-says-ministers-pole-f...

▲ rahimnathwani 16 hours ago | parent | prev | next [-]

  Would be totally unsurprised if those modalities and models get integrated into this UI.

Yup, the GitHub repo says:

  Support for dedicated audio-only and image-generation-only models is coming soon.

Prince Canuma is super-responsive on X and GitHub issues, and I use mlx-audio almost daily with mlx-community/Qwen3-TTS-12Hz-1.7B-Base-bf16 (for voice cloning).

▲ trollbridge 18 hours ago | parent | prev | next [-]

Thanks for that. My first question was “What does this do that Unsloth doesn’t?”

▲ layla5alive 6 hours ago | parent | prev | next [-]

Prince CacheAsNUMA? Nice :)

▲ recursivegirth 16 hours ago | parent | prev | next [-]

LM Studio is trash on Windows / Linux... guess that makes sense...

	▲	Forgeties79 25 minutes ago \| parent [-]
		What makes it trash on Linux? I’m a pretty casual user myself so my guess is I haven’t bumped against these limitations. I also don’t have high expectations as I’m running it on a 9070 lol

▲ Der_Einzige 5 hours ago | parent | prev | next [-]

Switching to mlx-vlm is basically harmful since it (like vllm and sglang) have such garbage support for modern samplers. To be clear, I am one of the authors on the min_p paper, and if min_p is the best you have (when llamacpp supports the far superior top-n-sigma), than I have no reason to switch even if you are somehow faster.

(https://arxiv.org/abs/2411.07641)

And if you do care to support modern samplers, you can start with the following:

1. https://arxiv.org/abs/2509.23234

2. https://arxiv.org/abs/2509.02510

3. https://arxiv.org/abs/2604.11012

	▲	woadwarrior01 3 hours ago \| parent [-]
		Thanks for bringing this up. You're 100% right. But most people, even technical ones are oblivious to how much of a difference modern samplers and higher quality quantization algorithms make for on-device LLM inference and are stuck with good old top-p, top-k samplers and RTN quantization. TBF mlx-vlm does support min-p sampling, but none of the other modern samplers that you list. Ollama and LM Studio are even worse with only top-p and top-k samplers.

▲ carterschonwald 14 hours ago | parent | prev [-]

its a wrapper around mlx, so thats gonna be the portability bottleneck