Remix.run Logo
verdverm 6 hours ago

Unconvincing, I use this model for agentic work, and while it's obviously not as good, this person is using their personal setup and experience as a justification.

1. Mac is slow at prompt processing, the Spark is much better for coding. Most of the time in coding is spent in prompt processing.

2. DFlash addon improves tgen speed 2-3x. (https://huggingface.co/collections/z-lab/dflash)

3. Harness matters, they gave no indication of what they are using. (likely an entire post just to describe a good setup)

The low, double-digit billion param models have improved vastly, notably earlier this year. I'm personally excited for the next iteration later this year because everything keeps getting better. The DFlash addons are a pure computational performance boost, there will be capability improvements later this year in this size range.