Remix.run Logo
▲ jaykru 16 minutes ago

Carbon 4 has been incredible for my use, tuning a local inference engine based on tinygrad running on Tenstorrent hardware. I had a barely functional prototype I built with Claude that petered out at an unusable level of performance. Astra and Sol didn't make much progress when I pointed them at it. Carbon 4 more than 10x'd the prefill and doubled the decode performance on Qwen 3.8 27B without breaking quality or the generality of the stack. Very nice to see competition at the frontier again.

▲atomashevic 3 minutes ago | parent [-]

Just curious, what TT hardware do you have? How many tps did you achieve with Qwen 3.8 27B?