Remix.run Logo
▲ fhn 17 hours ago

Just compile for your specific hardware sort of like what Gentoo does. I don't want you continuously running a model - sort of defeats the purpose of performance gains.

▲laginimaineb 16 hours ago | parent [-]

That gets you nowhere near the same level of acceleration.

▲tomxor 3 hours ago | parent [-]

For claims of up to "2x" it certainly can do, but depending on the application and hardware, just like this.

It's not clear to me from the article if the comparison is with locally compiled binaries, that would be the fair comparison.

I would expect this to be better all rounder in theory, but it would be interesting to see what the difference is from a locally compiled baseline, and therefore if the complexity, obscurity and cost is worth it (again probably application and hardware dependant question).