Remix.run Logo
rfw300 17 hours ago

I've no problem with the intuition. But I would hope for a lot more focus in the marketing materials on proving the (statistical) correctness of the implementation. 15% better inference speed is not worth it to use a completely unknown inference engine not tested across a wide range of generation scenarios.

lukebechtel 14 hours ago | parent | next [-]

This is a fair critique! We plan to use our system to generate many more inference libraries of this nature, and I'll make it a point to release better, broader correctness measures when we do so.

LuxBennu 4 hours ago | parent | prev [-]

[flagged]