Remix.run Logo
androiddrew 3 hours ago

Thankfully, there are still people willing to jump on the R9700 bandwagon and get a vLLM fork working. If you have an RDNA4 card check out https://hub.docker.com/r/stilldeadcode/vllm-radiance

intothemild 2 hours ago | parent [-]

Deadcode is currently working on INT4 right now on his R4D kernel.

The MXFP4 fork is excellent too. Its my daily driver right now. https://codeberg.org/ggz14/radiance-vllm-mxfp4

Also has PARO quant support there too (early stage)

Also speedups in both repos for 4x R9700s