Remix.run Logo
▲ mikepapadim 4 hours ago

https://github.com/beehive-lab/jitllm there is already an vllm-like inference engine that uses tornadovm as the GPU backend all written in java