| ▲ | vlowrian 4 hours ago | |||||||
Or an abstract AI infrastructure factory? | ||||||||
| ▲ | mikepapadim 4 hours ago | parent | next [-] | |||||||
https://github.com/beehive-lab/jitllm there is already an vllm-like inference engine that uses tornadovm as the GPU backend all written in java | ||||||||
| ▲ | keeda 3 hours ago | parent | prev | next [-] | |||||||
That’s probably the next thing after Software Factories. | ||||||||
| ▲ | kitd 3 hours ago | parent | prev [-] | |||||||
I'll be disappointed if this isn't named AbstractAiInfrastructureFactory | ||||||||
| ||||||||