| ▲ | modeless 9 days ago | |
Cool, what software? | ||
| ▲ | asabla 9 days ago | parent [-] | |
Initial testing has only been done with ollama. Plan on testing out llama.cpp and vllm when there is enough time | ||
| ▲ | modeless 9 days ago | |
Cool, what software? | ||
| ▲ | asabla 9 days ago | parent [-] | |
Initial testing has only been done with ollama. Plan on testing out llama.cpp and vllm when there is enough time | ||