| ▲ | apitman 7 days ago | |
Did you test multi-user cases? | ||
| ▲ | jasonjmcghee 7 days ago | parent [-] | |
Assuming this is equivalent to parallel sessions, I would hope so, this is like the entire point of vLLM | ||
| ▲ | apitman 7 days ago | |
Did you test multi-user cases? | ||
| ▲ | jasonjmcghee 7 days ago | parent [-] | |
Assuming this is equivalent to parallel sessions, I would hope so, this is like the entire point of vLLM | ||