| ▲ | bryzio 4 hours ago | |
Or abstract i.e. openrouter, that reduces the risk vector to "all implementations have been simultaneously banned". If a government entity bans a LLM provider due to a jailbreak concern, they can also ban an on-prem solution under the same guise. The jailbreak risk exists regardless of where it's hosted. You could defensibly argue the on-prem risk is higher since frontier model companies can justify safety spend due to their size, it's more difficult to combat bad actors if you're company is the only one using the model and you don't have economies of scale. | ||