| ▲ | novok 5 days ago |
| That is functionally much harder to pull off than software because model weights are essentially more like raw media files than code, and that is much easier to convert to another runtime |
|
| ▲ | firesteelrain 5 days ago | parent [-] |
| Codeium had an airgap solution until they were in talks with OpenAI and pulled it back. It worked on prem and they even told you what hardware to buy |
| |
| ▲ | novok 5 days ago | parent [-] | | You can still extract the model weights from an on-prem machine. It has all the same problems of media DRM, and large enterprises do not accept unknown recording and surveillance that they cannot control | | |
| ▲ | firesteelrain 5 days ago | parent [-] | | I am not sure what you mean. I work at a large Enterprise and we did not unleash it on our baseline and it couldn’t phone home but it was really good for writing unit tests. That sped things up for us. |
|
|
