| ▲ | tomrod 6 days ago | |
Self-hosting takes either cloud- or on-prem-engineering chops, which are in short supply. In my view, that becomes the primary driver for lowering token costs. Secondary are the alternative model sources like Z.ai and Moonshot, which between open weights and lower prices help to drive commoditization. But there is a political risk with these, for example, Z.al is on the U.S. Department of Commerce Entity List, which blocks American companies from selling advanced technology and goods to the firm. | ||