Remix.run Logo
▲ HotHotLava 6 hours ago

Just open weights are not enough, I think as a nation state you'd at least want a whole sovereign training pipeline. Otherwise you are stuck when Kimi K4 stops releasing their weights.

But I don't see why this needs to be done on a state-by-state level, a sovereign EU model seems to be much more realistic in terms of funding.

▲rixed 5 hours ago | parent [-]

Wouldn't you also want to be able to manufacture some sort of GPU?

▲DoctorOetker 3 hours ago | parent [-]

I actually think we should be revisiting PMT photomultipler tube construction, and electron-"optical" matrix multiplication.

The annoying part of optical matrix multiplication is the conversion from electronic to optic and back.

Why not use electron-optics for matrix multiplication and use dynodes for amplification.

▲pstuart 2 hours ago | parent [-]

While an intriguing concept, that doesn't sound like it could scale to the amount of "cores" needed to do the work. Or am I missing something?