Careful about "never"… individual transistors used to be large, heavy, power hungry, and expensive.

That's not true. Transistors were commercialized a few years after their invention, and already the first generation vastly outperformed vacuum tubes in size, weight, and power. Optical computing has been done for a few decades now with very little progress.