Does matlab these days do stuff like JIT operator fusing to avoid memory roundtrips and take advantage of FMAs?

Yes: https://www.mathworks.com/help/fixedpoint/ref/half.fma.html

I'm grateful that Go a non-proprietary language offers these features.