I thought after the DVD era surely we'd get something more akin to SD cards or flash drives instead of more discs, really disappointed we ended up with Blu Ray.

This is because blurays, like vinyl records, are efficiently stamped into plastic from metallic masters with negligible faults. You can't do this for electronic storage.