The latest SSDs benchmark at 3GB/s and up. The marginal latency would be trivial compared to the inference time.