From [0]:

"When we can reproduce a common set of papers on 1 NVIDIA GPU 2x faster than PyTorch. We also want the speed to be good on the M1. ETA, Q2 next year."

[0] https://tinygrad.org/#tinybox