That’s for toy GPUs, like the 5090.

there are many tasks (increasingly more each day) where small models are more than enough