Human bodies are highly efficient at certain movements, e.g. walking. There's also a complicated part of hunter gatherer life style where you don't know if you'll find something if you walk another mile, so often the response is to just... not do that.

Being able to have a life style where you're constantly expending energy, like training athletes do, really only works if you're guaranteed food, which is generally not how hunter gathering works.