Also, while we don't have made statues that old, we do have manuports from 2-3 million years ago: https://en.wikipedia.org/wiki/Manuport

Manuports are natural rocks in "funny" shapes, like faces or falluses, which are found back (far) out of place and often in the neighbourhood of other human remnants.