TBF, human burial sites are a dime a dozen. There's relatively few locations associated with house elf remains.
None, to be precise.
They didn't say the location contained them, just that it was associated with them, which obviously it is for at least some fraction of the population.