does that mean someone was paying into your social security, essentially boosting your benefit amount when the time comes?

If you don't dispute it, yes. However, if you don't dispute it, IRS knows about it as well and will be asking for their cut. Generally, the benefit increase is not worth higher taxes.