Yes, that is in fact how Elo can work[0]. There are quite many ways Elo systems can work.

[0]: https://en.wikipedia.org/wiki/Elo_rating_system