I work at AWS (disclaimer opinions are my own, do not reflect views of my employer) and i think the existence of a leaderboard has led to folks gamifying it. People see peers in a higher tier on the leaderboard and start burning tokens to catch up.

I think the company realizes this and is actively trying to avoid this, since for the new tools there isn't a leaderboard.

Right, the leaderboard is internal.