You need to hover the heart in the middle, not just the card.