you can also win a lottery

At least 10^7 people have refinanced their homes at lower rates, while only 10^5 people have won the lottery. So refinancing is substantially more likely than lottering.