It seems that you do lose a life when hit by an enemy or falling in a pit, but the latter freezes until you click the toggle sound button, and running out of lives resets the counter to 3 and halves your "valuation".