I grew up in a house with little to no sugar and never really developed a "craving" for sugar. I'll absolutely eat it if it's there, but really only consume it if it's zero effort, and generally in small amounts since many sweet things taste overly sweet to me.

There is a genetic component to disinterest in sweet food. It quite evidently runs in some families. These are people who never eat any sugary food or often even fruit regardless of availability because they actively dislike things that taste sweet. It isn't a matter of environment or self-control. To them, a donut is about as enticing as a bowl of plain oatmeal.

Anecdotally, people that don't eat any sweet food always seem to gravitate toward salty/bitter flavors instead.

Unclear whether this is due to environment (grew up with no sugar) or genetics (parent‘s genes induced no sugar craving -> you have no craving).