As long as you don't bring up politics, religion, or money, you would be hard-pressed to make it so bad you wouldn't be able to stay or even come back. If things are SUPER awkward, just move to the other side of the gym or go to the bathroom for a little bit (~5-10m or so) then feel free to return, just don't talk to that person again other than a simple "hi" if warranted.