I think the "at times" refers to periods of times, have multiple lovers at end of the 1800s and find yourself described as absolutely irredeemable.

Depends where at the end of the 1800s. Belle Époque France saw adultery on the part of men almost normalized among the middle and upper classes, and everyone made use of prostitutes.