The problem will solve itself in one election cycle

Yeah that's pretty unlikely because it's hard to organize people for candidate B just based on one point of dissatisfaction with candidate A, especially when votes against candidate A can be easily split and Candidate A uses their incumbent advantage to claim credit for any and all positive outcomes.