If "we" means everyone, yes. But the reality is there is a sufficient number of people willing to work more to earn more, and therefore they will raise prices of everything which destroys your purchasing power.

Your purchasing power is defined in a competitive equilibrium with your peers.

If you're assuming you can band everyone together to all decide to work fewer hours for the same pay, fine, but you just invented a union, not an improvement to UBI.