This is the opposite of my experience.

I went from a D300s kit with about $10k of lenses to Fuji. I had an X100s, then an X-E2, and now an X-Pro3.

The X-Pro3 especially is light, has excellent physical controls, and very much feels like a vintage Leica. It's what I'd consider an "art camera" -- not what I'd choose if I were shooting weddings regularly, but perfect for street photography, family stuff, and perfectly capable of higher-end commercial work if you're willing to put up with its quirks.

The quirks are the point, though.