I just want a regular (non-reverse) geocoding system that's actually easy to self-host.

Windows CE apps were doing this 20 years ago with single file databases of only a few GBs, why do I need a 500GB+ postgres monster to do the same thing today?

Have you tried MOTIS with only the geocoding enabled? This should be 1-2 orders of magnitude smaller.