The UI of OrbStack is probably one the biggest features, so a replacement without the UI doesn't make a ton of sense for most people that like OrbStack.

Podman has this built-in, and there is an optional UI called Podman Desktop.