I'd say 100-200 ms is not horrendous but it can be much better without giving up on libghostty-vt :) check out Monstar.

Now, Monstar has a bizarre issue (at least in my setup) where it displays blank instead of capital A when used with Fixedsys Excelsior, for some reason. But hey it starts in under 10ms.

edit:typo