You can `jj file untrack` instead of that mv bit.
Oh neat, thanks! I (clearly) did not know that command.