Actually yes because context is kept on kV cache
you cannot transfer KV cache from one model to another