With quantization, converting it to an MOE model... it can be a fast walk