Yes, that's why good datasets are important. But usually the difference between model generations is architectural improvements

late training is where a lot of capability gains come from too