I should have noted that it's a built in dividing head that turns the part between starts.

Any time you let go of a part you're going to have to re-locate it before you start cutting again, and you will lose accuracy in the process.