Are you sure yours isn't broken? My daughter has an M4 and she does hefty biochem stuff on it. No beachballing or anything. Same with my M4 Pro.
Also airpods move instantly here. No issues.