Yes it definitely can diverge while still staying open source. Happens in the Linux kernel for example whenever the ABI changes.

It can, and has in the past, diverged from the baseline Linux kernel, but not from “the last open Android kernel” as it must remain open source per GPL.