I've seen that, but I just wasn't sure if that also works for IPv6.

According to their own docs, it seems to work for at least OpenVPN:

> Those not using the Mullvad client program can just add the directive "tun-ipv6" to their OpenVPN configuration file.

Yas. When you download the config files you can choose between IPv4 and IPv6