Have you tried Xiaomi's MiMo v2.6? It's remarkably good -- and very weird/idiosyncratic. (For instance, it can compose MIDI-style music directly via the chat app, and it follows instructions much more closely than any other music model. AFAIK nothing else does this.)

I haven't had much experience with ERNIE, but I've been using various different (Chinese) base models of late, and I'm excited to try it.