Remix.run Logo
potatoman22 3 days ago

From what I can tell, their official chat site doesn't have a native audio -> audio model yet. I like to test this through homophones (e.g. record and record) and asking it to change its pitch or produce sounds.

dragonwriter 3 days ago | parent | next [-]

“record and record”, if you mean the verb for persisting something and the noun for the thing persisted, are heteronyms (homographs which are not homophones), which incidentally is also what you would probably want to test what you are talking about here (distinguishing homophones would test use of context to understand meaning, but wouldn’t test anything about whether or not logic was working directly on audio or only working on text processed from audio, failing to distinguish heteronyms is suggestive of processing occurring on text, not audio directly.)

bakeman 3 days ago | parent | next [-]

There are homophones of “record”, such as:

“He’s on record saying he broke the record for spinning a record.”

dragonwriter 3 days ago | parent [-]

True.

OTOH my point that the thing being suggested to be tested is not testable by seeing whether or not the system is capable of distinguishing homophones, but might be by seeing whether or not it distingishes heteronyms still stands. (The speculation that the record/record distinction intended was one that is actually a pair of heteronyms and that the error was merely the use of the word “homophone" in place of “heteronym”, rather than the basic logic of the comment is somewhat tangential to the main point.)

potatoman22 2 days ago | parent | prev [-]

Ah I meant heteronyms. Thanks!

sosodev 3 days ago | parent | prev | next [-]

Huh, you're right. I tried your test and it clearly can't understand the difference between homophones. That seems to imply they're using some sort of TTS mechanism. Which is really weird because Qwen3-Omni claims to support direct audio input into the model. Maybe it's a cost saving measure?

sosodev 3 days ago | parent | next [-]

Weirdly, I just tried it again and it seems to understand the difference between record and record just fine. Perhaps if there's heavy demand for voice chat, like after a new release, they load shed by using TTS to a smaller model.

However, It still doesn't seem capable of producing any of the sounds, like laughter, that I would expect from a native voice model.

potatoman22 2 days ago | parent | prev [-]

To be fair, discerning heteronyms might just be a gap in its training.

djtango 3 days ago | parent | prev [-]

Is record a homophone? At least in the UK we use different pronunciations for the meanings. Re-cord for the verb, rec-ord for the noun.

potatoman22 2 days ago | parent [-]

I was mistaken about what homophone means!