Remix.run Logo
simonw 5 hours ago

I had preview access to this one for a few weeks. It's very good. I had one conversation that lasted a full hour while I was walking the dog, got some good brainstorming done against one of my projects.

The best feature is that it can delegate questions out to GPT-5.5 in the background, so you're no longer restricted to a voice model that's several years behind the frontier.

I did report a fun bug with it though: it was interrupting me and laughing at my (not really intended as) jokes while I was still talking! They seem to have clamped that behavior down thankfully, it felt a bit rude and condescending.

100ms 5 hours ago | parent | next [-]

Is it responsive to personality settings? I actively don't want fake AI girlfriend, but I do get a ton of value out of voice mode. Looking forward to trying this but hoping it's not a creepy overdone mess (like Sesame). Expectations are they'll keep doubling down on fake AI girlfriend approach because the thing I want probably wouldn't drive engagement anywhere nearly as well

Someone1234 4 hours ago | parent [-]

I too found this with their previous attempts.

I have my Chat personality settings stripped right down to no-fluff. I'd want voice to be more akin to the Star Trek computer, and less akin to as you said an AI friend, but previously it was tuned too personable/friend-like.

100ms 4 hours ago | parent [-]

Star Trek computer voice model is something I have yet to encounter, and I've looked repeatedly :) It's not about a specific voice, it's the fact they managed to capture "I am a utility" perfectly in the voice. Our modern friends do not want to be thought of as a utility, but to engender trust and agency all of their own and that's a huge problem for me.

100ms 2 hours ago | parent | next [-]

I thought to try voice cloning with dots.tts ( https://huggingface.co/spaces/rednote-hilab/dots.tts ), the result is pretty good, but likely wouldn't be fast enough to use on a quasi-realtime basis:

Input clip: https://vocaroo.com/19QtEPtwTjOS

Prompt text: There are 14 varieties of tomato soup available from this replicator. With rice, with vegetables, Bolian style, with pasta specify hot or chilled.

Output: https://vocaroo.com/1f3XuQQoSzwB

jldugger 2 hours ago | parent | next [-]

I think the request here is not about sounding like Majel Barrett but in keeping the output extremely terse and unobtrusive.

There's been a few studys showing that novices love LLM output that's long, but experts hate it. As an example, I've been tasked with using some agentic PM tool to write specs, and it keeps generating these huge page long outputs with "HBR voice" bolded summaries of paragraph long bulletpoints. I.e.:

> Right-size hard, and watch the one open-ended edge. Endorse the DRI's simplifications wholesale: drop the runbook-per-alert mandate (keep 1–2 diagnostic-only runbooks for the high-priority set), and ride durability on the existing weekly incident + monthly operational reviews — no new governance. The single scope-creep risk is the coverage strand (gaps are defined by absence); bound it to gaps evidenced by real, already-missed customer-facing outages, not a proactive gap hunt. Curing ownership gaps (e.g. foo-bar, no clear owner) is finite in-scope work.

There's dozens of these every iteration. I can't imagine trying to deal with that via voice, I would just zone out after the second sentence.

bityard an hour ago | parent | prev | next [-]

I'm just going to say, Wow. That's a pretty incredible result. I had no idea you could clone a voice with such a short snippet of audio these days.

I've had this dream of talking to the Enterprise-D computer since I was 8 years old. Midlife-crisis me still has that dream, but hooked up to Home Assistant so it can actually do useful things too. A couple months back, I went looking around for "clean" samples of Majel's voice as the computer but didn't have a lot of luck. Even though there are three television series and several movies, pretty much all of them have some amount of background noise, bleeps, bloops, or warp core thrum. (As this one does.) There may be modern ways to clean those up without affecting her voice much, but I haven't dug into that yet.

There are a few audiobooks narrated by Majel Barrett but obviously her role as the computer was proper voice acting and so the books would not be good source material.

There were also a few games/CD-ROM (Omnipedia) with some samples, but they did not bother to post-process them for that lofi Enterprise-D computer feel. Can _probably_ be replicated fairly faithfully after the fact, but I only know a _little_ about audio post-processing.

According to her son (Rod Roddenberry), Majel sat down in a studio and recorded audio samples specifically for the purpose of having her voice cloned someday for future Star Trek stories. However, those haven't been released publicly. (And likely never will, but I can dream, can't I?)

Edit: I played with your samples and the time it takes to generate the output audio is pretty brutal. Too slow for interactive use. Maybe that's a limitation of the HF-hosted app, though.

pseudosavant 40 minutes ago | parent | prev [-]

That is pretty incredible with such a small amount of input. Makes me want to check out dots.tts myself!

purpleidea 4 hours ago | parent | prev | next [-]

For many years, I've wanted ED-209 (robocop) voice from something like espeak or similar. Still can't find anything good.

Not for chat, just as a way to make notification messages that sound like ED-209.

100ms 4 hours ago | parent | next [-]

I think that's mostly just a frequency shift :) You could probably recreate it with another model and some effects on top. Also, why the hell not for voice mode haha.

bitwize 4 hours ago | parent | prev [-]

One popular speech synth from back in the day, I believe it was WillowTalk, had a voice called Colossus, which sounded like the voice module of the computer from Colossus: The Forbin Project. This voice was used for that of CATS in the famous "All your base are belong to us" Flash video.

Another WillowTalk voice was a clone of DECtalk's Perfect Paul good enough to be used as the voice in the MC Hawking rap recordings.

pdntspa 3 hours ago | parent [-]

I am having a hell of a time googling for WillowTalk, do you know any links/places where I can learn more? Maybe even download something?

andai 3 hours ago | parent | prev [-]

I just tell them to talk like Jarvis. I tried the "cold logic" prompt but it turned them into a bunch of assholes.

jacobgold 4 hours ago | parent | prev | next [-]

> "The best feature is that it can delegate questions out to GPT-5.5 in the background, so you're no longer restricted to a voice model that's several years behind the frontier."

Wow. That's exactly what I hoped they would do.

This issue has held me back from using ChatGPT's voice mode as much as I otherwise would have, because I also use it for brainstorming while commuting, exercising, etc., and don't want it to feel stuck in the past.

alexellisuk 3 hours ago | parent [-]

Funnily enough - I built this (delegation) over the weekend with Fable for a local voice chat running 100% on local LLMs, Parakeet and Kokoro. I say "...ask the thinking model..." and that redirects it to Qwen 3.6 27B on vLLM.

Can't claim originality though - it was inspired by Sesame - where their models will invoke a search, or check the weather etc, and make a vocalisation to keep you engaged.

Turn taking is one of the hardest things to get right for the exact reasons mentioned - but does seem to be the way that Claude.ai's voice works - in a very obvious way.

Anthropic + OpenAI both rug-pulled voices I liked and got used to and OpenAI really dumbed down their voices at the same time - Arbor went from Estuary English and almost "jack the lad" to some generic English accent. Claude had a Birmingham accent and said things like "shit", ending sentences like "So you're telling me that they asked for a 90% discount yeah?" - then it changed overnight to a mock Derbyshire accent with a dull tone.

ChatGPT's voice also gaslights me for conventional opinions - "my Eastern European neighbour helped me lift a wardrobe upstairs - something you just can't ask your typical neighbour neighbour"... then you get a full on left-leaning lecture from the safety layers rather than a head nod or "what luck!"

Claude + Sesame are nowhere near as overbearing.

In both cases - from edgy and engaging to something that just didn't gel.

The point of making my own assistant is that I can talk for as long as I want, episodic memory is personal and private, there's no "trust me bro, we're a big corporation" vibes.

This was not my first attempt - when I had a bunch of Opus credit around Jan/Feb - I tried really hard and created something that was not good enough. What I have now, is working, and each session is training Claude/Codex on what to tune, and to fix.

"Just had a convo - can you look into what happened?" And if it's one I don't mind sharing with the model - I'll say, "and what did you think of the questions I asked?" Sometimes it'll give a lovely commentary on how the model did.

af_heart is probably the smoothest voice - but yes it's more like another commented - more "StarTrek" than "telesales assistant that pauses and laughs at your jokes".

If you're on a similar path and want something full duplex - the go to solution is PersonaPlex from Nvidia based upon Moshi.

jjulius 4 hours ago | parent | prev | next [-]

I highly recommend simply enjoying the walk.

sauwan 4 hours ago | parent | next [-]

I think you're missing the counterfactual. I now have two choices: 1) sit behind my desk and work, or 2) walk and talk something out.

Before this model, the voice models were pretty dumb and annoying to work with. We'll see if this changes that.

supern0va an hour ago | parent | prev | next [-]

Every time something along these lines is posted, comments like this show up.

The thing I don't get is...no one would say this about listening to a podcast or audiobook on a walk.

I'm not sure why people choose to demonize this specific use of time during walks.

jjulius 9 minutes ago | parent [-]

> ...no one would say this about listening to a podcast or audiobook on a walk.

Just for the record, I would say the same thing in that situation.

SequoiaHope 4 hours ago | parent | prev | next [-]

Seems a bit knee jerk. I go on walks and bike rides all the time. A couple of times I’ve used voice mode and it’s been interesting. I could have listened to music or a podcast, listen to YouTube or just unplug. But every walk is different.

If you’re uncomfortable with this new world, and I’m sure I am even as I participate, you could tell us more about that?

derefr 4 hours ago | parent | prev | next [-]

Given the personality type common on HN, I imagine that the GP, even if unplugged from all technology on their walk, wouldn't be in a mindful state of enjoying their surroundings, but rather would be "lost in the clouds", stewing on the same ideas/thoughts/problems; but with those thoughts going more in circles, due to a lack of ability to verify anything.

aliasxneo 3 hours ago | parent [-]

Literally me. Everyone is different, and that's fine. But I don't have the privilege of living in an area where I can talk to people about the things I am thinking through. It's very rural. Having a _utility_ that can act as a sounding board while I spew out my thoughts on a walk is a really meaningful improvement to my current situation.

wat10000 an hour ago | parent | prev | next [-]

Sometimes I want to learn something while I walk. Sometimes I want to listen to stories. Sometimes I want to just be present. All are good. I highly recommend letting people enjoy whatever they enjoy.

danw1979 3 hours ago | parent | prev | next [-]

I often enjoy walking and doing something else at the same time. Usually thinking through a problem…

mock-possum 4 hours ago | parent | prev | next [-]

… but it sounds like they did enjoy the walk, doesn’t it?

altmanaltman 4 hours ago | parent | prev | next [-]

I take my dog for walks everyday and I think she 100% of the times enjoys it but me maybe only 20-30%

brcmthrowaway 3 hours ago | parent | prev | next [-]

One thing has remained constant over the last little period of time. AI boosters have zero taste.

simonw 28 minutes ago | parent | next [-]

I never considered that how I spend my time while walking my dog might be a matter of "taste".

make3 2 hours ago | parent | prev [-]

"AI boosters" when I hear things like that I wonder if people realize how the world is changing and going to change.

we know pretty well at this point that this is world warping technology (either for good or bad), not a small matter of taste.

emp17344 32 minutes ago | parent | next [-]

My god. It’s useful for coding… and that’s it. It’s not going to change the world the way you think.

brcmthrowaway 2 hours ago | parent | prev [-]

> we know pretty well at this point that this is world warping technology (either for good or bad), not a small matter of taste.

And what are you doing about it?

Tadpole9181 2 hours ago | parent | prev | next [-]

I highly recommend not patronizing adults for doing what they want or feel is appropriate when they're walking their dog.

IncreasePosts 4 hours ago | parent | prev [-]

[flagged]

4 hours ago | parent | next [-]
[deleted]
croes 4 hours ago | parent | prev [-]

Isn’t that a life advice?

visarga 4 hours ago | parent | next [-]

That's anti life-advice

croes 4 hours ago | parent [-]

It’s an anti life-advice life-advice

IncreasePosts 2 hours ago | parent | prev [-]

I viewed jjulius' post as a cry for help, therefore I don't consider it unsolicited.

heisgone 5 hours ago | parent | prev | next [-]

Is it a dumb-down version of GPT like the current voice model? At least in french, I find the current GPT voice mode to be useless, to the point I only use the dication mode. I would ask a question and it would answer something along "That's a interesting question. I can help you with that. Anything you want to know about X?" I would ask again and it would answer the same kind of non answer.

KaoruAoiShiho 5 hours ago | parent [-]

Click through to the link, the answer is no it uses the latest gpt models now.

magicalist 4 hours ago | parent [-]

> the answer is no it uses the latest gpt models now.

Actually it says it _can_ delegate to the latest models. Seems reasonable to ask how the voice model does when it doesn't delegate (or while waiting for the delegated answer).

derefr 4 hours ago | parent [-]

I haven't stress-tested it, but I would imagine it approaches complex problems the same way a human with a phone in their pocket would — that is, by having a degree of awareness of the confidence it has in its own knowledge in some areas; where, when it "realizes that it doesn't know", it blocks the conversation with statements like "I don't know, let me check."

I say this because this is already how ChatGPT works internally when using its "auto" mode; the version of the "fast" model used in the "auto" mode does the same "notice your ignorance and bring in the heavy model" thing, just silently, rather than mentioning that it's doing it.

(If someone has actually run the experiment, please chime in!)

solarkraft 3 hours ago | parent | prev | next [-]

I love the UX of voice mode. I’ve always hated voice models.

Gemini’s being particularly egregious (always ending in some deranged question, can not reliably be prompted away) prompted me to build my own client for my real harness that simply does STT -> model -> TTS (both being independently useful).

I guess I see some value in a model responding quickly and with more nuance, but it’s not much. I can wait for it to finish. I’d much rather have it be actually useful. I’m not looking for a digital friend.

The delegation feature lets me see some value in a voice model for orchestration type features. But in either case, I don’t really like (or understand why others would like) talking to a model with different features and quirks just because I’m using a different medium to communicate over.

ben_w 4 hours ago | parent | prev | next [-]

> I did report a fun bug with it though: it was interrupting me and laughing at my (not really intended as) jokes while I was still talking! They seem to have clamped that behavior down thankfully, it felt a bit rude and condescending.

Some times I'm still amazed that AI "gets" humour much more effectively than the character of Data did before his emotion chip, e.g.: https://www.youtube.com/watch?v=G4VZ5kQIdV0

Other times I'm amazed in the opposite way, that the script writers cover basically the same talking points about the character as we have today about LLMs, e.g.: https://www.youtube.com/watch?v=GBJCYHwyZhw

peab 2 hours ago | parent | prev | next [-]

>The best feature is that it can delegate questions out to GPT-5.5 in the background, so you're no longer restricted to a voice model that's several years behind the frontier.

Ahh, this makes sense. I was wondering when they would start doing this. I stopped using voice mode all together because it was frustrating talking to a dumb AI, when most of the time I discuss things with Opus 4.8 or gpt 5.5.

I was working on a phone call agent recently, and thought about doing this. It makes sense

dajonker 5 hours ago | parent | prev | next [-]

But does it generate good pelicans?

BeetleB 4 hours ago | parent | prev | next [-]

I should give these voice models another try.

I have friends who have brainstormed with an LLM (voice chat) for 10-30 minutes, and reported very positive experiences.

When I speak to one - while I'm impressed at how far they've progressed - the LLM just doesn't talk like someone I'd want to discuss a technical problem with (the way I would with a human).

(And my friends aren't even using a custom prompt - some of them are just talking to the default Gemini on their phone!)

solarkraft 3 hours ago | parent [-]

I also love exploring ideas like this. The problem that made me stop using Gemini is that it would always try really hard against all my prompting to ask a stupid question at the end of its response that would completely derail my train of thought.

fy20 3 hours ago | parent | prev | next [-]

Does it have full access to your chat history, project files, etc? That's the biggest limitation I have with voice mode right now, if I ask it about something I chatted about before (even in the same conversation) it has zero recollection of it.

simonw 2 hours ago | parent [-]

You can start a chat in an existing session after pasting data into that session and it can then talk about that content. I haven't tried it with projects.

jr3592 19 minutes ago | parent | prev | next [-]

does it work in codex?

FlamingMoe 5 hours ago | parent | prev | next [-]

Cool, was this conversation through the chatgpt app?

simonw 5 hours ago | parent [-]

Yes, ChatGPT on iPhone.

athyuttamre 5 hours ago | parent | prev | next [-]

Thank you for testing and the feedback Simon!

scottyah 4 hours ago | parent | prev | next [-]

Have you compared it to grok in teslas?

amarant 4 hours ago | parent [-]

Wait, you can talk to Teslas now? How did I miss thiS? Can I get a red led bar and basically have a KITT?

nunez 3 hours ago | parent | next [-]

Yes! Hey Grok was shipped to all Ryzen-based Teslas a year ago, I think. I don't use it but those that have found it useful.

tough 4 hours ago | parent | prev [-]

the cybertruck seems designed for this KITT fantasy of yours

amarant 3 hours ago | parent [-]

Dammit! I live in Europe and the cyber truck isn't even available here..

That said a huge pickup truck is about as far as you can get from a Camaro... Then again I'm not exactly David Hasslehoff myself either... Meh if it talks that's close enough!

squidsoup 44 minutes ago | parent [-]

> Dammit! I live in Europe and the cyber truck isn't even available here..

Europeans are notorious for their good taste.

mrits 5 hours ago | parent | prev | next [-]

About 2 years ago I used to have conversations with GPT while walking the dog. It really emphasized the need to think before you speak, but you had to think fast before it hung up on you.

themadhouseofel 3 hours ago | parent | prev | next [-]

[dead]

lesinski 4 hours ago | parent | prev | next [-]

[flagged]

pseudosavant 4 hours ago | parent [-]

That is a nice idea and all, but perhaps there are things our friends aren't good at talking about. Perhaps something that is very related to a work project? Or like when I go down the rabbit hole discussing quantum mechanics and astro physics with ChatGPT because none of my friends understand that at even my level, and I'm looking to learn more about it from someone/something that does know more than me.

I'm looking forward to trying this out because I find that doing discovery on certain things feels more natural with voice. The previous voice chat was such a dumb GPT-4 era model that I resorted to using the dictate feature with GPT-5.5 and had it read the text response back to me.

jvdsf 4 hours ago | parent | prev [-]

Sam, is that you?