You know English doesn't work like that. The word you're saying only becomes clear with the surrounding context. Eg, 'there' vs 'their'.

▲

nilslindemann 12 hours ago | parent | next [-]

It may be interesting to have it immediately insert the words, even if they are wrong, and when a sentence is finished, replace what has been written with the final corrected sentence.

▲

atonse 12 hours ago | parent | next [-]

Google released this awkwardly named app called edge eloquent recently that does exactly that.

In fact, it cleans up the entire paragraph that you just said, and even if you have meandering thoughts, it cleans those up too.

Actually, this above statement was fully dictated with iOS and it added all the punctuation automatically, so I think that iOS is also doing some of this natively. In fact, I’m on the iOS 27 beta and it seems to be doing an even better job of correcting itself and correcting earlier words and adding punctuation too.

▲

remuskaos 10 hours ago | parent | next [-]

This sounds fantastic, but I'm utterly surprised that Google, of all companies, only releases this for macOS and iOS, but not Android.

	▲	atonse 7 hours ago \| parent [-]
		It’s an awkward app and the whole interaction just feels weird and kind of slapdash. I think it is meant to be a prototype. But in this day and age it’s easy enough to at least write the iOS and Android versions. But maybe not dealing with the play store.

▲

mft_ 9 hours ago | parent | prev [-]

I tried this on my Mac soon after launch and it was consuming a significant amount of processor cycles even just sitting idle in the menu bar. (From memory, ~20% of an M1 Max.)

It may have been an early issue but with no obvious way to interact and report the issue and, eh, Google’s general attitude around customer satisfaction, I just gave up and deleted it again.

▲

abdullahkhalids 3 hours ago | parent | prev | next [-]

In fact, a few apps I have tried do exactly this inside the app themselves. There is a live textual field that displays whatever the model thinks, and this display constantly goes back and fixes earlier words.

So I know it's possible. I just want to integrate this with the paste-at-cursor feature that these apps have. I imagine the app would have to create a virtual keyboard and use backspace or arrow keys to go back and change things.

▲

8 hours ago | parent | prev [-]

[deleted]

▲

atonse 12 hours ago | parent | prev | next [-]

But this is still possible to do if you track the whole run of text. You could replace all of it each time so it LOOKS like it’s streaming but earlier words also change. I’m hoping the streaming models do this eventually.

I believe the built-in iOS dictation already does this.

▲

kristiandupont 11 hours ago | parent [-]

What would be the benefit of this, besides from looking cool?

▲

atonse 11 hours ago | parent | next [-]

More accuracy. Like others have said, homonyms (their, they're, there) is easier to determine once you have more context. So then you may need to go back a couple words and update them.

Same with punctuation, you could determine that a comma belonged in a certain place once you have enough words.

▲

knowknowledge 11 hours ago | parent | prev [-]

In iOS this means you can edit the text as it’s being transcribed. For example, I want to dictate a todo list and after each item I can hit enter to go to the next line.

	▲	yorwba 9 hours ago \| parent [-]
		Do the parts before you hit enter still get updated if later context indicates you said something else?

▲

PhilippGille 12 hours ago | parent | prev | next [-]

Handy already supports streaming transcription models, and you can see the words in the small Handy pop-up while you are talking.

So in general this definitely works. Handy is just missing the feature to insert these streamed words into the app where the cursor is.

	▲	regularfry 11 hours ago \| parent [-]
		I suspect the hard bit is that it sometimes needs to back up and redo, and that's an interface they haven't got figured out. I'm fairly sure I remember Dragon Naturally Speaking doing it in Word years ago though, so the interfaces should be there.

▲

dostick 12 hours ago | parent | prev [-]

Model should be able to understand where logical sentence ends, to stop buffering, and optionally rewrite some of the test that has already been output.

	▲	samplifier 12 hours ago \| parent [-]
		IIRC that is exactly how Dragon Naturally speaking did it decades ago.