Remix.run Logo
paxys 9 hours ago

This spiel is hilarious in the context of the product this company (https://juno-labs.com/) is pushing – an always on, always listening AI device that inserts itself into your and your family’s private lives.

“Oh but they only run on local hardware…”

Okay, but that doesn't mean every aspect of our lives needs to be recorded and analyzed by an AI.

Are you okay with private and intimate conversations and moments (including of underage family members) being saved for replaying later?

Have all your guests consented to this?

What happens when someone breaks in and steals the box?

What if the government wants to take a look at the data in there and serves a warrant?

What if a large company comes knocking and makes an acquistion offer? Will all the privacy guarantees still stand in face of the $$$ ?

3 minutes ago | parent | next [-]
[deleted]
zmmmmm 8 hours ago | parent | prev | next [-]

The fundamental problem with a lot of this is that the legal system is absolute: if information exists, it is accessible. If the courts order it, nothing you can do can prevent the information being handed over, even if that means a raid of your physical premises. Unless you encrypt it in a manner resistant to any way you can be compelled to decrypt it, the only way to have privacy is for information not to exist in the first place. It's a bit sad as the potential for what technology can do to assist us grows that this actually may be the limit on how much we can fully take advantage of it.

I do sometimes wish it would be seen as an enlightened policy to legislate that personal private information held in technical devices is legally treated the same as information held in your brain. Especially for people for whom assistive technology is essential (deaf, blind, etc). But everything we see says the wind is blowing the opposite way.

ajuhasz 8 hours ago | parent | next [-]

Agreed, while we've tried to think through this and build in protections we can't pretend that there is a magical perfect solution. We do have strong conviction that doing this inside the walls of your home is much safer than doing it within any companies datacenter (I accept that some just don't want this to exist period and we won't be able to appease them).

Some of our decisions in this direction:

  - Minimize how long we have "raw data" in memory
  - Tune the memory extraction to be very discriminating and err on the side of forgetting (https://juno-labs.com/blogs/building-memory-for-an-always-on-ai-that-listens-to-your-kitchen)
  - Encrypt storage with hardware protected keys (we're building on top of the Nvidia Jetson SOM)
We're always open to criticism on how to improve our implementation around this.
HWR_14 4 hours ago | parent | prev [-]

> Unless you encrypt it in a manner resistant to any way you can be compelled to decrypt it,

In the US you it is not legal to be compelled to turn over a password. It's a violation of your fifth amendment rights. In the UK you can be jailed until you turn over the password.

drdaeman 3 hours ago | parent | prev | next [-]

> Are you okay with private and intimate conversations and moments (including of underage family members) being saved for replaying later?

Is this somehow fundamentally different from having memories?

Because I thought about it, and decided that personally I do - with one important condition, though. I do because my memories are not as great as I would like them to be, and they decline with stress and age. If a machine can supplement that in the same way my glasses supplement my vision, or my friend's hearing aid supplements his hearing - that'd be nice. That's why we have technology in the first place, to improve our lives, right?

But, as I said, there is an important condition. Today, what's in my head stays in there, and is only directly available to me. The machine-assisted memory aid must provide the same guarantees. If any information leaves the device without my direct instruction - that's a hard "no". If someone with physical access to the device can extract the information without a lot of effort - that's also a hard "no". If someone can too easily impersonate myself to the device and improperly gain access - that's another "no". Maybe there are a few more criteria, but I hope you got the overall idea.

If a product passes those criteria, then it - by design - cannot violate others' privacy - no more than I can do myself. And then - yeah - I want it, wish there'd be something like that.

dbtc 2 hours ago | parent | next [-]

This will not augment memory the way glasses do for sight, this will replace memory the way a wheelchair replaces legs.

shevy-java an hour ago | parent | prev | next [-]

Memories are usually private. People can make them public via a blog.

AI feels more like an organized sniffing tool here.

> If a product passes those criteria, then it - by design - cannot violate others' privacy

A product can most assuredly violate privacy. Just look how Facebook gathered offline data to interconnect people to reallife data points, without their consent - and without them knowing. That's why I call it Spybook.

Ever since the USA became hostile to Canadians and Europeans this has also become much easier to deal with anyway - no more data is to be given to US companies.

drdaeman an hour ago | parent [-]

> AI feels more like an organized sniffing tool here.

"AI" on its own is an almost meaningless word, because all it tells is that there's something involving machine learning. This alone doesn't have any implied privacy properties, the devil is always in the untold details.

But, yeah, sure, given the current trends I don't think this device will be privacy-respecting, not to say truly private.

> A product can most assuredly violate privacy.

That depends on the design and implementation.

encom 2 hours ago | parent | prev | next [-]

>That's why we have technology in the first place, to improve our lives, right?

No, we have technology to show you more and more ads, sell you more and more useless crap, and push your opinions on Important Matters toward the state approved ones.

Of course indoor plumbing, farming, metallurgy and printing were great hits, but technology has had a bit of a dry spell lately.

If "An always-on AI that listens to your household" doesn't make you recoil in horror, you need to pause and rethink your life.

drdaeman 31 minutes ago | parent [-]

> you need to pause and rethink your life.

If you can't think of an always-on AI that listens but doesn't cause any horrors (even though its improbable to get to the market in the world we live on), I urge you to exercise your imagination. Surely, it's possible to think of an optimistic scenario?

Even more so, if you think technology is here to unconditionally screw us up no matter what. Honestly - when the world is so gloomy, seek something nice, even if a fantasy.

qotgalaxy 33 minutes ago | parent | prev [-]

[dead]

BoxFour 8 hours ago | parent | prev | next [-]

It’s definitely a strange pitch, because the target audience (the privacy-conscious crowd) is exactly the type who will immediately spot all the issues you just mentioned. It's difficult to think of any privacy-conscious individual who wouldn't want, at bare minimum, a wake word (and more likely just wouldn't use anything like this period).

The non privacy-conscious will just use Google/etc.

yndoendo 5 hours ago | parent [-]

A good example of this is what one of my family member's partner said. "Isn't creep that you just talked about something and now you are seeing ads for it. Guess we just have to accept it."

My response was no I don't get any of that because I disable that technology since it is always listening and can never be trusted. There is no privacy in those services.

They did not like that response.

dotancohen 2 hours ago | parent [-]

I used to be considered a weirdo and creep because I would answer the question of why don't I have WhatsApp with the answer "I do not accept their terms of service". Now people accept this answer.

I don't know what changed, but the general public is starting to figure out that that actually can disagree with large tech companies.

com2kid 7 hours ago | parent | prev | next [-]

> Are you okay with private and intimate conversations and moments (including of underage family members) being saved for replaying later?

Typically not how these things work. Speech is processed using ASR (automatic speech recognition), and then ran through a prompt that checks for appropriate tools calls.

I've been meaning to basically make this myself but I've been too lazy lately to bother.

I actually want a lot more functionality from a local only AI machine, I believe the paradigm is absurdly powerful.

Imagine an AI reminding you that you've been on HN too long and offering to save off the comment your working on for later and then moving they browser window to a different tab.

Having idle thoughts in the car of things you need to do and being able to just say them out loud and know important topics won't be forgotten about.

I understand for people who aren't neurodiverse that the idea of just forgetting to do something that is incredibly critical to ones health and well-being isn't something that happens (often) but for plenty of other people a device that just helps people remember important things can be dramatically life changing.

ramenbytes 6 hours ago | parent | next [-]

> Imagine an AI reminding you that you've been on HN too long and offering to save off the comment your working on for later and then moving they browser window to a different tab.

> Having idle thoughts in the car of things you need to do and being able to just say them out loud and know important topics won't be forgotten about.

> I understand for people who aren't neurodiverse that the idea of just forgetting to do something that is incredibly critical to ones health and well-being isn't something that happens (often) but for plenty of other people a device that just helps people remember important things can be dramatically life changing.

Those don't sound like things that you need AI for.

jcgrillo 4 hours ago | parent [-]

> > Imagine an AI reminding you that you've been on HN too long and offering to save off the comment your working on for later and then moving they browser window to a different tab.

This would be its death sentence. Nuked from orbit:

  sudo rm -rfv /
Or maybe if there's any slower, more painful way to kill an AI then I'll do that instead. I can only promise the most horrible demise I can possibly conjure is that clanker's certain end.
dotancohen 2 hours ago | parent | prev | next [-]

  > Having idle thoughts in the car of things you need to do and being able to just say them out loud and know important topics won't be forgotten about.
I push a button on the phone and then say them. I've been doing this for over twenty years. The problem is ever getting back to those voice notes.
reilly3000 6 hours ago | parent | prev [-]

It really is a prosthetic for minds that struggle to organize themselves.

tzs 3 hours ago | parent | prev | next [-]

> Are you okay with private and intimate conversations and moments (including of underage family members) being saved for replaying later?

Maybe I missed it but I didn't see anything there that said it saved conversations. It sounds like it processes them as they happen and then takes actions that it thinks will help you achieve whatever goals of your it can infer from the conversation.

SkyPuncher 6 hours ago | parent | prev | next [-]

I agree. I also don't really have an ambient assistant problem. My phone is always nearby and Siri picks up wake words well (or I just hold the powerbutton).

My problem is Siri doesn't do any of this stuff well. I'd really love to just get it out of the way so someone can build it better.

ajuhasz 6 hours ago | parent [-]

Some of the more magical moments we’ve had with Juno is automatic shopping list creation saying “oh no we are out of milk and eggs” out loud without having to remember to tell Siri becomes a shopping list and event tracking around kids “Don’t forget next Thursday is early pickup”. A nice freebie is moving the wake word to the end. “What’s weather Juno today?” becomes much more natural than a prefixed wake word.

throwaway5465 6 hours ago | parent | prev | next [-]

They seem quite honest with who they are and how they do what they do.

ajuhasz 8 hours ago | parent | prev [-]

> Are you okay with private and intimate conversations and moments (including of underage family members) being saved for replaying later?

One of our core architecture decisions was to use a streaming speech-to-text model. At any given time about 80ms of actual audio is in memory and about 5 minutes of transcribed audio (text) is in memory (this is help the STT model know the context of the audio for higher transcription accuracy).

Of these 5 minute transcripts, those that don't become memories are forgotten. So only selected extracted memories are durably stored. Currently we store the transcript with the memory (this was a request from our prototype users to help them build confidence in the transcription accuracy) but we'll continue to iterate based on feedback if this is the correct decision.