Remix.run Logo
▲ _heimdall 6 hours ago

I expect the risk vector would primarily be related to OS-level AI tools being given to see whats being rendered on screen and interact with it. Signal can encrypt at rest and between devices, it can't encrypt when actually rendering text to the UI tree.

▲georgemcbay 3 hours ago | parent | next [-]

> I expect the risk vector would primarily be related to OS-level AI tools being given to see whats being rendered on screen and interact with it. Signal can encrypt at rest and between devices, it can't encrypt when actually rendering text to the UI tree.

Yeah, it is likely this.

A decade ago I worked for a company that provided secure communications apps (email, IMs, etc) for both Android and iOS and (as one of the Android developers) I remember pointing out to higher-ups that it was trivial to write an app on Android that would tie into the accessibility APIs Android provided to bypass all of our app's network and storage security (the accessibility APIs would allow you to automatically read the text out of any standard OS text controls of any installed app while running as a background service to provide alternative means of presenting the data, like text to speech, etc).

But instead of providing accessibility, an attacker app could just take all that data and silently upload it somewhere.

This did mean the attacker would have to physically access the phone one time to install the accessibility logger service (or they'd have to phish a user to install it themselves), but after that initial install they could forever bypass the security on our app with absolutely no way for the user to know data was being exfiled unless they are the type that is meticulously auditing which apps are installed on their phone.

Destroying accessibility is unfair to people who need it, but I recommended we add a feature to our app that would default to notifying the user with a clear warning whenever another running app had accessibility read access.

My recommendation never got followed, at least for the remainder of my time at that company (they got bought up by Blackberry about a year later and the office I was working in got shut down).

▲ an hour ago | parent [-]
[deleted]
▲j45 5 hours ago | parent | prev [-]

Maybe signal can change how they render text on the screen. Nothings perfect, but maybe render it themselves?

▲RunSet 2 hours ago | parent | next [-]

Screenshots tend to capture a black rectangle instead of the screen area rendered using a hardware overlay.[0] Perhaps Signal could use that. Although there are likely ways to circumvent it.

[0] https://en.wikipedia.org/wiki/Hardware_overlay#Screen_shots

▲zugi 4 hours ago | parent | prev [-]

Like render all your chats as Captcha text so the AI can't read it?

▲j45 4 hours ago | parent [-]

Maybe, or just render it as an image. Or render it as individual pixels. Things might not be perfect but it would be a start. :)

Rust / WebAssembly can do a lot.