Though I'm in the camp "people should really know to sandbox by now and be careful", I'd say we should also be mindful of how far from everyone has deep knowledge of the systems and tools they use. This behaviour of a tool is just malicious. You have to take into account the human factor, of how people likely end up using a system. And in this case, the consequences of exfiltrating so many secrets this way are really quite unacceptable.

▲

habosa 7 hours ago | parent | next [-]

These tools are explicitly marketed as a way for non-technical people to code. If we expect those same people to understand sandboxing we're dreaming.

	▲	mixdup 5 hours ago \| parent \| next [-]
		This is a fight I deal with every day. We have folks in the technology group at work who use AI to write code and do so without issue. But now folks in supply chain or in the executive suite are using it to generate web pages that they want published or apps they want on the internet, and while Claude can generate an HTML file how that gets published, how authentication works, etc is just glossed completely over, and generates a ton of work for the IT team to build up around this stuff as it comes in
	▲	loloquwowndueo 6 hours ago \| parent \| prev [-]
		Leaded gasoline and tobacco were explicitly marketed as non-harmful back in the day.

▲

ChrisMarshallNY 7 hours ago | parent | prev | next [-]

True, but that's a fantasy happy path. It will never happen, for most people. Only HN people will do that.

It needs to be baked into the OS.

At that point, HN users start screeching about it, so it's lose/lose, really.

▲

jsolson 6 hours ago | parent [-]

macOS largely _does_ bake this into the OS, and it is annoying. They also provide a way to turn it off for specific applications (including, for example, Terminal.app).

	▲	ChrisMarshallNY 6 hours ago \| parent [-]
		I've found that I can usually write apps that respect it. MacOS is a free-love hippie, compared to iOS. In many cases, we have no choice. It's annoying, and often rather infuriating, but I understand that one of the motivations for people buying Apple stuff, is for that very reason, so I'm really sawing off the branch that I'm sitting on, by trying to work around it.

▲

tempodox 6 hours ago | parent | prev | next [-]

Given the long history of even the most egregious data breaches with millions of affected people never having the slightest consequences, what level of care are you expecting here?

▲

viccis 8 hours ago | parent | prev [-]

We should also be mindful of how much these tools break down the "be careful and thoughtful" barriers in favor of more and more convenience.

	▲	m4rtink 7 hours ago \| parent [-]
		Not to mention the very wide push to "Use AI NOW, for EVERYTHING!" in marketing ans many companies, with hardly any though given to safety or where does all the data end up.