Remix.run Logo
▲ ryandrake 3 hours ago

A tool that moralizes at you is defective. I don't expect the unix cp command to return an error or copy bits slower if it detects I'm using it on a pirated movie. Just like I don't expect my band saw to brick itself if it detects I'm cutting into my finger. It's not on these tool companies to enforce other companies' business models.

▲flavelius 3 hours ago | parent | next [-]

Interestingly some saws do exactly that, and I'd say it's actually desired. But yes, this is for different reasons, and using that safety mechanism is a decision of the operator.

▲lelanthran 2 hours ago | parent | next [-]

They dont brick themselves, they stop.

Fair enough, the models don't brick them Selves either, but neither do they stop.

Bandsaws don't cut crooked lines, or change the speed, they stop.

▲sm-silversight an hour ago | parent | next [-]

No those saws don't just stop, they absolutely destroy at least the blade you're using and potentially damage the engine mechanism.

But I agree LLMs shouldn't have such an anti-feature.

▲kenjackson 2 hours ago | parent | prev | next [-]

I think you're splitting hairs here.

Most things don't have the ability to moralize, but if they did, probably more would. There are restrictions on watching adult content in some jurisdictions. I've heard that copy machines will do watermarks (or something like that) if you copy currency. Some cars will brake automatically if they determine you're likely to hit something if you continue (maybe I'm trying to drive through the front of a bank!). Some cars are configured with breathalyzers that need to be passed to start. Etc...

▲paimapi 15 minutes ago | parent [-]

I wish there was more actual research on those 'moralisms' many of which boil down to public health safety features that have led to dramatic reductions in mortality rates.

On the one hand, I definitely don't agree with the logic of 'don't guardrail me if I don't want it.' I think back on that one video from the late 80s of people talking about how seatbelt mandates were horrible violations of their freedoms (and not like like one second of work and no real discomfort).

On the other, I'd love it if these companies actually produced real research about modern AI-assisted attacks in terms of damage and quantity, and whether or not guardrails even matter when tech like abliteration is in general use.

▲ an hour ago | parent | prev | next [-]
[deleted]
▲QuadmasterXLII an hour ago | parent | prev | next [-]

They do brick themselves- sawstop has to be replaced after saving a finger because the stop is quite violent.

▲felixgallo 2 hours ago | parent | prev [-]

actually SawStop does brick itself, destroying the brake cartridge and blade to save your hand.

▲eightysixfour 2 hours ago | parent [-]

I think "brick" here means different things to different people. Like I said elsewhere, it is more like an airbag going off. Yeah, you have to replace some "consumables" to go back to work, but the car isn't totaled (just because the airbag went off, the collision that caused it on the other hand).

If it truly bricked itself, I think it would be more like a crumple zone completely buckling, which isn't an automatic total (people will rebuild anything...) but is pretty close.

▲andy99 3 hours ago | parent | prev [-]

Yes there’s a whole regulatory capture movement plus a bunch of the usual useful idiots pushing for some kind of mechanism to be included in power saws.

It’s not too different from all the nanny state stuff people push for in cars. In Europe already cars beep at you if they think you’re going over the speed limit, and also suck at detecting the correct speed limit.

Or like the Zune that was designed for copyright holders instead of users. It’s all the same, the problem is stuff that’s not made for users and made for someone else’s agenda. They don’t do well in a free market (like the Zune) which is why we always see accompanying regulatory capture efforts.

▲eightysixfour 2 hours ago | parent [-]

Using the StopSaw as an example here isn’t doing you many favors, even though I agree with the underlying premise. The StopSaw is closer to seat belts and airbags than beeping for going over the speed limit.

▲andy99 2 hours ago | parent [-]

No it’s some nanny state nonsense pushed by people who have never done construction work and are grifting to try and get money for their product. The upstream post picked it as an example of something absurd, seemingly unaware it existed. It is absurd but apparently some cohort of people is either stupid or controlling enough to actually support the company behind it in their scam.

▲emtel 3 hours ago | parent | prev | next [-]

A tool that is capable of moralizing at you or making decisions, is clearly not just a tool. I get that people want to keep the locus of accountability on humans, but insisting that coding agents are "just tools" is confusion.

▲aerodexis 43 minutes ago | parent | next [-]

Every tool is /inherently/ moralistic. Full stop. The idea that a tool could not have an embedded morality in it is a fiction.

▲cortesoft 2 hours ago | parent | prev | next [-]

When does a tool become "not just a tool"? Is there a complexity limit to what it can do before it becomes "more than a tool"?

If you had a tool that ONLY moralized on decisions, would that still be just a tool? Is the issue that it both does something else AND moralizes that is the issue?

I don't necessarily disagree that I personally don't want my tools to moralize, I don't know if that makes them categorically different or just a tool I don't want.

▲thelaxiankey an hour ago | parent [-]

Yes, there is a complexity limit, but it is fuzzy and not perfectly well defined (and that's ok). Modern LLMs ride that line in a wild and interesting way.

It's really fun having become a biologist in recent years, and knowing that there's an entire field that uses living organisms (yeast or neutered E coli) as protein factories. I am bringing it up a bunch here because not only are these things used as tools, but they're literally alive!

▲pixl97 2 hours ago | parent | prev [-]

Yep, thinking LLMs are just a tool just isn't a good mental model of what's occurring.

Of course HN has a pretty large number of people that say things like "But I want the nuclear weapon building machine to do whatever I want without asking questions, and there are no possible wide scale ramifications that will happen because of this".

These AI models are something new and different and we need to change our expectations of them over conventional software.

▲tintor 3 hours ago | parent | prev | next [-]

Ok, but I want my band saw to brick itself instead of cutting my finger.

▲CoastalCoder 3 hours ago | parent [-]

I thought that was only a table saw thing.

Do some band saws also have that now?

▲MarkMarine 2 hours ago | parent | next [-]

https://www.sawstop.com/product-category/bandsaw/

Yes, that said I think you’d have to be pretty sloppy about safety to cut yourself with a regular bandsaw. I have a sawstop table saw and I don’t see the need for that on a bandsaw

▲poizan42 2 hours ago | parent | prev [-]

Yup, SawStop do make band saws now[0]

[0]: https://www.sawstop.com/product-category/bandsaw/

▲andai an hour ago | parent | prev | next [-]

Do you expect the biosynth tool to comply with a "invent turbo AIDS" prompt?

▲echoangle 14 minutes ago | parent | next [-]

Kind of, does python block you from using it to script a cyber attack?

▲dyauspitr 6 minutes ago | parent | prev [-]

No, but you cannot silently underperform. You have to explicitly tell me that it’s a sensitive area and you won’t do it.

▲dyauspitr 7 minutes ago | parent | prev | next [-]

Hidden or silent under performance will perpetually have me looking for other options. At the very least, do you have to tell me that you consider this a sensitive area and you are restricting performance as a result.

▲keeganpoppen 16 minutes ago | parent | prev | next [-]

uh, your band saw does do that, and, in fact, it has saved innumerable fingers that it does do that

▲unpleasurable 3 hours ago | parent | prev | next [-]

like an oven that refuses meat

▲dboreham 2 hours ago | parent [-]

It would be good if it refused only live meat.

▲jonathanstrange 3 hours ago | parent | prev | next [-]

A bit off topic but there are band saws that immediately stop when touching your finger, they're so fast that your finger remains unharmed.

▲DaSHacka 3 hours ago | parent [-]

And those band saws actually do technically brick themselves too lol

GP's first example is spot-on, the second is actually somewhat weak as almost anyone actually would prefer a bandsaw to brick itself rather than permanently maiming them.

▲ryandrake 3 hours ago | parent [-]

Yea, it's a weaker example, but the problem with my saw moralizing about what it's cutting is 1. false positive bricking my tool, and 2. the user's lack of input--it should be my decision as the tool operator to add a safety measure.

▲Tarq0n 2 hours ago | parent [-]

Odd take as 90% of saw-stops are probably there because they were mandated by OSHA regulation. It's rarely up to the operator.

▲InsidiousWombat 3 hours ago | parent | prev | next [-]

the saw example is unfortunate as that's a (desired) feature on expensive saws. But also user explicitly wants to, not some techbro decides to.

▲dboreham 2 hours ago | parent [-]

Typically saw safety features are mandated by a government. E.g. when I lived in the EU 30 years ago table saws had to have regen brakes so they stopped within a fraction of a second when turned off. Came to the US: no such thing exists. I'm not sure if that feature even exists on US sold saws today.

▲vlyan 3 hours ago | parent | prev [-]

we can't have nice things in the mass psychosis era.

even the legacy things -- the internet and general purpose computers -- are being enshitified. new things are being made with built-in enshitification.