Remix.run Logo
▲ skeledrew 6 hours ago

Depends. The company normally would be, but they can always add a no liability clause to their ToS, in which case the user is. But it hardly matters in this case given the narrow scope. Very little harm can occur if the system prescribes the wrong thing; hardly different from buying the wrong thing OTC.

▲bena 6 hours ago | parent [-]

> Very little harm can occur if the system prescribes the wrong thing

Statements like this is effectively saying "Nothing will go wrong".

> but they can always add a no liability clause to their ToS

Then why should I trust the output at all?

However, the entire point was to reference the IBM training manual that states: "A computer can never be held accountable, therefore a computer can must never make a management decision".

If the bot cannot be held accountable, it shouldn't be allowed to make decisions.

▲skeledrew 5 hours ago | parent [-]

> Statements like this [...]

Again, not at all. There's very clear context and scope for the pilot as presented by the article. Doctors involved approved 8 treatments as appropriate for recommendation in this manner, for mild to moderate acne. And the first 100 cases will be reviewed before the recommendation is finalized.

Even with all that, a "bad" recommendation can still be made at a later time (and there are still views to catch them), but if that case does happen then there's negligible harm. The chances and scope of harm from using public roads (something done regularly by billions worldwide) vastly outweigh this, and unless you can come up with at least one scenario where AI can cause non-negligible harm in the pilot context, you're just fearmongering.

> Then why should I trust the output at all?

Nobody is forcing you to.

If the bot cannot be held accountable, [...]

There is no dependency relationship between accountability and decision making. But, again, it's up to individuals if they want to use this service.