Remix.run Logo
▲ criley2 4 hours ago

Honestly, my first impression is that the model believes that "software for a US persona" is less secure, and potentially more <something else> that wasn't tested.

Sounds about right. As we can see with the US approach to AI, it really is about maximizing the investment as fast as possible, maximizing the utility as fast as possible, and blowing past any concept of safety or responsibility.

I mean these models will have at times radically different output when the only difference between prompts is that one prompt is lowercased.

I'd love to see the reasoning traces because if you write "software for a US persona", it will try to fill in the blanks. What did the user mean? "US persona"? Prioritizing profits, advertising, and shipping new features over safety and responsibility? That's what many humans would assume you meant...

▲Avicebron 3 hours ago | parent | next [-]

Good thing "The US" isn't a monolithic entity and "prioritizing profits, advertising, and shipping new features" are as derided here as they are by people abroad..

▲criley2 3 hours ago | parent | next [-]

Hey, if you want to argue with the parameters about what stereotypes come out most strongly for that prompt, be my guest. But no need to shoot the messenger. LLMs are basically stereotype machines, it just turns out if that you make a trillion stereotypes, you get a lot right.

▲dgellow 3 hours ago | parent | prev [-]

> prioritizing profits, advertising, and shipping new features" are as derided here as they are by people abroad..

Doing so in the US is more likely to be rewarded with a cult following than anywhere else

▲mwigdahl 3 hours ago | parent | prev [-]

Ask yourself whether this type of victim blaming would sound acceptable if it were American models writing insecure code for Chinese users.

It should be no surprise that ham-handed political training leads to negative alignment side effects for those deemed the enemy.

▲Daishiman 3 hours ago | parent [-]

What makes you think American providers aren't doing the same?

▲mwigdahl 2 hours ago | parent [-]

Did I say they weren't? They very well might be. If they are, and it can be substantiated, I would expect well-justified outrage.