Remix.run Logo
jmyeet 5 hours ago

This touches on many issues. It's kind of a confused narrative. Predatory practices against minors (in particular), sign up dark patterns, addictive behavior (eg infinite scroll). I don't think you should bundle all of these together like this.

For example, infinite scroll is a product of a news feed and a news feed is algorithmic. What this produces and what it reinforces in the user is one thing but not really related to some small grey text in an Amazon Prime sign up.

So let's break it down. Some of the issues are:

1. Intent to sign up.

2. Difficulty in cancelling a service. This is what I call the "gym model". Easy to sign up, hard to cancel. This can be handled. California, for example, requires companies to offer online cancellation. Most other states don't. This is so much an issue you'll regularly find advice from people to change their address to California so they get that option. There's no reason why every state or the federal government couldn't do that.

3. Selling of your data. Not really touched here but it's going to be a big issue going forward;

4. Addictive behavior to maximize time spent on platform; and

5. What should we allow or disallow for minors. This is going to be a big issue. We're only at the start of the Age Verification Era (like it or not). But IMHO no company should be talking about how to maximize time spent for 13 year olds. And no advertiser should be able to advertise to minors; and

6. Not really touched here but I'm going to add it anyway. IMHO we give tech companies a free pass for algorithms as some kind of mystical, neutral black box. But everything an "algorithm" does represents a decision humans made to get a certain behavior from what training data is used, what they're optimizing for (eg interactions or time spent) and what features they create.

Platforms now essentially get liability protection from publishing content even though they elevate or suppress content based on what it contains. IMHO this is no different than someone deciding what to publish and being liable for it.