| ▲ | londons_explore 14 hours ago |
| We need more residential proxies, not less. I've had enough of companies saying "you're connecting from an AWS IP address, therefore you aren't allowed in, or must buy enterprise licensing". Reddit is an example which totally blocks all data to non-residential IP's. I want exactly the same content visible no matter who you are or where you are connecting from, and a robust network of residential proxies is a stepping stone to achieving that. |
|
| ▲ | ndiddy 14 hours ago | parent | next [-] |
| If you look at the article, the network they disrupted pays software vendors per-download to sneakily turn their users into residential proxy endpoints. I'm sure that at least some of the time the user is technically agreeing to some wording buried in the ToS saying they consent to this, but it's certainly unethical. I wouldn't want to proxy traffic from random people through my home network, that's how you get legal threats from media companies or the police called to your house. |
| |
| ▲ | londons_explore 14 hours ago | parent | next [-] | | > that's how you get legal threats from media companies or the police called to your house. Or residential proxies get so widespread that almost every house has a proxy in, and it becomes the new way the internet works - "for privacy, your data has been routed through someone else's connection at random". | | |
| ▲ | Imustaskforhelp 13 hours ago | parent | next [-] | | > Or residential proxies get so widespread that almost every house has a proxy in, and it becomes the new way the internet works - "for privacy, your data has been routed through someone else's connection at random". Is this a re-invention of tor, maybe I2P? | | |
| ▲ | chii 4 hours ago | parent | next [-] | | > Is this a re-invention of tor in a way, yes - the weakness of tor is realistically the lack of widespreadness. Tor traffic is identifiable and blockable due to the relatively rare number of exit nodes (which also makes it dangerous to run exit nodes, as you become "liable"). Engraining the ideas of tor into regular users' internet usage is what would prevent the internet from being controlled and blockable by any actor (except perhaps draconian gov't over reach, which while can happen, is harder in the west). | |
| ▲ | rolph 12 hours ago | parent | prev [-] | | IP8 address tumbler? to wit, playing the shell game, to obstruct direct attribution. |
| |
| ▲ | 12 hours ago | parent | prev [-] | | [deleted] |
| |
| ▲ | dataviz1000 13 hours ago | parent | prev [-] | | They provide an SDK for mobile developers. Here is a video of how it works. [0] They don't even hide it. [0] https://www.youtube.com/watch?v=1a9HLrwvUO4&t=15s | | |
| ▲ | ndiddy 13 hours ago | parent [-] | | Of course they're pitching it like everything's above board, but from the article: > While many residential proxy providers state that they source their IP addresses ethically, our analysis shows these claims are often incorrect or overstated. Many of the malicious applications we analyzed in our investigation did not disclose that they enrolled devices into the IPIDEA proxy network. Researchers have previously found uncertified and off-brand Android Open Source Project devices, such as television set top boxes, with hidden residential proxy payloads. | | |
| ▲ | calgoo 2 hours ago | parent | next [-] | | I love how its the "evil" Open Source project devices, and "other app stores" that are the problem, not the 100s of spyware ridden crap that is available for download from the Play store. Would be interesting to know how many copies of the SDK was found and removed from their own platform. | |
| ▲ | direwolf20 12 hours ago | parent | prev [-] | | If popup ads that open the play store are ethical, this is ethical. |
|
|
|
|
| ▲ | JDye 13 hours ago | parent | prev | next [-] |
| I live in the UK and can't view a large portion of the internet without having to submit my ID to _every_ site serving anything deemed "not safe the for the children". I had a question about a new piercing and couldn't get info on it from Reddit because of that. I try using a VPN and they're blocked too. Luckily, I work at a copmany selling proxies so I've got free proxies whenever I want, but I shouldn't _need_ to use them. I find it funny that companies like Reddit, who make their money entirely from content produced by users for free (which is also often sourced from other parts of the internet without permission), are so against their site being scraped that they have to objectively ruin the site for everyone using it. See the API changes and killing off of third party apps. Obviously, it's mostly for advertising purposes, but they love to talk about the load scraping puts on their site, even suing AI companies and SerpApi for it. If it's truly that bad, just offer a free API for the scrapers to use - or even an API that works out just slightly cheaper than using proxies... My ideal internet would look something like that, all content free and accessible to everyone. |
| |
| ▲ | Aurornis 13 hours ago | parent | next [-] | | > that they have to objectively ruin the site for everyone using it. See the API changes and killing off of third party apps. Third party app users were a very small but vocal minority. The API changes didn't drop their traffic at all. In fact, it's only gone up since then. The datacenter IP address blocks aren't just for scrapers, it's an anti-bot measure across the board. I don't spend much time on Reddit but even the few subreddits I visited were starting to become infiltrated by obvious bot accounts doing weird karma farming operations. Even HN routinely gets AI posting bots. It's a common technique to generate upvote rings - Make the accounts post comments so they look real enough, have the bots randomly upvote things to hide activity, and then when someone buys upvotes you have a selection of the puppet accounts upvote the targeted story. Having a lot of IP addresses and generating fake activity is key to making this work, so there's a lot of incentive to do it. | | |
| ▲ | JDye 13 hours ago | parent | next [-] | | I agree that write-actions should be protected, especially now when every other person online is a bot. As for read-actions, I'll continue to profit off those being protected too but I wouldn't be too bothered if something suddenly changed and all content across the internet was a lot easier to access programmatically. I think only harm can come from that data being restricted to the huge (nefarious) companies that can pay for that data or negotiate backroom deals. | |
| ▲ | direwolf20 12 hours ago | parent | prev [-] | | Reddit's traffic is almost exclusively propaganda bots. |
| |
| ▲ | what 8 hours ago | parent | prev | next [-] | | Have you considered that it’s because a new industry popped up that decided it was okay to slurp up the entire internet, repackage it, and resell it? Surely that couldn’t be why sites are trying to keep non humans out. | |
| ▲ | 201984 11 hours ago | parent | prev [-] | | Fix your government. | | |
|
|
| ▲ | Aurornis 14 hours ago | parent | prev | next [-] |
| > I want exactly the same content visible no matter who you are or where you are connecting from The reason those IP addresses get blocked is not because of "who" is connecting, but "what" Traffic from datacenter address ranges to sites like Reddit is almost entirely bots and scrapers. They can put a tremendous load on your site because many will try to run their queries as fast as they can with as many IPs as they can get. Blocking these IP addresses catches a few false positives, but it's an easy step to make botting and scraping a little more expensive. Residential proxies aren't all that expensive, but now there's a little line item bill that comes with their request volume that makes them think twice. > We need more residential proxies, not less Great, you can always volunteer your home IP address as a start. There are services that will pay you a nominal amount for it, even. |
|
| ▲ | direwolf20 14 hours ago | parent | prev | next [-] |
| You can run one, something like ByteLixir, Traffmonetizer, Honeygain, Pawns, there are lots more, just google "share my internet for money" What will you be proxying? Nobody knows! I haven't had the police at my house yet. Seems a great way to say "fuck you" to companies that block IP addresses. You may see a few more CAPTCHAs. If you have a dynamic IP address, not many. |
| |
| ▲ | dist-epoch 13 hours ago | parent [-] | | How much can you make if you run all of them at the same time? Doesn't the ISP detect them? | | |
|
|
| ▲ | tokyobreakfast 13 hours ago | parent | prev | next [-] |
| > I've had enough of companies saying "you're connecting from an AWS IP address I run a honeypot and the amount of bot traffic coming from AWS is insane. It's like 80% before filtering, and it's 100% illegitimate. |
| |
| ▲ | ghxst 4 hours ago | parent [-] | | Most of them abuse the ip pool attached to lambda from my experience. |
|
|
| ▲ | yuliyp 10 hours ago | parent | prev | next [-] |
| The end game of that is no useful content being accessible without login, or needing some sort of other proof-of-legitimacy. |
| |
| ▲ | Nextgrid 7 hours ago | parent | next [-] | | That's already the case (irrespective of residential proxies) because content only serves as bait for someone to hand over personal information (during signup/login) and then engage with ads. Proxies actually help with that by facilitating mass account registration and scraping of the content without wasting a human's time "engaging" with ads. | |
| ▲ | supertrope 10 hours ago | parent | prev [-] | | Amazon.com now only shows you a few reviews. To see the rest you must login. Social media websites have long gated the carrots behind a login. Anandtech just took their ball and went home by going offline. |
|
|
| ▲ | nine_k 11 hours ago | parent | prev | next [-] |
| There's a company that pays you to keep their box connected to your residential router. I assume it sells residential proxy services, maybe also DDoS services, I don't know. It's aptly named Absurd Computing. |
|
| ▲ | crtasm 13 hours ago | parent | prev | next [-] |
| I'm reading reddit.com from a Tor node, they also have a .onion domain you could use. |
| |
| ▲ | Jblx2 12 hours ago | parent [-] | | Anyone know how to create a usable reddit account from the .onion domain? | | |
| ▲ | phyzome 12 hours ago | parent [-] | | I've tried it, and my account was shadowbanned a few hours after I created it. It's very obnoxious. | | |
| ▲ | cluckindan 11 hours ago | parent [-] | | Reddit bots shadowban almost everyone who post before they have enough comment karma. Nothing to do with Tor or VPN. |
|
|
|
|
| ▲ | xg15 14 hours ago | parent | prev | next [-] |
| Also, nevermind the tech companies building their own proxy networks, such as Find My or Amazon Sidewalk. |
| |
| ▲ | a456463 13 hours ago | parent | next [-] | | Agreed. With things people paid for and using our wifi data to build their "positioning dbs" that you can't block or turn off on your phone, without "rooting" your own device. | |
| ▲ | enneff 13 hours ago | parent | prev [-] | | How is Find My a proxy network? | | |
| ▲ | direwolf20 12 hours ago | parent [-] | | In the literal sense. Your traffic is proxied through devices belonging to unwilling strangers. | | |
| ▲ | enneff 11 hours ago | parent [-] | | By “your traffic” you mean device location reports? Or something else? | | |
| ▲ | fc417fc802 6 hours ago | parent | next [-] | | Yes. It's "edge routing" that happens to be restricted to a single operator. | |
| ▲ | DANmode 8 hours ago | parent | prev [-] | | The data that powers the app tracking your devices, shown on your devices, yes. (What else?) | | |
| ▲ | enneff 8 hours ago | parent [-] | | I don’t know. I wouldn’t have thought of myself as proxying other people’s traffic by carrying my iPhone around. (For one thing, it’s my own phone that initiates all the activity- it monitors for Apple devices, the devices don’t reach out to my phone.) I can see how you could frame it that way, though. I just thought they might be referring to something else that I didn’t know about. | | |
| ▲ | MBCook 8 hours ago | parent [-] | | I remain skeptical. I can understand how one would might see it that way, but I think it’s stretching the word proxy too far. Devices on Apple’s Find My aren’t broadcasting anything like packets that get forwarded to a destination of their choosing. I would think that would be a necessity to call it “proxying”. They’re just broadcasting basic information about themselves into the void. The phones report back what they’ve picked up. That doesn’t fit the definition to me. I absolutely don’t mind the fact that my phone is doing that. The amount of data is ridiculously minuscule. And it’s sort of a tit for tat thing. Yeah my phone does it, but so does theirs. So just like I may be helping you locate your AirTag, you would be helping me locate mine. Or any other device I own that shows up on Find My. It’s a very close to a classic public good, with the only restriction being that you own a relevant device. | | |
| ▲ | DANmode 7 hours ago | parent [-] | | > aren’t broadcasting anything like packets that get forwarded to a destination of their choosing Protocol insists the data only goes back to owner device or Apple server. |
|
|
|
|
|
|
|
|
| ▲ | packetslave 14 hours ago | parent | prev | next [-] |
| > Reddit is an example which totally blocks all data to non-residential IP's. No, we don't. |
| |
| ▲ | direwolf20 14 hours ago | parent | next [-] | | Have you tried it? Every new account will be shadowbanned and if it's shared you often get blank page 429. None of this was true before the API shutdown. | | |
| ▲ | 3rodents 14 hours ago | parent | next [-] | | That’s not my experience, using various VPNs, public networks, Cloudflare and Apple private relays. A captcha is common when logged out but that’s about it, I have not encountered any shadow bans. I create a new account each week. | |
| ▲ | gruez 14 hours ago | parent | prev [-] | | >Every new account will be shadowbanned That's not the same as "blocks all data to non-residential IP's"? >if it's shared you often get blank page 429. None of this was true before the API shutdown. See my other comment. I agree there's a non-zero amount of VPNs that are banned from reddit, but it's also not particularly hard to find a VPN that's not banned on reddit. | | |
| ▲ | interloxia 14 hours ago | parent [-] | | Probably not hard but my poor little innocent VPS at Hetzer that I have had for years is denied and that makes me sad. |
|
| |
| ▲ | piskov 14 hours ago | parent | prev | next [-] | | Yes you do. Private VPS for personal VPN in Netherlands (digital ocean), then Hungary (some small local DC) — both are blocked from day one. > You've been blocked by network security. To continue, log in to your Reddit account or use your developer token. If you think you've been blocked by mistake, file a ticket below and we'll look into it. | | |
| ▲ | what 7 hours ago | parent | next [-] | | Sounds like you just need to sign in or use the api? | |
| ▲ | Imustaskforhelp 13 hours ago | parent | prev [-] | | Proton VPN sometimes (mostly?) has this issue too. It's a bit of an hit or miss in there iirc but I have definitely seen the last message of your comment. |
| |
| ▲ | hackeman300 14 hours ago | parent | prev | next [-] | | Try browsing from any Mullvad vpn. You will be "blocked by network security" | | |
| ▲ | edoceo 13 hours ago | parent | next [-] | | I use mullvad regularly & visit reddit from that connection - it works. But! You have to sign-in. | |
| ▲ | gruez 14 hours ago | parent | prev | next [-] | | That's just mullvad's IP pool being banned. The other VPN providers I use aren't banned, or at least are only intermittently banned that I can easily switch to another server. | |
| ▲ | yuliyp 10 hours ago | parent | prev [-] | | ... if you're logged out. Log in so they don't have to lump you in with every scraper you're sharing a subnet with. |
| |
| ▲ | thot_experiment 14 hours ago | parent | prev | next [-] | | I have never interacted with a reddit employee who wasn't actively gaslighting me about the platform. Do you even use the site? I talked to a PM recently who genuinely thought the phone app was something people liked. | | |
| ▲ | MBCook 7 hours ago | parent | next [-] | | There are people who actively like it. I don’t. But they 100% exist. | |
| ▲ | direwolf20 12 hours ago | parent | prev [-] | | They probably get paid by how many people believe their nonsense. |
| |
| ▲ | leftouterjoins 11 hours ago | parent | prev | next [-] | | everything on Reddit is so locked down it’s useless. even if you do get to post something useful some basement dwelling mod will block it for an arcane interpretation of one of the subreddits 14 rules. | |
| ▲ | a456463 13 hours ago | parent | prev | next [-] | | Have you tried using it logged out on a vpn? It is impossible. | |
| ▲ | dvngnt_ 14 hours ago | parent | prev | next [-] | | there are several times where I've had to disable PIA to access reddit's login page | |
| ▲ | tokyobreakfast 13 hours ago | parent | prev [-] | | [flagged] |
|
|
| ▲ | a456463 13 hours ago | parent | prev | next [-] |
| This blog post from the company that used promise "don't be evil", one that steals water for data centers from vilages and towns via shady deals, whose whole premise it stealing other people's stuff and claiming it as their own and locking them out and selling their data.. Who made them the arbiter of the internet? No one!!! They just stole this and get on their high horse to tell people how to use internet? You can eff right off Google. |
|
| ▲ | BoredPositron 14 hours ago | parent | prev [-] |
| I still "run" a small ISP with a few thousand residential ips from my scraping days. The requirements are laughable and costs were negligible in the early 2000s. |