| ▲ | autoexec 18 hours ago |
| I'm happy to see it. They should have included Roku in that too! > Roughly twice per second, a Roku TV captures video “snapshots” in 4K resolution. These snapshots are scanned through a database of content and ads, which allows the exposure to be matched to what is airing. For example, if a streamer is watching an NFL football game and sees an ad for a hard seltzer, Roku’s ACR will know that the ad has appeared on the TV being watched at that time. In this way, the content on screen is automatically recognized, as the technology’s name indicates. The data then is paired with user profile data to link the account watching with the content they’re watching. https://advertising.roku.com/learn/resources/acr-the-future-... I wouldn't be surprised if my PS5 was doing the same thing when I'm playing a game or watching a streaming service through it. |
|
| ▲ | VTimofeenko 17 hours ago | parent | next [-] |
| Most likely case is that the tv is computing hash locally and sending the hash. Judging by my dnstap logs, roku TV maintains a steady ~0.1/second heartbeat to `scribe.logs.roku.com` with occasional pings to `captive.roku.com`. The rest are stragglers that are blocked by `*.roku.com` DNS blackhole. Another thing is `api.rokutime.com`, but as of writing it's a CNAME to one of `roku.com` subdomains. The block rates seem to correlate with watch time increasing to ~1/second, so it's definitely trying to phone home with something. Too bad it can't since all its traffic going outside LAN is dropped with prejudice. If your network allows to see stuff like that, look into what PS5 is trying to do. |
| |
| ▲ | godelski 8 hours ago | parent | next [-] | | > Most likely ... sending the hash
If you're tracking packets can't you tell by the data size? A 4k image is a lot more data than a hash.I do suspect you're right since they would want to reduce bandwidth, especially since residential upload speeds are slow but this is pretty close to verifiable, right? Also just curious, what happens if you block those requests? I can say Samsung TVs really don't like it... but they will be fine if you take them fully offline. | | |
| ▲ | VTimofeenko 8 hours ago | parent [-] | | > If you're tracking packets can't you tell by the data size? A 4k image is a lot more data than a hash. I admit, I've not gotten around to properly dumping that traffic. For anyone wanting to do this, there's also a spike of DNS requests every hour on the hour, even if tv is off(well, asleep). Would be interesting to see those too. Might be a fun NY holiday project right there. Even without decrypting (hopefully) encrypted traffic, it should be verifiable. > Also just curious, what happens if you block those requests? Due to `*.roku.com` DNS black hole, roku showed no ads but things like Netflix and YouTube using standard roku apps("channels") worked fine. I now moved on to playing content using nvidia shield and blocking outside traffic completely. Only odd thing is that the TV occasionally keeps blinking and complains about lack of network if I misclick and start something except HDMI input. |
| |
| ▲ | CursedSilicon 16 hours ago | parent | prev | next [-] | | Hashing might not work since the stream itself would be a variable bitrate, meaning the individual pixels would differ and therefore the computed file hash | | |
| ▲ | 3wolf 16 hours ago | parent [-] | | They're using perceptual hashing, not cryptographic hashing of raw pixels. So it's invariant to variable bitrate, compression, etc. | | |
| ▲ | hnlmorg 8 hours ago | parent [-] | | How does perceptual hashing work? Have you got any recommendations for further reading on this topic? | | |
| ▲ | b_mc2 27 minutes ago | parent | next [-] | | These are two articles I liked that are referenced in the Python ImageHash library on PyPi, second article is a follow-up to the first. Here's paraphrased steps/result from first article for hashing an image: 1. Reduce size. The fastest way to remove high frequencies and detail is to shrink the image. In this case, shrink it to 8x8 so that there are 64 total pixels. 2. Reduce color. The tiny 8x8 picture is converted to a grayscale. This changes the hash from 64 pixels (64 red, 64 green, and 64 blue) to 64 total colors. 3. Average the colors. Compute the mean value of the 64 colors. 4. Compute the bits. Each bit is simply set based on whether the color value is above or below the mean. 5. Construct the hash. Set the 64 bits into a 64-bit integer. The order does not matter, just as long as you are consistent. The resulting hash won't change if the image is scaled or the aspect ratio changes. Increasing or decreasing the brightness or contrast, or even altering the colors won't dramatically change the hash value. https://www.hackerfactor.com/blog/index.php?/archives/432-Lo... https://www.hackerfactor.com/blog/index.php?/archives/529-Ki... | |
| ▲ | tasty_freeze an hour ago | parent | prev | next [-] | | In the same way that Shazam can identify songs despite the audio source being terrible over a phone, mixed with background noise. It doesn't capture the audio as a WAV and then scan its database for an exact matching WAV segment. I'm sure it is way more complex than this, but shazam does some kind of small windowed FFT and distills it to the dominant few frequencies. It can then find "rhythms" of these frequency patterns, all boiled down to a time stream of signature data. There is some database which can look up these fingerprints. One given fingerprint might match multiple songs, but since they have dozens of fingerprints spread across time, if most of them point to the same musical source, that is what gets ID'd. | |
| ▲ | Someone 5 hours ago | parent | prev | next [-] | | https://en.wikipedia.org/wiki/Perceptual_hashing | |
| ▲ | gertrunde 8 hours ago | parent | prev [-] | | Possibly one of the better known (and widely used?) implementations is Microsoft's PhotoDNA, that may be a suitable starting point. |
|
|
| |
| ▲ | clbrmbr 15 hours ago | parent | prev | next [-] | | What system do you use to get that level of visibility? | | |
| ▲ | VTimofeenko 14 hours ago | parent | next [-] | | Main data comes from unbound[1], I use vector[2] to ship and transform logs. Dnstap[3] log format IME works better than the standard logs, especially when it comes to more complex queries and replies. Undesired queries get 0.0.0.0 as a response which I track. Firewall is based on hand-rolled nftables rules. [1]: https://www.nlnetlabs.nl/projects/unbound/about/
[2]: https://vector.dev
[3]: https://dnstap.info/Examples/ | |
| ▲ | varenc 13 hours ago | parent | prev | next [-] | | Besides what others have said, another dead simple option is to use Nextdns: https://nextdns.io Doesn't require running anything locally and supports various block rules and lists and allows you to enable full log retention if you want. I recommend it to non-techies as the easiest way to get something like pi-hole/dnscrypt-proxy. (but of course not being self-hosted has downsides) edit: For Roku, DNS blocking like this only works if Roku doesn't use its own resolver. If it's like some Google devices it'll use 8.8.8.8 for DNS resolution ignoring your gateway/DHCP provided DNS server. | | |
| ▲ | ImPostingOnHN 11 hours ago | parent [-] | | Seems like you could have a router or firewall mitm queries to e.g. 8.8.8.8 and potentially redirect/rewrite/respond | | |
| ▲ | darkwater 8 hours ago | parent | next [-] | | I would not be surprised if Google TV devices will sooner than later start using DoH to 8.8.8.8 | |
| ▲ | godelski 8 hours ago | parent | prev [-] | | I'm a noob at this, but can you do that when it is DoT or DoH? Like I thought the point of them is that you can't forget the DNS request. Even harder with oDoH, right? So does that really get around them? |
|
| |
| ▲ | nwellinghoff 11 hours ago | parent | prev | next [-] | | Pfsense firewall. There is a week long learning curve and it’s best to put it on dedicated hardware. | |
| ▲ | mschuster91 15 hours ago | parent | prev [-] | | Replace your router's DNS with something like pi-hole or a bog standard dnsmasq, turn up the logging, that's it. Ubiquiti devices I think also offer detailed DNS logging but not sure. | | |
| ▲ | jakeydus 14 hours ago | parent [-] | | I believe unifi offers aggregated dns logs ootb but you could always set up more detailed ones on the gateway itself. |
|
| |
| ▲ | NuclearPM 12 hours ago | parent | prev [-] | | I don’t know why you quoted the addresses. | | |
| ▲ | __MatrixMan__ 2 hours ago | parent | next [-] | | It's polite to give parsers (human or otherwise) hints that they're about to encounter text which is now intended for a different kind of parser. I recently forgot to surround my code in ``` and Gemini refused to help with it (I think I tripped a safety guardrail, it thought I was targeting it with an injection attack). Amusingly, the two ways to work around it were to fence off my code with backticks or to just respond to: > I can't help you with that With > Why not? After which it was then willing to help with the unquoted code. Presumably it then perceived it as some kind of philosophical puzzle rather than an attack. | |
| ▲ | RicoElectrico 12 hours ago | parent | prev | next [-] | | Markdown habit. | |
| ▲ | alias_neo 6 hours ago | parent | prev [-] | | Tell me you don't Markdown, without telling me you don't Markdown. It's a developer thing, using backticks means the enclosed text is emphasised when rendered from Markdown. | | |
|
|
|
| ▲ | nitwit005 17 hours ago | parent | prev | next [-] |
| That sounds so expensive it's hard to see it making money. You'd processing a 2fps video stream for each customer. That's a huge amount of data. And all that is for the chance to occasionally detect that someone's seen an ad in the background of a stream? Do any platforms even let a streamer broadcast an NFL game like the example given? |
| |
| ▲ | vrosas 15 hours ago | parent | next [-] | | I used to work for an OTT DSP adtech company i.e. a company that bid on TV ad spots in real time. The bidding platform was handling millions of requests per second, and we were one of the smaller fish in the sea. This system is very real. Your tv is watching what you’re watching. I built the attribution pipeline, which is what this is. If you go buy a product from one of these ads, this is how they track (attribute) it. Not to be alarmist butttt you have zero privacy. | | |
| ▲ | AJ007 20 minutes ago | parent | next [-] | | The TV thing isn't a new story, this was public. Everyone should have known about it and no one cared. (I could inset a boilerplate rant about Snowden here) Those datacenters are not being built so that you can talk to ChatGPT all day, they are being built to generate and optimize ads. People who were not previously very suggestible are going to be. People who are suggestible will have their agency sold off to the highest bidder. Avoid owning a TV? Your friends will. Maybe you can not have a FB/IG/WhatsApp account, only use cash, not have a mobile phone, but Meta (or Google, or Apple) can still detect your face in the background of photos/videos and know where you shop, travel and when. | |
| ▲ | everdrive 2 hours ago | parent | prev | next [-] | | This is really interesting. Can you expand on this? What are OTT and DSP in this context? Do you have a sense for what data is tracked and how it's used? Or if this sort of system is blind in certain cases? (eg: I hook up an N64 to the a/v ports -- will I get retro game ads on the TV?) | |
| ▲ | kleiba 7 hours ago | parent | prev | next [-] | | > you have zero privacy Is this data linked to me personally in some way (e.g. though an account) or is it anonymous data? | | |
| ▲ | everdrive 2 hours ago | parent | next [-] | | They can definitely work out who you are from your IP address. (or get close enough that the advertisers don't care) Not too many people are putting a VPN on their router and using throwaway accounts for their smart TVs. This might be difficult anyhow if your log into major services such as Amazon, etc, who will know who you are. I'm not saying this is impossible to avoid, but it ends up being a LOT of work when the alternative is just not connecting the TV to the internet and using a laptop / Apple TV / etc. instead. | |
| ▲ | xnx 6 hours ago | parent | prev [-] | | Personally identifiable. Most smart TVs force a login to connect to the Internet or even use at all. |
| |
| ▲ | Ancalagon 13 hours ago | parent | prev | next [-] | | I understand the perils of a capitalist system but whyyy would you agree to build this | | |
| ▲ | vrosas 11 hours ago | parent | next [-] | | The perils of the capitalist system man. For what’s its worth, I left adtech many moons ago specifically because it is a horrifyingly depressing industry and very very not fun to talk about at parties. | | |
| ▲ | godelski 7 hours ago | parent [-] | | I'm glad you got out, but given your vantage point what would you say to those who feel pressured to do these types of jobs? Would you say more "it isn't worth it" or "if you have to... but get out as fast as possible" or something else? | | |
| ▲ | notyourwork 4 hours ago | parent [-] | | Money pays the bills. It’s probably not deeply rooted. | | |
| ▲ | godelski 4 hours ago | parent [-] | | Forgive me, but I'd actually like to hear vrosas's response or someone else with a similar background. I appreciate you trying to answer my question and help try to make me informed, but I don't want to hear speculation, especially the rather obvious ones. That's not helping, it just adds more noise to the conversation and discourages a response by them. We all know money pays the bills, no one needs to hear that. But hey, if that's what they say, then you'll be proven right. So let's wait and find out. I really do want to understand their mentality. I hope you do too because how else do we break the cycle? | | |
| ▲ | freedomben 34 minutes ago | parent | next [-] | | I've talked to a lot of engineers building DRM technology, and most of them are just a combination of swept up in the fun of the challenge, and also deeply bought into the idea of protecting intellectual property. I would say probably 90% don't see any philosophical issues with what they're building at all. If you can convince them of that, quite a few of them would probably try to get out, but it's quite an uphill battle. I forget who said the quote and the exact words, but something along the lines of it's very difficult to disabuse somebody of a belief when their livelihood depends on believing it. As someone who was in an industry that I later discovered was doing things I wasn't personally ethically okay with, I would advise them to do similar to me. Start looking for a new gig and just get out as soon as you can. Unfortunately as an individual there just isn't much you can do. There will always be someone willing to do the job that you aren't willing to do. Just get out and find something you can sleep at night doing | |
| ▲ | vrosas 33 minutes ago | parent | prev [-] | | My man’s not wrong. Adtech has some seriously cool engineering problems and scale. It’s its own form of high frequency trading mixed with everyone you’d imagine from a modern day Mad Men. Plus tons and tons and tons of money. |
|
|
|
| |
| ▲ | nospice 12 hours ago | parent | prev | next [-] | | It makes its creator the money they can spend buying the products they see in TV ads. | |
| ▲ | cephi 11 hours ago | parent | prev [-] | | If someone is going to get paid to build it anyway, I might as well be the one getting paid for it. | | |
| ▲ | catoc 5 hours ago | parent | next [-] | | This attitude is the reason “someone is going to get paid”. If you see a unattended laptop in a coffeeshop, do you steal it because “someone will steal it, so it might as well be me”? | | |
| ▲ | nertirs3 3 hours ago | parent [-] | | Why stop here? We can also blame the people, who implemented such features on the TVs, the people who worked at companies, who used data acquired by these devices for advertisement, the people who worked on the mentioned ads for such devices and the people who bought products from companies, that spend money on such marketing techniques. At this point you might as well blame the average guy for global warming... | | |
| ▲ | acrump 2 hours ago | parent [-] | | The average guy is exactly the person responsible for global warming. The evil of the world is just the meta accumulation of the average person following their mirco incentives. |
|
| |
| ▲ | cryptonym 7 hours ago | parent | prev | next [-] | | Where do you draw the line? Ready to do anything for money as long as it seems legal-ish or your ass is covered by hierarchy? | | |
| ▲ | abirch 3 hours ago | parent [-] | | If something should not be done: make it illegal. Trying to have a gentlemen's agreement not to do something seems like a futile position. | | |
| ▲ | cryptonym 2 hours ago | parent [-] | | Having you own morale and ethics is far from futile. Each individual should be able to question the law and object taking part in something they don't agree, as long as it doesn't break the law. Killing someone is legal in certain countries for different reasons (I'm not talking about war). Not sure I would like to get involved in that business, for instance if I don't agree on how and why people are sentenced to death in my country. Some people are built with low ethics. Sure, if it's not made illegal, they'll always find someone to do it. Looks like in that case it might be illegal, as TV makers are sued. |
|
| |
| ▲ | Sharlin 10 hours ago | parent | prev [-] | | Yeah, there are reasons why "someone is going to do it anyway" is a classic example of an ethically unsound argument. | | |
| ▲ | torstenvl 10 hours ago | parent | next [-] | | It isn't ethically unsound. It's a commons/coordination problem. What is the optimal strategy in infinite-round prisoners dilemma with randomized opponents? The randomization effectively makes it an infinite series of one-round prisoners dilemma. So the best strategy is always to defect. The only way you can change this is very high social trust, and all of society condemning anyone who ever defects. | | |
| ▲ | jsrozner 9 hours ago | parent | next [-] | | If morality never factors into your own decisions, you don't get to be upset when it doesn't factor into other peoples'. In other words, society just sucks when everyone thinks this way, even if it true that resolving it is hard. | | |
| ▲ | nativeit 8 hours ago | parent | next [-] | | This is called a “replacement excuse”. It’s a hallmark of nihilists and utilitarians, but I tend to prefer the more prosaic group noun, “jerks”. | |
| ▲ | torstenvl 2 hours ago | parent | prev [-] | | This is an intellectually and morally deficient position to take. There is no moral principle in any system anywhere in the history of the universe that requires me to bind myself to a contract that nobody else is bound to. We can all agree, as a society, "hey, no individual person will graze more than ten cows on the commons," and that's fine. And if we all agree and someone breaks their vow, then that is immoral. "Society just sucks when everyone thinks this way" indeed. But if nobody ever agreed to it, and you're out there grazing all you're cattle, and Ezekiel is out there grazing all his cattle, and Josiah is out there grazing all his cattle, there is no reasonable ethical principle you could propose that would prevent me from grazing all my cattle too. | | |
| ▲ | ReluctantLaser 36 minutes ago | parent [-] | | > There is no moral principle in any system anywhere in the history of the universe that requires me to bind myself to a contract that nobody else is bound to. Is there not? I don't feel this makes sense to me, as the conclusion seems to be "if everyone (or perhaps a large amount of people) do it, then it's not immoral". My immediate thought goes to moral systems that universalise an action, such that if everyone did it and it makes the world worse, then it's something that you should not do. That would be an example of a system that goes counter to what you say. Since morals are personal, you can still have that conclusion even if other people do not subscribe to the same set of moral beliefs that you have. Something can be immoral to you, and you will refuse to do it even if everyone else does. > But if nobody ever agreed to it [...] there is no reasonable ethical principle you could propose that would prevent me from grazing all my cattle too. Why not? I don't quite understand your conclusion. Why could the conclusion not be "I feel what everyone else is doing is wrong, and I will not do it myself"? Is it because it puts you at a disadvantage, and you believe that is unfair? Perhaps this is the "reasonable" aspect? | | |
| ▲ | torstenvl 10 minutes ago | parent [-] | | Your confusion is understandable. The way the terms "moral" and "ethical" are thrown around is sloppy in most vernacular. Generally, ethics refers to system-wide morality. E.g., I may feel that personal morality compels me to offer lower rates to clients, even though a higher rate may be acceptable under legal ethics. I tried to make that distinction clear in my post ("moral principle in any system") but perhaps I didn't do a good enough job. The original poster was not referring to individual moral feelings, but to formal ethical systems subject to systematized logical thinking: "classic example of an ethically unsound argument." There is no religious tradition, no system of ethics, no school of thought in moral philosophy, that is consistent with that position. The closest you might come is Aristotelian virtue ethics. But it would be a really strained reading that would result in the position that opting out of commons mismanagement is required. Aristotle specifically said that being a fool is not a virtue. If anything, a virtue ethics lens would compel someone to try to establish formal community rules to prevent the tragedy of the commons. |
|
|
| |
| ▲ | godelski 7 hours ago | parent | prev [-] | | It is definitely ethically unsound and it is definitely a common example even related to Nazis. Similar to "just following orders". Which I'll remind everyone, will not save you in a court of law[0]... You are abdicating your own moral responsibility on the assumption of a deterministic reality. The literal textbook version of this ethical issue, one you'll find in literally any intro to ethics class is If I don't do this job then somebody else will. The only difference is that I will not get paid and if I get paid I will do good with that money where as if somebody else gets paid they might not.
Sometimes a variant will be introduced with a direct acknowledgement of like donating 10% of your earnings to charity to "offset" your misgivings (ᶜᵒᵘᵍʰ ᴱᶠᶠᵉᶜᵗᶦᵛᵉ ᴬˡᵗʳᵘᶦˢᵐ ᶜᵒᵘᵍʰ).But either way, it is you abdicating your personal responsibility and making the assumption that the job will be done regardless. But think about the logic here. If people do not think like you then the employer must then start offering higher wages in order to entice others. As there is some function describing people's individual moral lines and their desire for money. Even if the employer must pay more you are then helping deter that behavior because you are making it harder to implement. Alternatively the other person that does the job might not be as good at the job as you, making the damage done less than had you done the job. It's not hard to see that often this will result in the job not even existing as truthfully these immoral jobs are scraping the bottom of the barrel. Even if you are making the assumption that the job will be done it would be more naive to assume the job is done to the same quality. (But kudos on you for the lack of ego and thinking you aren't better than other devs) [0] https://en.wikipedia.org/wiki/Superior_orders | | |
| ▲ | 20after4 7 hours ago | parent | next [-] | | Most of those convicted at the Nuremberg trials eventually had their sentences commuted and only served a fraction of their time. Only a few were convicted and executed. Justice rarely prevails. | | | |
| ▲ | torstenvl 2 hours ago | parent | prev | next [-] | | Objectively incorrect. There is no reasonable argument that it's ethically unsound. The fact that you immediately Godwin'd should have been your first clue. | |
| ▲ | bannana2033 7 hours ago | parent | prev [-] | | > will not save you in a court of law Not in the USA. LEO or ICE - or even some judges misuse and never are punished. Qualified immunity. Moral is different story. Too many people in HN work in Google or Apple. That by itself if immoral. | | |
| ▲ | godelski 4 hours ago | parent [-] | | > even some
Some is a keyword.Some doesn't change the law. You're right to push back in case I intended something different. But I'll state this clearly: those LEO, ICE agents, and judges are committing crimes. But the fact that not all criminals are punished or prosecuted does not change the laws either. What I'm concerned about is people becoming disenfranchised and apathetic. Dismissing the laws we have that does punish LEO, ICE agents, and judges for breaking the laws. To take a defeatist attitude. Especially in this more difficult time where that power is being abused more than ever. But a big reason it is being able to be abused is because a growing apathetic attitude by people. By people giving up. So I don't know about you and your positions. I don't know if you're apathetic or invested. All I know is a random comment from a random person. It isn't much to go on. But I hope you aren't and I hope you don't spread apathy, intentionally or not. |
|
|
| |
| ▲ | whacko_quacko 8 hours ago | parent | prev [-] | | Care to articulate them? | | |
| ▲ | avsteele 3 hours ago | parent | next [-] | | If you want a consequentialist answer: If, for ethical reasons, fewer people were willing to take these jobs, then either salaries would have to rise or the work would be done less effectively. If salaries rise, the business becomes more expensive and harder to scale.
If effectiveness drops, the systems are less capable of extracting/using people’s data. Either way, refusing these jobs imposes real friction on the surveillance model. If you want a deontological answer: You have a responsibility not to participate in unethical behavior, even if someone else would. | |
| ▲ | Sharlin 4 hours ago | parent | prev [-] | | The fact that it can be used to "justify" almost anything. It obviously doesn't work as a defense in the court, and neither does it work as a justification for doing legal but unethical things. |
|
|
|
| |
| ▲ | c16 3 hours ago | parent | prev [-] | | Would love to know what are the best things we can do to prevent this sort of tracking in general. PiHole? Don't re-use emails? On a scale of 1 to fucked are we cooked? |
| |
| ▲ | nemomarx 17 hours ago | parent | prev | next [-] | | I don't think they mean that kinda streamer - the idea is the roku tv can tell you're watching an ad even if it's on amazon prime, apple tv, youtube, twitch, wherever, and associate the ad watching with your roku account to potentially sell that data somehow? That way they aren't cut out of the loop by you using a different service to watch something and still have a 'cut'. | | |
| ▲ | nitwit005 17 hours ago | parent [-] | | It'd make sense if they're using streamer in a different sense than I'm used to. I see that's at the bottom of the definitions Google will produce. | | |
| ▲ | nemomarx 16 hours ago | parent [-] | | Yeah I think they mean "user of a streaming service" here, which would more conventionally be user or watcher or so on. |
|
| |
| ▲ | ozim 4 hours ago | parent | prev | next [-] | | Confirming how many people actually seen the ad is worth big bucks. No one wants to pay for ads they cannot confirm and publisher can make up impressions - if you can catch publisher making up numbers you might get a huge discount or loads of money back. | |
| ▲ | alias_neo 5 hours ago | parent | prev | next [-] | | That's the thing about scaling; you offload the work to the "client" (the TV in this case) and make it do the work, it need not send back more than a simple identifier or string in an API call (of course they'll send more), so they get to use a little bit of your electricity and your TVs processing power to collect data on you and make money, with relatively little required from them, other than some infra to handle the requests, which they would have had anyway to collect the telemetry that makes them money. Client side processing like this is legitimate and an excellent way to scale, it just hits a little different when it's being used for something that isn't serving you, the user. source: backend developer | |
| ▲ | 0cf8612b2e1e 17 hours ago | parent | prev | next [-] | | I assume these systems are calculating an on device perceptual hash. So not that much data needs get flown back to the mothership. | |
| ▲ | Cthulhu_ 6 hours ago | parent | prev | next [-] | | Not necessarily, it can be done on-device, the screenshot hashed, and the results deduplicated and accumulated over time, then compressed and sent off in a neat package. It'd still be a huge amount of data when you add it all up, but not too different from the volume that e.g. web analytics produces. Then server-side the hash is matched to a program or ad and the data accumulated and reduced even further before ending up in someone's analytics dashboard. | |
| ▲ | klik99 17 hours ago | parent | prev | next [-] | | Are there video "thumbprints" like exists for audio (used by soundhound/etc) - IE a compressed set of features that can reliably be linked in unique content? I would expect that is possible and a lot faster lookup for 2 frames a second. If this is the case, the "your device is taking a snapshot every 30 seconds" sounds a lot worse (not defending it - it's still something I hope can be legislated away - something can be bad and still exaggerated by media) | | |
| ▲ | woodson 17 hours ago | parent | next [-] | | There are perceptual hashing algorithms for images/video/audio (dsp and ML based) that could work for that. | | |
| ▲ | tshaddox 16 hours ago | parent [-] | | Given that the TV is trying to match one digital frame against another digital frame, you could probably get decent results even with something super naive like downsampling to a very low resolution, quantizing the color palette, then looking for a pixel for pixel match. All this could be done long before any sort of TV-specific image processing, so the only source of "noise" I can think of would be from the various encodings offered by the streaming service (e.g. different resolutions and bitrates). With the right choice of downsample resolution and color quantization I have to imagine you could get acceptable results. | | |
| |
| ▲ | Rediscover 15 hours ago | parent | prev [-] | | I've been led to believe those video thumbprints exist, but I know the hash of the perceived audio is often all that is needed for a match of what is currently being presented (movie, commercial advert, music-as-music-not-background, ...). | | |
| ▲ | lurk2 6 hours ago | parent [-] | | This is why a lot of series uploaded to YouTube will be sped up, slowed down, or have their audio’s pitch changed; if the uploader doesn’t do this, it gets recognized by YouTube as infringing content. |
|
| |
| ▲ | Spooky23 17 hours ago | parent | prev | next [-] | | You only need to grab a few pixels or regions of the screen to fingerprint it. They know what the stream is and can process it once centrally if needed. | | | |
| ▲ | bequanna 17 hours ago | parent | prev | next [-] | | The actual screenshot isn’t sent, some hash is generated from the screenshot and compared against a library of known screenshots of ads/shows/etc for similarity. Not super tough to pull off. I was experimenting with FAISS a while back and indexed screenshots of the entire Seinfeld series. I was able take an input screenshot (or Seinfeld meme, etc) and pinpoint the specific episode and approx timestamp it was from. | | |
| ▲ | autoexec 16 hours ago | parent [-] | | > The actual screenshot isn’t sent, some hash is generated from the screenshot and compared against a library of known screenshots of ads/shows/etc for similarity. this is most likely the case, although there's nothing stopping them from uploading the original 4K screengrab in cases where there's no match to something in their database which would allow them to manually ID the content and add a hash or just scrape it for whatever info they can add to your dossier. |
| |
| ▲ | htrp 17 hours ago | parent | prev | next [-] | | Attribution is very painful and advertisers will pay lots of money to close that loop. | |
| ▲ | airza 12 hours ago | parent | prev | next [-] | | Is it? I don’t think you need particularly high fidelity to fingerprint ads/programs. | |
| ▲ | micromacrofoot 16 hours ago | parent | prev | next [-] | | it's hashed on the tv then they compare hashes in aggregate | |
| ▲ | marbro 17 hours ago | parent | prev [-] | | [dead] |
|
|
| ▲ | ms7m 18 hours ago | parent | prev | next [-] |
| This is especially annoying and just incredibly creepy -- I was watching a clip of Smiling Friends on YouTube (via my Apple TV), and I suddenly got a banner telling me to watch this on HBO Max. I never felt more motivated to pi-hole the TV. |
| |
| ▲ | gruez 17 hours ago | parent | next [-] | | >I never felt more motivated to pi-hole the TV. Or just disconnect from the internet entirely? You already have an apple tv. Why does your tv need internet access? | | |
| ▲ | hotstickyballs 17 hours ago | parent | next [-] | | TVs tend to incessantly ask for internet access, especially android ones. | | |
| ▲ | loloquwowndueo 17 hours ago | parent [-] | | Then don’t buy an Android tv? | | |
| ▲ | scheeseman486 5 hours ago | parent [-] | | The problem with 'well just don't buy it' is that in many product categories, enshittification has become so entrenched that there are no longer options to avoid it. The availablity of product features is driven by market forces, if it's no longer profitable to sell a TV that doesn't require online connectivity for the purposes of ads, then such TVs will no longer be sold. Alternatives like using monitors designed for digital signage come with drawbacks. Expense, they don't have desirable features like VRR, HDR or high refresh rates, since they aren't needed for those use cases. Older TV models will break and supply will dry up. In the long term, this problem, not just TVs but the commercial exploitation of user data across virtually all electronic devices sold, isn't something that can be solved with a boycott, or by consumers buying more selectively. The practice needs to be killed with legislation. | | |
| ▲ | loloquwowndueo 4 hours ago | parent [-] | | Good point. I’ll just argue about HDR and high frame rates being desirable features :) I don’t even know what VRR is. | | |
| ▲ | zie 2 hours ago | parent [-] | | VRR is Variable refresh rates, so if there is nothing going on in the content, they can bring the refresh rate down and save processing, thermal issues and energy. If there is a lot going on(say a game), they can ramp the refresh rate back up super high. There are a few different "standards" around VRR, not every device supports all of them. |
|
|
|
| |
| ▲ | cluckindan 17 hours ago | parent | prev [-] | | Some TVs have a dedicated mobile connection, there is a SIM card and baseband radio inside. Of course only they can use it, not you. | | |
| ▲ | bannana2033 7 hours ago | parent | next [-] | | You mean they pay for data charges? Don't be stupid. | |
| ▲ | gruez 16 hours ago | parent | prev [-] | | Source? This sort of conspiracy started with "smart tvs will connect to open wifi networks", then evolved to "it uses amazon sidewalk", and apparently now morphed into "tvs have 5g modems". Given how poorly supported the prior claims were, that does not bode well for the 5G claim. | | |
| ▲ | devsda 12 hours ago | parent | next [-] | | Isn't that one of the marketed advantages of 5G. Lot of smart IoT devices including TVs being able to connect independently. What we are lacking is implementation but the tech and probably the intent was always there. If HDMI ethernet connectivity(HEC) had gained traction, we would have seen a fire stick, apple tv or roku providing internet to your tv without asking for explicit consent. | |
| ▲ | dzhiurgis 8 hours ago | parent | prev | next [-] | | Sounds obvious for TV manufacturers to do this if they plan to spy on you and sell ads you can't hide. Same with locking down firmware. | | | |
| ▲ | cluckindan 16 hours ago | parent | prev | next [-] | | You said 5G, not me | | |
| ▲ | gruez 16 hours ago | parent [-] | | I agree that I misquoted you, but that's a distinction without a difference in this context. "SIM card and baseband radio inside" means 5G, 4G, 3G, whatever. I still demand that you produce proof that there are TVs with "SIM card and baseband radio inside". | | |
| ▲ | pests 14 hours ago | parent [-] | | I was curious so I did some research. These devices do seem to be being produced, currently mostly overseas. The inclusion of 5G support does not seem to be hidden or nefarious. They provide a SIM card slot just like your phone would. Some models are incorporating a built-in router to provide connectivity to other devices. It seems like the cellular companies are promoting these TV's too, with built in service. My opinion is this is just a consolidation of devices. I have many friends who live off their phone data plan giving hotspot to the TV and other devices. Now being moved into a common device format, the TV. I don't think they can spy any more effectively this way. Eexcept via the router integration that gives them way more access, but I'm sure this exists already as a wifi feature on tvs. Just technology trudging along. Perhaps they have a secret sim card or esim embedded, that might be a risk as the hardware is already there for a valid reason. |
|
| |
| ▲ | netsharc 16 hours ago | parent | prev [-] | | Every time the topic is TV on HN someone repeats this conspiracy or that "it'll happen soon!"... This place like a flat-earther gathering sometimes. |
|
|
| |
| ▲ | danielscrubs 7 hours ago | parent | prev | next [-] | | You could try getting an European TV, at least then it will ask and you can say no. | |
| ▲ | ribosometronome 16 hours ago | parent | prev [-] | | A banner from Apple or your TV trying to navigate you back to its own HBO app? | | |
| ▲ | the_gastropod an hour ago | parent [-] | | The latter. In addition to being creepy, it’s such a horrible “feature”. I can’t imagine who thought it was a good idea. |
|
|
|
| ▲ | TimPC 16 hours ago | parent | prev | next [-] |
| It’s far less important for ad-free content. They mainly want to connect your ad watching behaviour to an email and then have loyalty program data connected to the same email so that they can identify which ads convert vs not. |
| |
| ▲ | afavour 16 hours ago | parent [-] | | It’s still a privacy violation a lot of people would be outraged by if they knew it. Tracking what shows you are watching is a valuable data set. | | |
| ▲ | phyzix5761 6 hours ago | parent | next [-] | | I'm surprised to see how few of my non-technical friends and family actually care about privacy. | |
| ▲ | sroussey 10 hours ago | parent | prev [-] | | It’s right there in your TV’s settings though. Personally, I don’t trust them to obey the setting so my TV has no internet and I use an Apple TV. | | |
| ▲ | rockskon 8 hours ago | parent [-] | | In your settings under how many nested menus under which deceptively named option? And how many options do you need to toggle to actually opt out? |
|
|
|
|
| ▲ | mapt 2 hours ago | parent | prev | next [-] |
| Does this apply for external video inputs, outside of the smart TV OS? I guess I can always just refuse the TV OS access to the wifi, assuming they're not using 4G modems. |
|
| ▲ | RataNova 6 hours ago | parent | prev | next [-] |
| The only real question is whether they're doing screen-level analysis or just relying on app telemetry |
| |
| ▲ | the_gastropod an hour ago | parent [-] | | If I’m understanding you right, I’m confident it’s screen analysis. I have a Hisense Roku TV I exclusively use with an AppleTV. I get creepy intrusive popups telling me: “you could be watching this on other streaming providers!” all the time. So it “knows” what’s being displayed on the screen regardless of what app (or HDMI input) is being used. |
|
|
| ▲ | nrhrjrjrjtntbt 18 hours ago | parent | prev | next [-] |
| So potentially completely noncompliant if used in a business. E.g. it may have HIPAA, top secret etc. |
| |
| ▲ | cluckindan 17 hours ago | parent | next [-] | | Boardroom presentation TVs in publicly traded companies would yield insider information. | |
| ▲ | gruez 17 hours ago | parent | prev | next [-] | | Sending 4k screenshots twice a second to a server would be tremendously bandwidth hungry. My guess is that it's all done locally. | | |
| ▲ | treyd 17 hours ago | parent [-] | | There's probably compact signatures extracted from the screenshots (color profiles, OCR, etc) which are then uploaded later in bulk. You don't need the full original image to be able to reliably uniquely identify the content if you have an index of it already. | | |
| ▲ | floxy 17 hours ago | parent [-] | | I'm wondering if there is some sort of steganographic watermark that broadcasters are including in media, to enable stuff like this. Probably would need to be robust in the presence of re-encoding, more compression, etc.. | | |
|
| |
| ▲ | kevin_thibedeau 17 hours ago | parent | prev | next [-] | | It is a violation of the VPPA to collect this for streaming services and prerecorded media. Scheduled broadcast and cable TV aren't covered. | | |
| ▲ | aidenn0 17 hours ago | parent [-] | | I thought the 2013 amendment to the VPPA largely defanged it by allowing sharing with customer consent (which is probably one of the clauses in the million-word customer agreement nobody reads). | | |
| ▲ | sailfast 14 hours ago | parent [-] | | Pretty sure that’s why this lawsuit will have some legs - the deceptive way folks are opted in without really understanding what is happening. I’m shocked to be agreeing with Ken Paxton but he’s right on this one. |
|
| |
| ▲ | Spooky23 17 hours ago | parent | prev | next [-] | | Yeah that’s why Webex is still in business. TVs are a great entry point to LANs. | |
| ▲ | MangoToupe 15 hours ago | parent | prev [-] | | > HIPAA Are health providers using PS5s in a context where information may be leaked to other providers? What kind of information would you expect to be displayed that might violate HIPAA? | | |
| ▲ | nrhrjrjrjtntbt 13 hours ago | parent [-] | | Patient xray for example, blown up on big tv | | |
| ▲ | lurk2 6 hours ago | parent | next [-] | | As other users mentioned, these screenshots are almost certainly not being transmitted as screenshots as the bandwidth costs would be enormous. The screenshots are converted to a hash on the user’s device before being sent to a server where the hash is compared to a database of known hashes. A user’s x-ray would just appear as a hash. This might still constitute a HIPAA violation, but I doubt it. | | | |
| ▲ | MangoToupe 9 hours ago | parent | prev [-] | | This seems like an extremely unrealistic scenario for a given ps5 Also how would other providers be privvy to this view of this xray? | | |
| ▲ | nativeit 8 hours ago | parent [-] | | I’m not sure what relevance there is to other providers? I work with a lot of small medical offices, and they do use consumer Smart TVs in some contexts. I typically limit their network access for other reasons, and displaying X-rays isn’t something I’ve personally facilitated, but it wouldn’t shock me to discover it’s being done in other clinics, and the popularity of cloud-based ePHR software has left a lot of smaller clinics with very limited internal I.T. services. The destination isn’t relevant, if the image leaves the clinic at all without consent, that’s a HIPAA violation. Fortunately, I think it’s more likely that the images are sampled and/or hashed in a way that means the full image isn’t technically transmitted, but considering the consequences and costs of a data breach, I’d definitely be wary of it. |
|
|
|
|
|
| ▲ | gausswho 15 hours ago | parent | prev | next [-] |
| I'd like to weaponize all this scanning into a force for good. Instead of phoning home to Roku, send the fingerprints up to an ADID database registering every ad on the planet. Open up an API so that any video stream can detect an ad and inject Max Headroom replacement clips. Come on hackers. We could murder the global economy with this shit. |
| |
| ▲ | lodovic 6 hours ago | parent [-] | | I've been thinking about this as well - make a small device that in real time detects ads and turns off audio an video while it's playing. I'd rather see a blank screen than an ad. That way, the whole ad pyramid scheme stays intact while the conversion rates plummet. | | |
| ▲ | Griffinsauce 3 hours ago | parent | next [-] | | > while the conversion rates plummet. Isn't the segment who will set this up also likely to have a low conversion rate to begin with? You'd need to make it so easy that it becomes fully mainstream. I suspect that's what happened to adblockers, it got a bit too "standard" for (Google's) comfort. | |
| ▲ | xnx 6 hours ago | parent | prev [-] | | Same here. I've done this for podcasts (not in real time) and it works great. TV should be easier in some ways since the video stream and captions can also indicate an ad. | | |
| ▲ | RegW 4 hours ago | parent [-] | | I used to find when listening to a good many podcasts with VLC there would be: > ... See you after the break. brief pause > And we're back ... Unfortunately, most ads are now burnt in. The 10 second advance will skip through them, but as it's usually the host parroting the ad text and it's easy to over shoot. |
|
|
|
|
| ▲ | metabagel 17 hours ago | parent | prev | next [-] |
| Time for me to get Apple TV. |
| |
| ▲ | fn-mote 15 hours ago | parent | next [-] | | This is not sufficient because the TV you are showing the video on can (does/will) take the screencaps. | | |
| ▲ | HelloMcFly 14 hours ago | parent [-] | | If you have a plugged-in device, then you can just disconnect the TV from the network. |
| |
| ▲ | cluckindan 17 hours ago | parent | prev [-] | | As if it didn’t track your habits as well. | | |
| ▲ | crazygringo 17 hours ago | parent [-] | | ...it doesn't. Like, Apple knows what you're watching within the Apple TV app obviously. But it's certainly not taking screenshots every second of what it displaying when you use other apps -- which shows and ads you're seeing. Nor does Apple sell personal data. Other video apps do register what shows you're in the middle of, so they can appear on the top row of your home screen. But again, Apple's not selling that info. | | |
| ▲ | lokar 16 hours ago | parent [-] | | Having each app report what is going on vs figuring it out from a screenshot locally is the same from a privacy POV. But I do trust apple more | | |
| ▲ | crazygringo 16 hours ago | parent [-] | | A lot of this stuff is actually being used to track which ads are being watched. Apps definitely aren't reporting those. | | |
| ▲ | autoexec 12 hours ago | parent [-] | | Like all data collection you can bet that the data our smart TVs and devices take from us is (or one day will be) used for a lot more than just ads. |
|
|
|
|
|
|
| ▲ | micromacrofoot 16 hours ago | parent | prev | next [-] |
| The PS5 doesn't need to, they get it all in metadata because they control the full stack — TVs do it because they have less control over sources. |
| |
| ▲ | dontlaugh 16 hours ago | parent | next [-] | | The PS5 does actually record video all the time in a ring buffer. That’s how when you press the share button, it includes a video of the recent past. | | | |
| ▲ | brcmthrowaway 13 hours ago | parent | prev [-] | | Is the PS5 not jailbroken? | | |
| ▲ | autoexec 12 hours ago | parent [-] | | I'm sure somebody's done it, but mine isn't. I do make sure to pull the microphones out of the controllers at least so while they can watch everything I'm doing on my screen they can't listen to the entire house. |
|
|
|
| ▲ | next_xibalba 2 hours ago | parent | prev | next [-] |
| I'm fairly puzzled by my own reaction to this. I'm indifferent to YouTube have frame-by-frame nanodata about me. But as a Roku user, this snap shotting makes me very angry. Maybe because much of what I watch on my TV via my Roku is content I own and stream from my personal server? |
|
| ▲ | jgalt212 17 hours ago | parent | prev [-] |
| > > Roughly twice per second, a Roku TV captures video “snapshots” in 4K resolution. Isn't that too much data to even begin to analyze? The only winner here seems like S3. |
| |
| ▲ | nativeit 8 hours ago | parent [-] | | It runs a hashing algorithm locally, I believe, rather than transmitting the entire image. pHash or something similar would work. |
|