How do you test for ad effectiveness vs annoyance? Especially so for a captive audience where they can’t leave and go elsewhere?

It seems like every market leader that gets ads eventually “optimises” towards making them look like not ads. Obviously they will be more effective if people don’t realise what they are, so how do they account for annoyance (and the other negatives a user experiences) while doing these a/b tests?

▲

schubidubiduba 8 hours ago | parent | next [-]

Why would you care about annoyance when you captured your audience?

	▲	supermatt 8 hours ago \| parent [-]
		It is a question asking how you would do that if you cared. I.e how do you measure/quantify that annoyance as a metric when they are captive and have no choice to leave. Traditionally you would be able to measure annoyance by reduced usage, but that’s not the case in a captive market, so how do you measure it?

▲

akimbostrawman 9 hours ago | parent | prev [-]

>How do you test for ad effectiveness vs annoyance?

In a walled garden like apple? You simply don't, just make the test gradual and long enough until people get used to it.

	▲	supermatt 8 hours ago \| parent [-]
		That’s the way it appears, sure. But my question is how would you do it if you did care. What metric would there be you could measure if they have no choice but to use the product.