Remix.run Logo
Marketers are Addicted to Bad Data (2020)(jacquescorbytuech.com)
29 points by zbentley 4 days ago | 33 comments
jhartikainen 10 minutes ago | parent | next [-]

I work in adtech. We actually had to mangle some of our analytics data because it didn't match the broken data a client was used to. Our data was more accurate, but because the numbers didn't match the other analytics suite the client used, so we had to make it worse.

I wish I was joking.

bigbuppo 22 minutes ago | parent | prev | next [-]

Yeah, but with one more piece of data they'll have solved personalized mattress sales forever. Nevermind that the entity collecting the marketing data is a convenience store chain and doesn't sell their data, allegedly.

hermitcrab 3 hours ago | parent | prev | next [-]

The average time on site and bounce rates I have got from advertising my software inside ChatGPT and Reddit are so terrible that I can only assume that most of the clicks I am paying for are fraudulent, although it is not clear who is doing the fraud.

https://successfulsoftware.net/2026/08/13/my-experience-buyi...

https://successfulsoftware.net/2025/08/11/what-i-learned-spe...

hilariously an hour ago | parent | next [-]

The answer is at every level, and each level is separated into multiple sublevels of fraud.

hermitcrab an hour ago | parent | next [-]

What is the motivation for someone (other than OpenAI) to fraudulently click on my ad in ChatGPT?

consumer451 an hour ago | parent | next [-]

Many years ago I audited my friend's ~~AdWords~~ (I meant Google Search Ad) for his East Tennessee barn wedding venue. The local mom & pop SEO shop that set it up hadn't targeted any geo at all. Something like 60% of the clicks came from Malaysia, IIRC. CPC was around $2.

I could never figure out how that would work, or why. I mean, was Google actually doing this? That is hard to believe. But, who else would a have motivation to do that? I still have no idea what was going on there.

edit: I haven't dealt with ads forever, what I meant is the Google ads that appear in google search.

hermitcrab 40 minutes ago | parent | next [-]

People click on irrelevant ads. It doesn't cost them anything.

I bid on "seating plan" for my seating planner software in Adwords and lots of people searching for "747 seating plan" and similar clicked on my ads, despite the ads clearly being nothing to do with that. (I fixed with with setting "747", "a320" etc as negative keywords).

I don't think this is sufficient to account for the terrible engagement from ChatGPT ads though, unless the targetting is just garbage.

ThrustVectoring 43 minutes ago | parent | prev | next [-]

Google pays third-party websites to host advertisements, and shady website owners will put ads on such a website and bot clicks on it.

consumer451 30 minutes ago | parent | next [-]

I misspoke. I meant google search ads specificaly, not ads that appeared on 3rd party sites.

hermitcrab 39 minutes ago | parent | prev [-]

You can bid just on the ads that Google shows on its own website to avoid this.

hermitcrab 37 minutes ago | parent | prev [-]

But, yes, do set the correct geographic rea.

I have also audited other people's Adwords account. The horror.

uxhacker 36 minutes ago | parent | prev [-]

You competitors?

N_Lens 33 minutes ago | parent | prev [-]

It's fraud all the way down?!

jackp96 44 minutes ago | parent | prev [-]

I mean, paid traffic will almost always be worse than people actively seeking you out or finding you organically.

But I think there are definitely some opportunities for boosting your marketing/product strategy. Maybe ask ChatGPT for guidance on optimizing your advertising/marketing efforts?

I think there's enough low-hanging fruit (landing page that offers a free trial behind an email sign-up) that it'd probably help.

pandog 2 hours ago | parent | prev | next [-]

A lot of the time you are running experiments and seeing how the data changes, not looking at the data in a vacuum.

Many of the example critiques here don't apply so much when looking at the changes in data:

- if I got 50% more hits on my site this week vs last week, that's meaningful despite 36% of people blocking ads

- if my open rate doubled when I changed my email subject, also meaningful

The other examples are hard to pick holes in as they simply say "Z is a lie", but I can be looking at multiple data sources to decide how much of a lie Z is.

shostack 24 minutes ago | parent | next [-]

Having been at smaller companies without the data, tooling, discipline, and resourcing to conduct viable experiments, and then being at a company that is actually one of the best in the world at it and building solutions for these problems at scale for marketing teams, so many problems come back to the human element in how data is tracked, how teams collaborate or fail to which can lead to pollution and dirty data, and how decisions are made as the moment trade-offs need to be considered it becomes personal and enters messy human relationship territory.

But ultimately from a pure "did this work or not" standpoint you are right. Incrementality experiments are the gold standard.

N_Lens 31 minutes ago | parent | prev [-]

Following this kind of process blindly and optimising for it leads to a terrible product. However it can lead to more revenue in the short term.

bigbuppo 8 minutes ago | parent [-]

It leads to more tracking and higher marketing budgets. And sometimes it leads to more revenue, but since the marketing department is in charge of the statistics, well, did they really?

hackthemack 2 hours ago | parent | prev | next [-]

This has been known a long time. Freakanomics did a two part podcast on does advertising actually work. It is long but well worth a listen if you want to hear some science about advertising.

https://freakonomics.com/podcast/does-advertising-actually-w...

The second part goes into internet advertising.

https://freakonomics.com/podcast/does-advertising-actually-w...

There are transcripts of the episodes on the page if you want to read instead of listen.

antonvs 2 hours ago | parent [-]

> This has been known a long time.

This article predates that first Freakonomics episode by 11 days.

hackthemack 2 hours ago | parent [-]

The Freakonomics podcast goes into events that happened before 2020. It mentions the following article, for example.

https://thecorrespondent.com/100/the-new-dot-com-bubble-is-h...

natnat an hour ago | parent | prev | next [-]

> Marketers are addicted to bad data

This article cites a random Statista page for the "36% percent of people in the UK use an adblocker" stat.

brudgers 2 days ago | parent | prev | next [-]

If it gets you paid, it's good data.

If it makes your clients happy, it's good data.

Business data is for business purposes, not for science purposes.

dsjoerg 2 hours ago | parent | next [-]

Some people are in business to get paid by creating actual real value all the way down the chain to the ultimate customer. Those people are the ones you'd rather work for, and those are the ones who will care about "science purposes".

rtkwe 3 hours ago | parent | prev | next [-]

> Business data is for business purposes

I mean isn't the business purpose for the company running the ad campaign to actually increase revenue? Sure for an outside ad company just making the client happy is sufficient but for internal teams and the customer themselves the data is still bad.

scroblart 2 hours ago | parent | prev [-]

sure, but generally most businesses do wish to pay for fraudulent activity.

It seems we have reached a point in time where many "business people" seem unable to discern a difference between fraud and not-fraud, but whichever businesses those people are responsible for will not be sustainable enterprises in the long term.

calebkaiser 2 hours ago | parent | prev | next [-]

I dunno. There is a lot of valid and interesting criticism to write about digital marketing. Lots of people have attempted to study the efficacy of digital advertising, and I'd love to see a deep dive into the "MarTech" ecosystem and how shady much of it is. Anyone who has had to work on the go-to-market side of a company knows the general feeling of frustration the author is experiencing.

But this post reads like an aspiring "thought leader" posting a hot take to LinkedIn. It feels like lazy pandering to the "dumb marketers don't math good" crowd.

Here's the same author with a post titled "Marketing and The Modern Data Stack" where he gets very excited about the marketing automation and big data, kicking off the piece with line "There is a huge transformation happening in the data space." and really sells the data-driven future with "In short, you need data, lots of it and it needs to be tightly integrated across the entire customer lifecycle.": https://www.jacquescorbytuech.com/writing/marketing-modern-d...

kmeisthax 22 minutes ago | parent | prev | next [-]

The biggest spenders in the marketing business are doing so primarily to justify their own size. That is to say, if you're a trillion dollar business, you are going to spend a billion dollars on advertising purely to say that you spent a billion dollars on advertising. The quality of the data - or the clicks - matters less than the fact that you've bought your brand a sense of ubiquity. It's fractally nested corporate classism.

Direct response marketing - i.e. when you are buying ads specifically to get someone to buy a book - is a far smaller fraction of the market. It had a moment in the early 2000s when Google and later Facebook figured out how to extract lots of information about their customers and sell it on to other direct response marketers. But even then, the really lucrative marketers aren't legitimate businesses, they're scammers using the ability to micro-target ads to find their biggest rubes as cheaply and silently as possible.

If you're a regular person trying to buy ads for a legitimate business, you're probably going to get swamped by all of this and taken for multiple rides by several different kinds of scam.

hermitcrab 3 hours ago | parent | prev | next [-]

Various dodgy bots and crawlers hammer my website continually. Consequently, my web logs and analytics are garbage. So bad data is all we have, but it's better no data at all.

AlexandrB 2 hours ago | parent [-]

> A policeman sees a drunk man searching for something under a streetlight and asks what the drunk has lost. He says he lost his keys and they both look under the streetlight together. After a few minutes the policeman asks if he is sure he lost them here, and the drunk replies, no, and that he lost them in the park. The policeman asks why he is searching here, and the drunk replies, "this is where the light is".

[1] https://en.wikipedia.org/wiki/Streetlight_effect

hinkley 3 hours ago | parent | prev | next [-]

Everyone is addicted to bad data.

The Red-Green-Refactor pattern is a coping mechanism to deal with the fact that if we want a change to work and the build process tells us we didn't break anything, we bowl right past any subtle hints that we are in the wrong, and our whole code change is a house of cards standing on a bad assumption that will immediately collapse when breathed on.

I have a love-hate relationship with negative tests because of this, and I wonder if there's some way with static analysis or maybe AI to validate that the test that is green because nothing happened isn't green now because I broke the API and the test is now testing nothing in, nothing out instead of something in, nothing out.

Sooner or later in some refactor someone finds a way to break the code without CI catching it.

But we are just people. And if you squint you can see how our relationship to green builds is the same drive that management, sales, and marketing, and scientists get with charts that Make the Numbers Go Up even when the data is just correlated and the proximate cause they were looking for is a hallucination.

Mark Twain knew. Lies, Damned Lies, and Statistics.

reaperducer 3 hours ago | parent | prev | next [-]

Meta is most certainly addicted to bad data.

I believe this because Facebook continues to send spam to an e-mail address that was only used by me for my cat, and only once; and the cat has been dead for 15 years. The dead cat address received three spams from Facebook just yesterday.

There is also bad data out there about another cat that died ten years ago. He keeps getting snail mail from political candidates trying to convince him that they're deeply interested in the cares and concerns of people like him. A dead cat.

jdw64 an hour ago | parent | prev [-]

What is good data and what is bad data?