Remix.run Logo
Nextgrid 15 hours ago

Every single thing for the past 10 years has had (opt-out, which most people didn't) telemetry and that correlates with a decline in quality, not improvement.

cosmic_cheese 15 hours ago | parent | next [-]

My suspicion is that this is due to three things:

- Use of analytics tends to replace user trials/interviews entirely, trading away rich signals for weaker ones

- Analytics can be used to justify otherwise unpopular or ill-advised changes

- When combined with certain changes (e.g. making features harder to access), the numbers can be “steered” in a particular direction to favor a particular outcome and better enable the last point (“Looks like nobody’s using that thing we hid behind an obscure feature flag! Guess we’re safe to remove it entirely now!”).

In theory telemetry/analytics have strong potential for improving software quality, but more often than not they’re just massaged and misused by product managers bent on pushing the software a particular direction.

roughly 3 hours ago | parent [-]

> Use of analytics tends to replace user trials/interviews entirely, trading away rich signals for weaker ones

Yeah, this is huge. The 30-day A/B test is a scourge on the industry.

wwweston 5 hours ago | parent | prev [-]

Telemetry in the hands of software craftsmen with a supporting business model will probably support improved software.

Telemetry in the hands of stakeholders whose stakes are business/career KPMs will probably serve those, and the software experience will follow.