Remix.run Logo
VivaTechnics 18 hours ago

- With the advent of LLMs, sites like StackOverflow are effectively obsolete—robots.txt or not.

- It’s the inevitable consequence when companies cease to innovate.

integralid 2 hours ago | parent | next [-]

Was stackexchange, a web forum company, supposed to innovate an LLM?

VivaTechnics an hour ago | parent [-]

I never claimed Stack Exchange should’ve pioneered LLMs. But it’s not merely a web forum company—just as Google isn’t just a search company. Stack Exchange is a 15-year-old tech firm that has stagnated. Innovation has been virtually nonexistent; their idea of progress has long been superficial UI tweaks on a legacy platform.

Even now, Stack Exchange resists adaptation. This very post highlights their `robots.txt` policy, which actively blocks crawlers—a clear signal of protectionism over transparency. They market themselves as community-driven, but the reality is far more corporate and insular.

Stack Overflow’s situation is telling: while search traffic is down a modest –5% to –14% (per their own data), engagement metrics are in freefall. Weekly posts have dropped 16%; monthly questions are down as much as 66% from their peak. That’s not a dip—it’s systemic decay.

15 hours ago | parent | prev | next [-]
[deleted]
marbro 12 hours ago | parent | prev [-]

[dead]