Remix.run Logo
jtrn an hour ago

Can you say p-hacking? It was designed and powered to test whether prenatal vitamin D reduces childhood asthma/wheeze, and found no effect on that primary outcome. The rest is just shuffling numbers and statistical methods around until something with p > .05 pops out.

They flags their own post hoc status, reports modest effect sizes, and applies some multiple-comparison correction. That makes the rhetorical sleight of hand harder to spot, because it's buried inside otherwise careful looking work.

The statistics are shit. They applied Benjamini-Hochberg FDR correction within cognitive domains, not across the family of 11 functions. That choice is what produced the headline "memory survived correction."

Watch what happens with the actual numbers. The two "winning" functions, verbal memory (p = .02) and visual memory (p = .01), both sit inside the memory domain — which contains exactly those two functions. BH within a 2-member family barely adjusts anything: the most lenient threshold is just 0.05, and both p-values are already under it, so the q-values come back at .02 and .02. The correction was toothless by construction, because the two hits happened to fall in the same tiny domain. A reviewer should have made them show the whole-family result side by side. The fact that they didn't is the tell. And there is much more that could be criticized in the same manner across the whole thing.

And then the observational data fail to corroborate the supplementation finding. The authors explain the mismatch via trimester timing of exposure, which is plausible, but the equally plausible reading is that the RCT hits are fragile, or that, more probably, it's not a real effect.

And even if there was an effect, it's so small and weak and NOT proven by even this data, that the recommendation for supplementation is not warranted at all. At best, this single study with their focus on recreating this effect is the only defensible conclusion. And yet they recommend supplementation.This is pure bias and D-vitamin cult babble once again.

The conclusion, based on the actual data, is: in a vitamin-D-sufficient cohort, high-dose prenatal D3 was not associated with offspring cognition on any whole-battery-corrected measure.

I hate this so much because it's stupidity like this that shows that science is not worth paying attention to, because the scientists basically lie through their teeth, at least from my perspective, where truth is something that is verifiable and relates to something real.