Remix.run Logo
tdb7893 2 hours ago

For point 2: I don't think there's really good or bad places to study it, it might not generalize to sunnier places but the reverse is also true. Presumably the scientists working on this can understand these things (I know in my field I'm aware that studies in the tropics will find different things than studies in Canada).

For my own point: in this study they have like 22 test values but still use the 95% confidence interval. Even on random data there will be a significant result like a third of the time so I think it's easy to interpret these result as more definitive than they are. Not that it's a bad study though (no study will be everything, baby steps like this are important in science).

senkora an hour ago | parent [-]

I just skimmed the summary but in the results section it reports three significant results and two after “multiple-test correction”. I’m not sure how they did that correction; I would expect that measures of cognitive performance are correlated for each child and so the standard Bonferroni correction might be too harsh to apply here.

> Covariate-adjusted analyses of standardized scores (mean [SD], 0 [1]; higher values indicating better performance) showed positive associations of high-dose vitamin D3 with verbal memory (β = 0.17 SD; 95% CI, 0.03-0.32 SD; P = .02), visual memory (β = 0.24 SD; 95% CI, 0.06-0.42 SD; P = .01), and flexibility or set shift (β = 0.19 SD; 95% CI, 0.01-0.37 SD; P = .04); however, high-dose vitamin D3 was no longer associated with flexibility or set shift after multiple test correction.

tdb7893 33 minutes ago | parent [-]

My statistics isn't great but reading the study more it looks like they control the rate of false positives via the q values so my initial concern may be unwarranted. I'm surprised that it keeps so many barely significant results with so many hypotheses. I'll have to look it up when I get time.