Remix.run Logo
Polizeiposaune a day ago

That rule would make it difficult to report on a failure to replicate a published paper.

toast0 a day ago | parent | next [-]

If the failure is replicated by multiple groups, that would be reportable.

Otoh, not sure that anyone wants to read a report that some finding that nobody reported on couldn't be replicated.

freediddy a day ago | parent | prev | next [-]

Every paper needs to include an independent replication of the study.

sethammons 21 hours ago | parent | next [-]

So build a second particle collider to validate what comes out of CERN?

monocasa a day ago | parent | prev [-]

If only we had that level of science funding.

hirvi74 a day ago | parent | prev [-]

Does some sort of batched style of research already exist? By batched, I mean a study where n number of teams all agree on a single methodology, and then conduct the same experiment simultaneously. Each team could then publish their results independently and the teams could publish one aggregate.

I know meta studies attempt to do this in a way, but they can sometimes have their own problems too.

I cannot recall coming across this style of research in much of what I have read as a hobby, but maybe it is more common in some domains than others? I am not smart, and there is nothing new under the Sun, so surely something like this exists, no?

yayamo a day ago | parent | next [-]

It doesn’t seem very popular but that exact thing does seem to exist, here called a ‘Registered Replication Report’:

https://www.psychologicalscience.org/publications/replicatio...

There are some completed which is cool. I agree that this seems like a great initiative.

Quekid5 a day ago | parent | prev [-]

Not quite what you're asking, but pre-registration does alleviate e.g. p-hacking and such without the need for multiple teams. It doesn't do much for outright fraud, but still...

mike_hearn a day ago | parent [-]

Only if the study matches its pre-registration and someone is checking that. Which it turns out, they often don't.

https://www.compare-trials.org/