Discussion about this post

User's avatar
Victor Kumar's avatar

I would upgrade my subscription if the paywalled version named names

Christopher J Ferguson, Ph.D.'s avatar

Great essay and thanks for sharing.

I remember PsychMAP and it's coconspirator Psych Methods. I didn't stay long in either for the exact reasons you mention (I didn't know about the sock puppets though).

My only quibble though is you say "the reformers have won"....I guess that's *sorta* true, but did they really? I'm less sure.

My casual observation is stuff like preregistration is still not the norm (and, of course, many papers don't follow their preregs). Even the "reformers" ignore stuff like crud/noise and the self-defensive arguments around small effect sizes that are likely false positives.

I think there's been progress, but I see it more like the rebels at the time of Bunker Hill rather than at Yorktown.

I saw someone put it recently (paraphrased and I forget who): "It's the same bad science, just with bigger samples". I sadly think that's mostly true.

In the end, do I have much more confidence in psychological science today than I did 20 years ago? I'd say not much. the main "change" psychology seems to have made due to the replication crisis, is simply to lower standards of evidence. Where (in my field) people used to brag about r = .3 (likely due to p-hacking), people simply started bragging about r = .03 with little change in message. Until we fix that, I don't think we've accomplished much.

21 more comments...

No posts

Ready for more?