« Dawn of p hacking | Main | Tesla is more than electric: Doug DeMuro, »

Replication studies

Jay Van Bavel, a social psychologist at New York University, has tweeted openly about a published nonreplication of one of his studies and believes, as any scientist would, that replications are an essential part of the process; nonetheless, he found the experience of being replicated painful. "It is terrifying, even if it's fair and within normal scientific bounds," he says. "Because of social media and how it travels -- you get pile-ons when the critique comes out, and 50 people share it in the view of thousands. That's horrifying for anyone who's critiqued, even if it's legitimate."

The field, clearly, was not moving forward as one. "In the beginning, I thought it was all ridiculous," says Finkel, who told me it took him a few years before he appreciated the importance of what became known as the replication movement. "It was like we had been having a big party -- what big, new, fun, cool stuff can we discover? And we forgot to double-check ourselves. And then the reformers were annoyed, because they felt like they had to come in after the fact and clean up after us. And it was true.


TrackBack URL for this entry:

Post a comment

(If you haven't left a comment here before, you may need to be approved by the site owner before your comment will appear. Until then, it won't appear on the entry. Thanks for waiting.)