Is Scientific Research In Trouble??
If there’s a central tenet that unites all of the sciences, it’s probably that scientists should approach discovery without bias and with a healthy dose of skepticism. The idea is that the best way to reach the truth is to allow the facts to lead where they will, even if it’s not where you intended to go.
But that can be easier said than done. Humans have unconscious biases that are hard to shake, and most people don’t like to be wrong. In the past several years, scientists have discovered troubling evidence that those biases may be affecting the integrity of the research process in many fields.
The evidence also suggests that even when scientists operate with the best intentions, serious errors are more common than expected because even subtle differences in the way an experimental procedure is conducted can throw off the findings.
When biases and errors leak into research, other scientists attempting the same experiment may find that they can’t replicate the findings of the original researcher. This has given the broader issue its name: the replication crisis.
Colin Camerer, Caltech’s Robert Kirby Professor of Behavioral Economics and the T&C Chen Center for Social and Decision Neuroscience Leadership Chair, executive officer for the Social Sciences and director of the T&C Chen Center for Social and Decision Neuroscience, has been at the forefront of research into the replication crisis. He has penned a number of studies on the topic and is an ardent advocate for reform. We talked with Camerer about how bad the problem is and what can be done to correct it; and the “open science” movement, which encourages the sharing of data, information, and materials among researchers.
What exactly is the replication crisis?
What instigated all of this is the discovery that many findings—originally in medicine but later in areas of psychology, in economics, and probably in every field—just don’t replicate or reproduce as well as we would hope. By reproduce, I mean taking data someone collected for a study and doing the same analysis just to see if you get the same results. People can get substantial differences, for example, if they use newer statistics than were available to the original researchers.
The earliest studies into reproducibility also found that sometimes it’s hard to even get people to share their data in a timely and clear way. There was a norm that data sharing is sort of a bonus, but isn’t absolutely a necessary part of the job of being a scientist.
How big of a problem is this?
I would say it’s big enough to be very concerning. I’ll give an example from social psychology, which has been one of the most problematic areas. In social psychology, there’s an idea called priming, which means if I make you think about one thing subconsciously, those thoughts may activate related associations and change your behavior in some surprising way.
Read Full article HERE. Source & Credit @ Caltech.