How to fake science

Posted on by admin
Journalist Johannes Bohannon tells the story of how he crafted an “experiment” that “proved” that eating chocolate helps weight loss–and sold it to millions of readers in the media world. How timely, especially the part about journalistic laziness. Think of how often the techniques employed here been applied by medical equipment manufacturers and others. Excerpts, with my emphasis:

Could we get something published? Probably. But beyond that? I thought it was sure to fizzle. We science journalists like to think of ourselves as more clever than the average hack. After all, we have to understand arcane scientific research well enough to explain it. And for reporters who don’t have science chops, as soon as they tapped outside sources for their stories—really anyone with a science degree, let alone an actual nutrition scientist—they would discover that the study was laughably flimsy. Not to mention that a Google search yielded no trace of Johannes Bohannon or his alleged institute. Reporters on the health science beat were going to smell this a mile away. But I didn’t want to sound pessimistic. “Let’s see how far we can take this,” I said.

I know what you’re thinking. The study did show accelerated weight loss in the chocolate group—shouldn’t we trust it? Isn’t that how science works?

Here’s a dirty little science secret: If you measure a large number of things about a small number of people, you are almost guaranteed to get a “statistically significant” result. Our study included 18 different measurements—weight, cholesterol, sodium, blood protein levels, sleep quality, well-being, etc.—from 15 people. (One subject was dropped.) That study design is a recipe for false positives.

It was time to share our scientific breakthrough with the world. We needed to get our study published pronto, but since it was such bad science, we needed to skip peer review altogether. Conveniently, there are lists of fake journal publishers. Since time was tight, I simultaneously submitted our paper—“Chocolate with high cocoa content as a weight-loss accelerator”—to 20 journals. Then we crossed our fingers and waited.

Our paper was accepted for publication by multiple journals within 24 hours. Needless to say, we faced no peer review at all. The eager suitor we ultimately chose . . . emailed Johannes to let him know that we had produced an “outstanding manuscript,” and that for just 600 Euros it “could be accepted directly in our premier journal.”

With the paper out, it was time to make some noise. I called a friend of a friend who works in scientific PR. She walked me through some of the dirty tricks for grabbing headlines. It was eerie to hear the other side of something I experience every day.
The key is to exploit journalists’ incredible laziness. If you lay out the information just right, you can shape the story that emerges in the media almost like you were writing those stories yourself. In fact, that’s literally what you’re doing, since many reporters just copied and pasted our text.
Take a look at the press release I cooked up. It has everything. In reporter lingo: a sexy lede, a clear nut graf, some punchy quotes, and a kicker. And there’s no need to even read the scientific paper because the key details are already boiled down. I took special care to keep it accurate. Rather than tricking journalists, the goal was to lure them with a completely typical press release about a research paper.
I felt a queazy mixture of pride and disgust as our lure zinged out into the world.
When reporters contacted me at all, they asked perfunctory questions. “Why do you think chocolate accelerates weight loss? Do you have any advice for our readers?” Almost no one asked how many subjects we tested, and no one reported that number. Not a single reporter seems to have contacted an outside researcher. None are quoted.
There was one glint of hope in this tragicomedy. While the reporters just regurgitated our “findings,” many readers were thoughtful and skeptical. In the online comments, they posed questions that the reporters should have asked.


SOURCE: Not Running a Hospital – Read entire story here.

Related posts:

  1. Perth Wildcats are the NBL Champions for 2013-14 CONGRATULATIONS to the Perth Wildcats on an incredible finals clash against the Adelaide 36ers. As diamond partner, HIF Australia could not be prouder of our team as they took out the 2013/14 NBL championship for the sixth time! ...
  2. Clinical Trial Research: Your Chance to Oust the Mouse With all the talk about mice in cure research (over 2 million results for "mice diabetes research" on Google!), you might think there is absolutely no way for you - a human - to participate in the magic of modern science. But there are actually a... ...
  3. Bitewing Radiographs – what are they and why do I need them? What are bitewings? Bitewing radiographs are a series of two or four radiographs taken to provide diagnostic information about posterior (back) teeth. When do I need bitewings? The standard of care is to take bitewing radiographs a minimum of one time per calendar year. A full mouth series, which includes bitewings and other radiographs, is taken a minimum of one time every 5 years. Why do I need bitewings? Bitewings provide diagnostic information about your teeth that cannot be obtained in any other manner. What happens if I do not get bitewings? Tooth decay between your teeth may go...
  4. I don’t want an A for anorexia | Charlotte Samantha A grim spell in the eating disorder wing of a psychiatric hospital has only raised more questions about ignorance of the disease“You haven’t scooped all the butter out. Finish it all.” The nurse’s stare invaded from across the table, and her words continued the assault. She had finished supervising my breakfast, but was hell-bent on discovering any trace of leftovers, any hint of my illness now showing its mark in the almost empty flora pat beside my sticky fingers. They were sticky because – bowl of full-fat milk-soaked cereal, cup of tea, glass of water, glass of orange juice, two...
  5. 5 Things You Can Do TODAY To Be Fitter, Healthier and Happier Do you struggle to include exercise in your daily routine? According to Brian, it’s a common problem: “With so much to do and such little time to do it, exercise is often the first thing we let go when time is limited. Sometimes I actually feel that getting to the gym and back is the hardest part!” Luckily for us though, Brian has compiled a handy list of things you can do right now, which will make for a fitter, healthier and happier you (no gym required). ...

Related Posts

Planning for our healthy future

All of us in the health care sector work hard every day to ensure that we are meeting the needs of the patients and families we serve. At Hamilton Health Sciences (HHS), this mission of service and caring is our North Star – something we always look to for direction and focus. Fulfilling that mission can be very challenging given the pace of change in healthcare. The demands on our services are growing and changing. The patients we see are living longer, and often have more complex conditions. They also frequently have higher expectations for their health care experience than in years past. And while technological breakthroughs are offering new treatments and new hope, they often come with a steep price – high tech tools are  expensive.