Site icon Brookston Beer Bulletin

Studies Show Studies Don’t Show Much


If there’s one thing prohibitionists love to shout about, it’s a new study showing how terrible alcohol is, and how it supports what they’ve been proselytizing about all along. A growing trend has been anti-alcohol groups funding studies, having the “team” look for problems through phrasing the study’s goals and methodology with a particular outcome in mind, and then releasing the results as if it was impartial news. Sadly, with our media overworked and underpaid, many fall for it and report such a sham study’s results without ever critically examining it or even looking for a dissenting opinion to bring some fair and balanced perspective. Prohibitionists, knowing this, package their press releases into print-friendly versions so media outlets can simply cut and paste, passing it off as actual news. To be fair, it’s not just them. Almost everybody does it. It’s become a game, of sorts, one where most reasonable people’s wishes are ignored in favor of a more extreme agenda. Issues get polarized, and meaningful dialogue is becoming increasingly impossible with mud being slung in both directions, though I tend to think on the prohibitionist front that more mud comes our way, than vice versa.

But I’ve spent the last decade or so taking a fairly critical look at study after study, taking issue with almost all of them in one way or another. For every study that says one thing, you can find another that says the complete opposite, which you’d think wouldn’t, or shouldn’t, be possible. But a lot of it has to do with the way studies are conducted, how rigorous the science is, and whether or not they started with a specific agenda or not. I’ve certainly crowed about studies that show alcohol in a positive light, though I’ve never financed any. But despite all the tamper tantrums from the prohibitionists, they’re the ones spending all the money creating a false record of harm, not to mention taking advantage of any others they can, part of their post-prohibition strategy to bring down alcohol by less obvious means in a slower, more patient approach, chipping away at public policy and the law brick by brick, so to speak.

As a result of seeing so many of these so-called “studies,” I’ve noticed a lot of tricks that they use to make them seem like the findings actually mean something, but they rarely do, and usually even the study’s authors, who presumably want to keep their status as impartial scientists despite taking money for funding, almost always issue cautions and calls for further testing and for no one to make too much of what they found, words invariably ignored by the people using their findings to promote an agenda. It’s made me question the entire medical, and to some extent the scientific, community because it’s so obviously been corrupted by money — like every other aspect of our society, sad to say — with so many willing to take money to help a fanatical group promote its agenda. And it seems like the shear number of such studies has ballooned in recent years, too. Just how many scientific journals can there be, and how many are truly scientific, if any?

But an article on Vox a few days ago addressed this very issue, with This is why you shouldn’t believe that exciting new medical study. As the author wonders “whether there is any value in reporting very early research,” I’ve seen how it’s more often misused than anything else. As she writes. “Journals now publish their findings, and the public seizes on them, but this wasn’t always the case: journals were meant for peer-to-peer discussion, not mass consumption.” Because of this, the amount of studies being conducted has skyrocketed since their use is often now well beyond the original purpose of real study and furthering the science surrounding an issue. The actual number of so-called journal studies have seen an astounding 300% increase over the last quarter-century.

But as she points out, early reporting on these studies rarely leads to any meaningful breakthroughs, even though those initial findings become fixed in the public mind as fact. A recent example that springs to mind is about glutens. A study in Australia initially seemed to suggest that eating gluten-free could be healthier for even people who didn’t suffer from Celiac disease, but further work by the same scientist found that his initial results were incorrect, and that there were no appreciable health benefits to a gluten-free diet for most people. Despite this clear repudiation of the initial findings, gluten-free as a healthier lifestyle remains an idea many people not only still believe, but even follow, despite having been refuted years ago. This is not an isolated occurrence.

In 2003, researchers writing in the American Journal of Medicine discovered something that should change how you think about medical news. They looked at 101 studies published in top scientific journals between 1979 and 1983 that claimed a new therapy or medical technology was very promising. Only five, they found out, made it to market within a decade. Only one (ACE inhibitors, a pharmaceutical drug) was still extensively used at the time of their publication.

One.

So that means 100 others proved to not pan out, their promise as originally reported proving to not stand up to further research or lead to any meaningful breakthrough. But the news cycle has already moved on, and the damage has been done, with the study reported and its inaccurate findings fixed into people’s minds. And this is just one of the reasons why immediately promoting the results of a study to the public is a bad idea. As the Vox article makes clear. “This cycle recurs again and again. An initial study promises a miracle. News stories hype the miracle. Researchers eventually disprove the miracle.”

“There’s a big, big, difference between how the media think about news and how scientists think about news,” Naomi Oreskes, a Harvard professor of the history of science, recently told [Vox’s Julia Bellus] in an interview. “For you, what makes it news is that it’s new — and that creates a bias in the media to look for brand new results. My view would be that brand new results would be the most likely to be wrong.”

In some cases, results are published too soon precisely to get attention for the study or the research in order to get more funding to carry on the research, or simply because of the pressure to “publish or perish” in academia or a career. Or, of course, it’s published specifically to promote an agenda or ideology.

More often than not, single studies contradict one another — such as the research on foods that cause or prevent cancer. The truth can be found somewhere in the totality of the research, but we report on every study in isolation underneath flip-flopping headlines. (Red wine will add years to your life one week, and kill you quicker the next.)

This is seen in beer, a lot, too. But as the graph below makes clear, it happens everywhere, all the time, with the main culprit being the media in general, and the prohibitionists more specifically, reporting on single studies that show one thing rather then treating the issue as a whole or continuum of understanding. In particular, Alcohol Justice frequently takes one study that shows something in line with their agenda and treats it as if it’s the final answer and no further study is necessary; they’re right, case closed. Which, as you can see, is never the case.

A good example of this is a recent tweet from Alcohol Justice, questioning that “Alcohol good for your heart? Evidence is evaporating http://usat.ly/1JkkEny Don’t believe industry-sponsored science.”

The link takes you to a USA Today story, entitled Alcohol good for your heart? Evidence is evaporating, which is where AJ got the witty language in the tweet. But the part about not believing “industry-sponsored science” is completely made up. The story never even addresses that as an issue. It’s pure propaganda. As you’ll see, the trail from the USA Today story leads not to “industry-sponsored science,” but to another anti-alcohol group.

The USA Today story itself is a hodgepodge of misinformation and innuendo, written in that most common style of the mainstream media that believes scaring people captures their attention and gets ratings, viewers or whatever metric they measure their success by. Early in the piece, the author sets out her premise.

But before you pour your next cocktail, beer or glass of wine, you should know this: the science suggesting a benefit has never been conclusive. And some experts believe the evidence is getting thinner all the time.

Almost no science is conclusive, or ever has been. That’s the point of continuously conducting research, to constantly learn more and to further our understanding of whatever’s being studied. But just as benefits may be inconclusive, the evils are similarly inconclusive. But she chose to frame the story in such a way as to emphasize the negative, despite the fact that the statement could be said almost any way and still be technically correct. And saying “some experts” reveals that not everyone agrees, even with so vague a premise. You can always find a person to disagree about anything, especially if they have some reason to do so.

To illustrate what I mean, take her reliance on an editorial written by “Mike Daube, professor of health policy at Curtin University in Australia.” He “writes that the once-touted benefits of moderate drinking ‘are now evaporating,'” providing the piece’s catch phrase and hook. But who is Mike Daube. Is he a doctor or scientist? Nope. Is he an impartial expert? Hardly, “Mike Daube, professor of health policy” is all that USA Today reports, and at the editorial she’s quoting from, the only author affiliation listed is “Curtin University, GPO Box U1987, WA 6845, Australia.”

But you don’t have to look too hard to find out that Mike is also co-chair of Australia’s National Alliance for Action on Alcohol, an organization who’s sole stated purpose is that is “has been formed with the goal of reducing alcohol-related harm.” So while he’s railing against “industry lobbying and promotion [being] rife and unchecked by governments, he’s pretending to be an impartial health professional, while also leading an organization who’s already convinced that alcohol has only a negative impact on society and is working to battle it, or get rid of it. That doesn’t seem particularly impartial to me. How utterly disingenuous and hypocritical. He’s using his background as a health policy professor to make it seem as if he has some expertise in medicine, but his area of study is public policy, with an emphasis on health, and you don’t need an advanced degree to understand those are two very different things.

And the editorial USA Today is relying on, Alcohol’s evaporating health benefits (they sure love a good turn of phrase, don’t they?), is published in The BMJ (formerly the British Medical Journal). So essentially a policy expert — who in 2012 was “awarded [the] ‘Oscar’ of public health campaigning — is editorializing about science and medicine in a medical journal. It’s an editorial — an opinion. No matter how authoritative, he should carry about as much weight on scientific matters as I do. We have exactly the same number of doctoral degrees in medicine.

Even so, while lambasting alcohol over a new British study which forms the basis for his “evidence is evaporating” quip, he has to admit that the study did show a positive correlation for “women aged 65 or more” but dismisses that as “at best modest and likely to be explained by selection bias.” Which may true, but then again maybe not. Perhaps more study is necessary before making such sweeping pronouncements as the “evidence is evaporating.” Which is entirely the point. He’s looking at one study in a vacuum and choosing the outcome he favors, because of his own bias. So that’s not, or should not, be newsworthy. “Hey guess what? What I believed all along is what I still believe, and here’s this one study that partially agrees with me, so I must be right after all. Can I be in your scientific journal?” Is this really what passes for peer-reviewed science? What a load of bollocks.

The USA Today article is actually very short, but is padded out with a list of “what U.S. experts say you need to know for now.” Unfortunately, that list is entirely about the negative aspects of alcohol consumption and completely ignores any positive contributions to a person’s health, and it’s not like they’re hard to find.

But one study said something different, so I guess all those others are wrong, right? Yet this is the approach prohibitionist groups take time and time again. And as the Vox article makes clear, this approach can result in creating false hopes and leading researchers, scientists and even public policy-makers down the wrong path. As journalist Julia Belluz admits, it’s hard for the press to not jump at new study results, because their novelty is catnip to the management structure of both old and new media. But as the media blinders are understandable and even forgivable, at least to some extent, that’s not the case for the anti-alcohol groups who take that news and use it unscrupulously to advance their agenda. They’re the ones doing actual harm, because they’re creating a false narrative that is dishonest and knowingly wrong. I think they’ve forgotten that advancing a particular point of view doesn’t mean destroying the other side by any means possible, especially since they so often claim to own the moral high ground. But if their “ends justify the means” strategy reveals anything, it’s that they don’t own a mirror. They only judge our morals, attacking us frequently and accusing us of caring only about business, money and hurting children.

The Vox article concludes with some sage advice from “Harvard’s Oreskes, Stanford’s John Ioannidis, and many other respected researchers,” who insist “we need to look past the newest science to where knowledge has accumulated. There, we’ll find insights that will help us have healthier lives and societies.” Could somebody please tell the prohibitionists?

Exit mobile version