How To Evaluate a Scientific Study: 8 Questions To Ask
I like to believe most medical researchers and marketers of the “beauty and wellness” industry have everyone’s best interest at heart, however, there are occasions when our pain points are exploited in attempts to make money (cough, cough…cleanses and proprietary blends and green powders and extreme diet programs and, well, you get the point).
A study you find on the internet (or one being quoted by social media influencers to sell a product) may use a lot of science-y terms and convincing statistics that sound pretty legitimate, but actually turn out to be exaggerated, manipulated, poorly supported, or flat out FALSE.
So, how can we tell? How do we critically evaluate a scientific study to assess its validity and reliability?
Here are a few questions we can use:
Why was the study done? What is the specific question it is attempting to answer? The scientific term for the over-arching question of a study is the “hypothesis.”
Who conducted the study? Do they have the appropriate training and expertise?
Who funded the research? Was it sponsored by a third party? Or is there a vested interest in the results? Typically, if there is a product for sale at the end of a “study” then there could be bias in the results.
How was the data collected? Pay attention to the sample size and make-up of the population studied. A larger and more diverse sample size is necessary to be applied universally to a larger audience and the general population. Data and conclusions are less likely to contain bias if the study was a double-blinded, placebo-controlled trial which means neither the study participants nor the researchers are aware of which treatment or intervention participants are receiving until the trial is over.
Does the research actually measure what it claims? Did it test the hypothesis (i.e. did it answer the question)? Be leery of any jumps or gigantic leaps into associations. Do those associations even make sense?
Can the findings correctly be generalized to a larger population?
Has the study been peer-reviewed, meaning, have other experts in the field weighed in on the results? Do they agree with the methods and findings?
Has it been replicated in similar studies with similar results? Do the study’s conclusions fit with other studies on the topic or is it way out in left field?
It’s also important to note that a medical study in and of itself is not comprehensive. Instead, a study is meant to be used as a tool to help us understand our bodies and our own unique health and healing options. With each new study, let’s stop to ask:
How does the science apply to ME and the very specific parameters of my life, background, genetics, personal risk factors, and current situation?
Finally, we must remember that science isn’t static, it’s ever-changing. The medical community is constantly learning what works better now or what we were wrong about a few years ago. And the gold standard of care today could eventually change as more credible research becomes available (and yes, we DESERVE credible research before ingesting some “secret” proprietary blend).
Let’s agree to make decisions based on the best available truth from reputable studies and the best practices science has to offer at this current moment in time.
My friend, let’s trust THE SCIENCE.
I’d love to share my new book with you! Everything I Wish I Could Tell You About Midlife: A Woman’s Guide to Health in the Body You Actually Have is available now!
