Research Methodologies: Assessing Current Trends
This is the conclusion of our series, Research in an Age of Distrust. See our last three blogs for an introduction to this series which outlines our mission for transparency and trust-based research, an overview of our approach to academic research, and a look at why the historical and evolutionary contexts of research topics matter.
When digging into the validity and effectiveness of a given topic, some of the topics we have researched are already vetted by high quality, peer-reviewed supporting evidence, which sets a solid precedent for our research process. But at the end of the day, there are bound to be some products and techniques that aren’t super well-researched or historically grounded, yet there are passionate people convinced they’re the next big thing.
While it may be challenging to recommend these things with great certainty, that’s very different than saying that they aren’t worth trying. People are constantly learning and innovating, and it’d be short-sighted to ignore products and techniques that a large number of people believe in.
In these cases, we turn to a few standard questions to figure out whether these solutions deserve the time of our research team, the effort to test their efficacy, and the surety to discuss them with our partners.
What is the public perception?
When looking into something novel and evidence-light, quick steps to understanding its role in the broader sphere of wellbeing are to look at its promoters, its critics, and the energy surrounding it in popular discourse. Is it being discussed by reputable sources in a negative or positive light? Has it earned the support of people who are judged as health-conscious and considerate?
Is it safe?
The first, obvious question once a solution is deemed worth investigating is to ensure that it is positively safe. If not, there is little sense in exploring it any further. However, if we are certain that a new-wave solution is low risk and high reward, we may find it more intriguing and start to ask…
If it works, how does it work?
Oftentimes, solutions will have an underlying theory. Even if there is not formal research conducted on a solution’s efficacy, there may be an intriguing logic behind why people appreciate it. So, we turn from examiners of evidence to inspectors of logic and investigate the different pieces involved and how well they connect. Mechanistic explanations are far from bullet-proof, but these theories are often the precursor to research that can truly solidify a solution's efficacy and safety. This is where it helps to have a lot of smart people in your corner, and why we are continually growing our network of experts.
This Process in Action
As an example, let’s look to cold plunging. Cold plunging is not an incredibly well-researched activity, yet it’s incredibly popular. For this reason, it’s wise to run cold plunging through the questions outlined above. What you will find quickly and easily is that a lot of credible sources support cold plunging and that many wellness leaders incorporate it in their personal routines. Secondly, a bit of research will show that cold plunging is widely safe for people (senior citizens and people that are hosting a pre-existing cardiovascular condition ought to exercise additional caution). Additionally, the popularity and ubiquity of cold plunge carries with it a higher likelihood that the risks and rewards are better understood, in theory and in practice, compared to modalities for wellbeing that are less popular. Again, this logic does not approach a clinical level of certainty, but it’s another signal supporting the idea that we’re reasonably well aware of cold plunge’s benefits and risks.
Lastly, more research into theories about the biological mechanisms behind cold plunging reveal that there are strong hypotheses about why people enjoy it, as it interacts with systems we understand well: adrenal response, metabolism, and immune function. When considering these biological mechanisms, cold plunging continues to seem like it could have merit as a tool to help people feel good.
Ultimately, it is important to us that we have a balanced approach to considering and recommending wellness solutions by conscientiously researching both well-vetted and novel ideas. Our end goal is to create environments where people can thrive, and we can achieve this by utilizing the most effective products, methods, and modalities, whether new or tried-and-true. With this series on our research process, we hope to create trust through transparency so that you can be confident that we have done our due diligence before recommending wellness solutions, and can walk alongside us as we continue to improve and learn.