People increasingly rely on the internet in order to search for health related information. Searching for information about medical treatments is among the most frequent uses of search engines. While being a convenient and fast method to collect information, search engines have a content bias towards web pages stating that treatments are helpful, regardless of the truth. The presence of incorrect information in search results might potentially cause harm, especially if people believe what they read without further research or professional medical advice. In this paper, we aim to understand the decision making process of determining the efficacy of medical treatments using search result pages. We use a think-aloud study in order to gain insights on strategies people use during online search for health related topics. Results show that, even with verbalization, participants are still strongly influenced by a search results bias. Furthermore, people pay attention to majority, authoritativeness and content quality when evaluating online content. Rank and participants’ bias towards treatments being helpful are potential subconscious biases influencing the decision making process while using search engines.