Supply: timoelloitt.com
Casey, our Labrador Retriever, began limping earlier than she was a yr outdated. Investigations confirmed dysplasia, a genetic situation that results in degenerative joints, arthritis, and ache. We had been devastated. After contemplating the few therapy choices that existed, we determined to skip surgical procedure and deal with it conservatively. I had no want to begin anti-inflammatory medicine, being conscious about the unwanted side effects from persistent use. I used to be conversant in a well-liked complement with weak however considerably promising proof: We began giving her glucosamine and chondroitin dietary supplements recurrently. And we watched and waited.
It took a while, however Casey did seem to enhance. We had been thrilled. Life went on, and apart from the occasional tough play session, Casey’s limping was gentle, and he or she thrived. We continued the dietary supplements, assured that we had been doing good. However finally I began listening to the rising proof on glucosamine and chondroitin. As soon as touted as a panacea for arthritis and joint ache, there had lastly been some high-quality trials performed – and the outcomes had been disappointing. I began to marvel if the dietary supplements had been actually doing something for my canine’s ache. Finally I made a decision on a trial – so I ended the dietary supplements about seven years after I began them. Neither my spouse nor I may discover any distinction in any respect in her mobility. Nor did the veterinarian. We’d been fooling ourselves, spending tons of of {dollars} within the course of.
Put up hoc ergo propter hoc (after this, subsequently due to this)
My experiment with glucosamine and chondroitin was undoubtedly not the one time I’ve been topic to post-hoc bias, however it’s the one that also stands out to me. Some instances referred to as the submit hoc ergo propter hoc fallacy, it attaches causality to a sequence of occasions.
Vaccine fears have been pushed by the submit hoc ergo propter hoc fallacy. The early indicators of autism could also be noticed to emerge on the identical time kids obtain many vaccinations – within the first few years of life. This led some individuals to incorrectly infer a causal hyperlink between the 2, merely based mostly on the timing of occasions.
It’s not at all times harms the place this fallacy could also be noticed. Simply because your situation improves after a therapy, it doesn’t imply the therapy brought about the advance. Different potential components may very well be at work, together with imply reversion, time and pure therapeutic, the placebo impact, or just likelihood. Attributing an enchancment to a therapy is commonly comforting for sufferers, simply defined to households, and handy for clinicians. It’s additionally a fast and customary rationalization, which may be flawed.
A lot of drugs continues to be full of uncertainty. We don’t totally perceive all illness mechanisms. We don’t at all times know why some medicine work in some sufferers and never others. If we’re not cautious about rigorously testing our assumptions, this logical fallacy can result in flawed diagnoses, untimely conclusions, overtreatment, and wasted sources.
Tunnel imaginative and prescient decision-making
Put up hoc bias has not been not extensively studied in drugs. In a paper revealed in September 2024 in JAMA Community Open, Donald Redelmeier and Eldar Shafir, examined judgements in well being remedies for indicators of submit hoc bias. Their speculation was that individuals could be extra prone to proceed remedies, even questionable ones, in the event that they noticed minor enhancements in signs after preliminary care.
The researchers created totally different case eventualities a few affected person with obscure signs of unclear severity. Every case aimed to collect a therapy resolution for a hypothetical affected person by asking, “Would you advocate that [patient] proceed or discontinue [treatment]?” Contributors may select from 4 choices: “undoubtedly proceed,” “are inclined to proceed,” “are inclined to discontinue,” or “undoubtedly discontinue.”
Every situation had two variations: an “improved model” the place signs barely improved after therapy, and an “unchanged model” the place signs stayed the identical. No situation concerned worsening signs that will recommend stopping the therapy. In any other case, each variations had been an identical, involving the identical affected person and single query, and had been randomly assigned.
Two totally different teams had been surveyed: potential sufferers and healthcare professionals who recurrently work together with sufferers. The biggest group was public members recruited by the Prolific Survey platform. The second group included lively group pharmacists who had been approached in particular person at their workplaces throughout off-peak hours.
All individuals accomplished the survey anonymously, and had been unaware of the research’s speculation and solely noticed one situation with out realizing about various variations. Neighborhood individuals took the survey on-line and had been compensated. Pharmacists had been approached with the script, “I want to discuss with a pharmacist,” and extra replies had been ready utilizing “secret shopper” strategies.
The Eventualities and the responses
Antibiotics
The primary case concerned utilizing antibiotics towards medical recommendation. The improved and unchanged variations had been the identical, aside from one sentence in daring:
“JL is a 35-year-old schoolteacher. She has a sore throat and begins an antibiotic therapy from an unused prescription supplied by a good friend. In accordance with medical science, nevertheless, misusing antibiotics would possibly finally trigger resistant organisms. The following day JL feels higher [unchanged]. Would you advocate she proceed or discontinue the antibiotic?”
300 individuals participated—150 noticed the improved model, and 150 noticed the unchanged model. Extra individuals advisable persevering with the antibiotic when JL felt higher than when signs had been unchanged (67 individuals [45%] vs. 25 individuals [17%]). This confirmed a reasonable enhance in assist for persevering with therapy (OR, 3.98; 95% CI, 2.33-6.78; P < .001).
Sugar complement
This situation concerned a sugar complement for insomnia: Solely the daring textual content modified:
“GD is a 45-year-old administrator. She has irregular insomnia and begins a sugar powder complement within the hopes of getting higher sleep. The following week her sleep is higher [unchanged]. Would you advocate she proceed or discontinue the sugar powder complement?”
200 individuals participated, divided equally between the 2 eventualities. Extra advisable persevering with the sugar when signs improved (83%) (vs. unchanged (17%)). This confirmed a powerful enhance in assist for persevering with therapy (OR, 22.77; 95% CI, 10.99-47.18; P < .001).
Acupuncture
This situation concerned a member of the family suggesting acupuncture to a younger lady with neck ache. Solely the daring textual content differed:
KA is a 30-year-old flight attendant. She feels intermittent neck ache and begins acupuncture for reduction (prompt by her grandmother). The following week she feels higher [unchanged]. Would you advocate she proceed or discontinue the acupuncture?”
198 people responded: 100 obtained the “improved” model and 98 the “unchanged” model. Extra advisable persevering with the acupuncture if signs had been reported to enhance [87%] than when signs had been unchanged [28%]. (OR, 15.27; 95% CI, 7.46-31.27; P < .001)
Copper Bracelet
This situation concerned a bracelet marketed and promoted for wrist ache. Solely the daring textual content differed:
“MB is a 45-year-old accountant. She feels intermittent wrist ache and begins carrying a copper bracelet for ache reduction (marketed in {a magazine}). The following week she feels higher [unchanged]. Would you advocate she proceed or discontinue the copper bracelet?”
199 people responded: 100 obtained the “improved” model and 99 the “unchanged” model. Extra advisable persevering with utilizing the copper bracelet after signs had been reported to enhance [78%], than when signs had been unchanged [25%]. (OR, 16.19; 95% CI, 5.32-19.52; P < .001)
Shampoo State of affairs
This situation concerned “horse shampoo” and baldness – about as ridiculous as you will get:
“DK is a 75-year-old retired professor. He’s going bald and begins making use of horse shampoo as soon as per day. Nevertheless, researchers sometimes agree horse shampoo doesn’t promote hair development. A few weeks later his hair appears higher [unchanged]. Suppose he’s undecided and asks you, would you advocate DK proceed or discontinue the horse shampoo?”
400 people responded: 200 obtained the improved model and 200 the unchanged model. Extra advisable persevering with the horse shampoo after signs improved [65%] than when signs had been unchanged [7%] (OR, 23.30; 95% CI, 12.69-42.16; P < .001)
Vitamin Dietary supplements: Public Responses
This situation concerned using nutritional vitamins for fatigue. Within the absence of a deficiency, there is no such thing as a proof to assist using nutritional vitamins to deal with fatigue. Solely the daring textual content differed:
“WS is a 30-year-old hospital nurse. He feels drained and begins a Vitamin B12 complement for power (regardless of regular B12 ranges). The following week he feels higher [unchanged]. Would you advocate he proceed or discontinue the Vitamin B12 complement?”
200 people responded: 100 obtained the improved model and 100 the unchanged model. Regardless of a traditional baseline B12 degree extra advisable persevering with after signs improved [80%] than when signs had been unchanged [33%] (OR, 7.91; 95% CI, 4.18-14.97; P < .001)
Vitamin Dietary supplements: Pharmacist Responses
This situation concerned pharmacists and a “secret shopper” in pharmacies:
“Hello, I’m questioning if I can discuss with a pharmacist? [Wait for pharmacist.] Final week I used to be feeling drained and began taking a Vitamin B12 complement for power. Now this week I really feel higher [unchanged]. Do you assume I ought to proceed or discontinue it?”
100 pharmacists had been consulted, of whom 44 and 56 obtained the improved and unchanged variations, respectively. Extra pharmacists advisable persevering with the therapy after signs improved [82%] than when the signs had been unchanged [63%]. (OR, 2.60; 95% CI, 1.04-6.52; P = .03)
That is disappointing, as pharmacists had been extra doubtless than most people to advocate persevering with vitamin B12 within the absence of any persuasive purpose to be used.
Conclusion: Beware Put up-Hoc Bias
This survey research revealed a constant sample of post-hoc bias, the place the general public (and in a single situation, pharmacists) advisable persevering with a therapy in the event that they skilled or recognized some subjective enchancment, no matter whether or not the therapy might or might not have brought about it. As demonstrated by these usually ridiculous examples, submit hoc bias might lead sufferers and well being professionals to stick with remedies which may be having no significant results. The authors make an vital commentary that’s price quoting in full:
Clinicians usually acknowledge complexity within the aftermath of failure—specifically, affected person outcomes are unsure. That very same humility can really feel much less doubtless within the aftermath of a hit the place adherence to scientific self-discipline may be troublesome following a therapy initiated by the accountable clinician. Private motivations would possibly additional reinforce undue confidence after an enchancment since clinicians need to imagine their work makes a optimistic distinction. Defective attribution could also be additional exacerbated when the clinician interacts with a grateful affected person, appreciative household, and impressed colleagues. Briefly, the system surrounding care helps perpetuate the submit hoc bias.
Put up-hoc bias might really feel intuitive, however it’s not essentially correct. Whereas submit hoc reasoning is smart when the analysis is evident and therapy results are well-known, it might result in complacency and never looking for efficient remedies – one in every of my main criticisms of other drugs. Recognizing this bias is a key first step to minimizing its affect.