Educational report · A&A Practice · 2025
“Consider-the-Opposite” Debiasing to Improve Self-Assessment Accuracy in Anesthesiology Trainees: A Prospective Pretest-Posttest Study
Matern LH, Baker K, Saddawi‑Konefka D. doi:10.1213/XAA.0000000000001902
The question
Physicians and doctors in training have been shown to judge their own performance with poor accuracy, and cognitive biases contribute to this. One technique for reducing bias, called “consider-the-opposite,” asks people to entertain the possibility that their first impression is wrong and to build arguments against it. It had not been studied as a way to improve self-assessment. Matern, Baker, and Saddawi‑Konefka tested whether a single consider-the-opposite exercise would make anesthesiology residents rate themselves more accurately.
The study ran at one academic hospital in April and May 2021, and 59 of 72 eligible residents (82%) took part. The reference point for each resident was the average of their routine faculty ratings over the previous 6 months, adjusted for each faculty member’s rating habits, in two areas (technical skills, and communication and leadership). Residents estimated where they stood among residents in their year. They then wrote examples of their own performance that were better and worse than that estimate, and rated themselves again immediately. Before starting, the investigators set a 40% improvement in accuracy as the smallest change they would count as meaningful.
What it found
After one short exercise, residents judged their communication and leadership more accurately, a statistically significant change. The gain was smaller than the 40% bar set in advance, and technical-skills ratings did not change.
- At baseline, 40 of 59 residents (67.8%) overestimated their technical skills, and 35 of 59 (59.3%) overestimated their communication and leadership abilities.
- Accuracy for technical skills did not change (1.00% improvement, 95% confidence interval −7.46% to 10.0%).
- Accuracy for communication and leadership improved by 5.63% (95% confidence interval 0.001% to 16.9%; P = .044), smaller than the prespecified 40% threshold.
- In survey questions about the exercise afterward, 37 of 59 residents (62.7%) said the exercise made them more aware of flaws in their self-assessment, and 20 of 59 (33.9%) agreed that their second rating was more accurate. Thirteen of 59 (22.0%) said it made them less confident about their performance.
Why it matters
Consider-the-opposite has a strong evidence base in other settings, and this was its first test as a way to improve self-assessment. Even a single, brief version moved residents’ ratings of their communication and leadership closer to how faculty saw them. The effect was smaller than the bar set in advance, and 22% of residents reported lower confidence afterward, so the authors call for more study before broad use. They offer possible explanations, including the short exercise, its complexity, residents rating themselves more carefully at baseline because they knew the study’s aim, and the possibility that the technique does not address the biases behind poor self-assessment.
The study tested one brief version of the exercise, given once, at a single institution, without a separate control group.
How to cite it
Matern LH, Baker K, Saddawi-Konefka D. “Consider-the-opposite” debiasing to improve self-assessment accuracy in anesthesiology trainees: a prospective pretest-posttest study. A A Pract. 2025;19(1):e01902. doi:10.1213/XAA.0000000000001902
More on the publications page. The complete record is on PubMed and ORCID.