The American Journal of Medicine
Volume 121, Issue 5, Supplement , Pages S2-S23 , May 2008

Overconfidence as a Cause of Diagnostic Error in Medicine

  • Eta S. Berner, EdD

      Affiliations

    • Department of Health Services Administration, School of Health Professions, University of Alabama at Birmingham, Birmingham, Alabama, USA
    • Corresponding Author InformationRequests for reprints should be addressed to Eta S. Berner, EdD, Department of Health Services Administration, School of Health Professions, University of Alabama at Birmingham, 1675 University Boulevard, Room 544, Birmingham, Alabama 35294-3361.
    • ,
  • Mark L. Graber, MD

      Affiliations

    • VA Medical Center, Northport, New York and Department of Medicine, State University of New York at Stony Brook, Stony Brook, New York, USA

References 

  1. Lowry F. Failure to perform autopsies means some MDs “walking in a fog of misplaced optimism.”. CMAJ. 1995;153:811–814
  2. Mongerson P. A patient's perspective of medical informatics. J Am Med Inform Assoc. 1995;2:79–84
  3. Blendon RJ, DesRoches CM, Brodie M, et al. Views of practicing physicians and the public on medical errors. N Engl J Med. 2002;347:1933–1940
  4. YouGov survey of medical misdiagnosis. Isabel Healthcare–Clinical Decision Support System, 2005. Available at: http://www.isabelhealthcare.com. Accessed April 3, 2006.
  5. Burroughs TE, Waterman AD, Gallagher TH, et al. Patient concerns about medical errors in emergency departments. Acad Emerg Med. 2005;23:57–64
  6. Tierney WM. Adverse outpatient drug events—a problem and an opportunity. N Engl J Med. 2003;348:1587–1589
  7. Norman GR, Coblentz CL, Brooks LR, Babcook CJ. Expertise in visual diagnosis: a review of the literature. Acad Med. 1992;67(suppl):S78–S83
  8. Foucar E, Foucar MK. Medical error. In: Foucar MK, ed. Bone Marrow Patholog, 2nd ed. Chicago: ASCP Press, 2001:76–82.
  9. Fitzgerald R. Error in radiology. Clin Radiol. 2001;56:938–946
  10. Kronz JD, Westra WH, Epstein JI. Mandatory second opinion surgical pathology at a large referral hospital. Cancer. 1999;86:2426–2435
  11. Berlin L, Hendrix RW. Perceptual errors and negligence. Am J Radiol. 1998;170:863–867
  12. Kripalani S, Williams MV, Rask K. Reducing errors in the interpretation of plain radiographs and computed tomography scans. In: Shojania KG, Duncan BW, McDonald KM, Wachter RM, eds. Making Health Care Safer. A Critical Analysis of Patient Safety Practices. Rockville, MD: Agency for Healthcare Research and Quality, 2001.
  13. Neale G, Woloschynowych J, Vincent C. Exploring the causes of adverse events in NHS hospital practice. J R Soc Med. 2001;94:322–330
  14. O'Connor PM, Dowey KE, Bell PM, Irwin ST, Dearden CH. Unnecessary delays in accident and emergency departments: do medical and surgical senior house officers need to vet admissions?. Acad Emerg Med. 1995;12:251–254
  15. Chellis M, Olson JE, Augustine J, Hamilton GC. Evaluation of missed diagnoses for patients admitted from the emergency department. Acad Emerg Med. 2001;8:125–130
  16. Elstein AS. Clinical reasoning in medicine. In:  Higgs JJM editors. Clinical Reasoning in the Health Professions. Oxford, England: Butterworth-Heinemann Ltd; 1995;p. 49–59
  17. Kedar I, Ternullo JL, Weinrib CE, Kelleher KM, Brandling-Bennett H, Kvedar JC. Internet based consultations to transfer knowledge for patients requiring specialised care: retrospective case review. BMJ. 2003;326:696–699
  18. McGinnis KS, Lessin SR, Elder DE. Pathology review of cases presenting to a multidisciplinary pigmented lesion clinic. Arch Dermatol. 2002;138:617–621
  19. Zarbo RJ, Meier FA, Raab SS. Error detection in anatomic pathology. Arch Pathol Lab Med. 2005;129:1237–1245
  20. Tomaszewski JE, Bear HD, Connally JA, et al. Consensus conference on second opinions in diagnostic anatomic pathology: who, what, and when. Am J Clin Pathol. 2000;114:329–335
  21. Harris M, Hartley AL, Blair V, et al. Sarcomas in north west England (I. Histopathological peer review). Br J Cancer. 1991;64:315–320
  22. Kim J, Zelman RJ, Fox MA, et al. Pathology Panel for Lymphoma Clinical Studies: a comprehensive analysis of cases accumulated since its inception. J Natl Cancer Inst. 1982;68:43–67
  23. Goddard P, Leslie A, Jones A, Wakeley C, Kabala J. Error in radiology. Br J Radiol. 2001;74:949–951
  24. Berlin L. Defending the ”missed” radiographic diagnosis. Am J Radiol. 2001;176:317–322
  25. Espinosa JA, Nolan TW. Reducing errors made by emergency physicians in interpreting radiographs: longitudinal study. BMJ. 2000;320:737–740
  26. Arenson RL. The wet read. AHRQ [Agency for Heathcare Research and Quality] Web M&M, March 2006. Accessed November 28 http://webmm.ahrq.gov/printview.aspx?caseID=1212007;
  27. Beam CA, Layde PM, Sullivan DC. Variability in the interpretation of screening mammograms by US radiologists: findings from a national sample. Arch Intern Med. 1996;156:209–213
  28. Majid AS, de Paredes ES, Doherty RD, Sharma NR, Salvador X. Missed breast carcinoma: pitfalls and pearls. Radiographics. 2003;23:881–895
  29. Goodson WH, Moore DH. Causes of physician delay in the diagnosis of breast cancer. Arch Intern Med. 2002;162:1343–1348
  30. Smith-Bindman R, Chu PW, Miglioretti DL, et al. Comparison of screening mammography in the United States and the United Kingdom. JAMA. 2003;290:2129–2137
  31. Schiff GD, Kim S, Abrams R, et al. Diagnosing diagnosis errors: lessons from a multi-institutional collaborative project. Advances in Patient Safety: From Research to Implementation. Rockville: MD: Agency for Healthcare Research and Quality; 2007;vol 2. February 2005. AHRQ Publication No. 050021. Available at: http://www.ahrq.gov/downloads/pub/advances/vol2/schiff.pdf./. Accessed December 3
  32. Shojania K, Burton E, McDonald K, et al. The autopsy as an outcome and performance measure: evidence report/technology assessment #58. Rockville, MD: Agency for Healthcare Research and Quality, October 2002. AHRQ Publication No. 03-E002.
  33. Pidenda LA, Hathwar VS, Grand BJ. Clinical suspicion of fatal pulmonary embolism. Chest. 2001;120:791–795
  34. Lederle FA, Parenti CM, Chute EP. Ruptured abdominal aortic aneurysm: the internist as diagnostician. Am J Med. 1994;96:163–167
  35. von Kodolitsch Y, Schwartz AG, Nienaber CA. Clinical prediction of acute aortic dissection. Arch Intern Med. 2000;160:2977–2982
  36. Edlow JA. Diagnosis of subarachnoid hemorrhage. Neurocrit Care. 2005;2:99–109
  37. Burton EC, Troxclair DA, Newman WP. Autopsy diagnoses of malignant neoplasms: how often are clinical diagnoses incorrect?. JAMA. 1998;280:1245–1248
  38. Perlis RH. Misdiagnosis of bipolar disorder. Am J Manag Care. 2005;11(suppl):S271–S274
  39. Graff L, Russell J, Seashore J, et al. False-negative and false-positive errors in abdominal pain evaluation: failure to diagnose acute appendicitis and unneccessary surgery. Acad Emerg Med. 2000;7:1244–1255
  40. Raab SS, Grzybicki DM, Janosky JE, et al. Clinical impact and frequency of anatomic pathology errors in cancer diagnoses. Cancer. 2005;104:2205–2213
  41. Buchweitz O, Wulfing P, Malik E. Interobserver variability in the diagnosis of minimal and mild endometriosis. Eur J Obstet Gynecol Reprod Biol. 2005;122:213–217
  42. Gorter S, van der Heijde DM, van der Linden S, et al. Psoriatic arthritis: performance of rheumatologists in daily practice. Ann Rheum Dis. 2002;61:219–224
  43. Bogun F, Anh D, Kalahasty G, et al. Misdiagnosis of atrial fibrillation and its clinical consequences. Am J Med. 2004;117:636–642
  44. Arnon SS, Schecter R, Maslanka SE, Jewell NP, Hatheway CL. Human botulism immune globulin for the treatment of infant botulism. N Engl J Med. 2006;354:462–472
  45. Edelman D. Outpatient diagnostic errors: unrecognized hyperglycemia. Eff Clin Pract. 2002;5:11–16
  46. Russell NJ, Pantin CF, Emerson PA, Crichton NJ. The role of chest radiography in patients presenting with anterior chest pain to the Accident & Emergency Department. J R Soc Med. 1988;81:626–628
  47. Dobbs D. Buried answers. New York Times Magazine. April 24, 2005:40–45.
  48. Cabot RC. Diagnostic pitfalls identified during a study of three thousand autopsies. JAMA. 1912;59:2295–2298
  49. Cabot RC. A study of mistaken diagnosis: based on the analysis of 1000 autopsies and a comparison with the clinical findings. JAMA. 1910;55:1343–1350
  50. Aalten CM, Samsom MM, Jansen PA. Diagnostic errors: the need to have autopsies. Neth J Med. 2006;64:186–190
  51. Shojania KG. Autopsy revelation. AHRQ [Agency for Heathcare Research and Quality] Web M&M, March 2004. Accessed November 28 http://webmm.ahrq.gov/case.aspx?caseID=54&searchStr=shojania2007;
  52. Tamblyn RM. Use of standardized patients in the assessment of medical practice. CMAJ. 1998;158:205–207
  53. Berner ES, Houston TK, Ray MN, et al. Improving ambulatory prescribing safety with a handheld decision support system: a randomized controlled trial. J Am Med Inform Assoc. 2006;13:171–179
  54. Christensen-Szalinski JJ, Bushyhead JB. Physician's use of probabalistic information in a real clinical setting. J Exp Psychol Hum Percept Perform. 1981;7:928–935
  55. Peabody JW, Luck J, Jain S, Bertenthal D, Glassman P. Assessing the accuracy of administrative data in health information systems. Med Care. 2004;42:1066–1072
  56. Margo CE. A pilot study in ophthalmology of inter-rater reliability in classifying diagnostic errors: an underinvestigated area of medical error. Qual Saf Health Care. 2003;12:416–420
  57. Hoffman PJ, Slovic P, Rorer LG. An analysis-of-variance model for the assessment of configural cue utilization in clinical judgment. Psychol Bull. 1968;69:338–349
  58. Kohn L, Corrigan JM, Donaldson M. To Err Is Human: Building a Safer Health System. Washington, DC: National Academy Press; 1999;
  59. Leape L, Brennan TA, Laird N, et al. The nature of adverse events in hospitalized patients: results of the Harvard Medical Practice Study II. N Engl J Med. 1991;324:377–384
  60. Thomas EJ, Studdert DM, Burstin HR, et al. Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000;38:261–271
  61. Baker GR, Norton PG, Flintoft V, et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ. 2004;170:1678–1686
  62. Wilson RM, Harrison BT, Gibberd RW, Hamilton JD. An analysis of the causes of adverse events from the Quality in Australian Health Care Study. Med J Aust. 1999;170:411–415
  63. Davis P, Lay-Yee R, Briant R, Ali W, Scott A, Schug S. Adverse events in New Zealand public hospitals II: preventability and clinical context. N Z Med J. 2003;116:U624
  64. Bhasale A, Miller G, Reid S, Britt HC. Analyzing potential harm in Australian general practice: an incident-monitoring study. Med J Aust. 1998;169:73–76
  65. Makeham M, Dovey S, County M, Kidd MR. An international taxonomy for errors in general practice: a pilot study. Med J Aust. 2002;177:68–72
  66. Fischer G, Fetters MD, Munro AP, Goldman EB. Adverse events in primary care identified from a risk-management database. J Fam Pract. 1997;45:40–46
  67. Wu AW, Folkman S, McPhee SJ, Lo B. Do house officers learn from their mistakes?. JAMA. 1991;265:2089–2094
  68. Weingart S, Ship A, Aronson M. Confidential clinical-reported surveillance of adverse events among medical inpatients. J Gen Intern Med. 2000;15:470–477
  69. Balsamo RR, Brown MD. Risk management. In:  Sanbar SS,  Gibofsky A,  Firestone MH,  LeBlang TR editor. Legal Medicine, 4th ed. St Louis, MO: Mosby; 1998;p. 223–244
  70. Failure to diagnose. Midiagnosis of conditions and diseaes. Medical Malpractice Lawyers and Attorneys Online, 2006. Accessed November 28 http://www.medical-malpractice-attorneys-lawsuits.com/pages/failure-to-diagnose.html2007;
  71. General and Family Practice Claim Summary. Physician Insurers Association of America, Rockville, MD, 2002.
  72. Berlin L. Fear of cancer. AJR Am J Roentgenol. 2004;183:267–272
  73. Missed or failed diagnosis: what the UNITED claims history can tell us. United GP Registrar's Toolkit, 2005. Accessed November 28 http://www.unitedmp.com.au/0/0.13/0.13.4/Missed_diagnosis.pdf2007;
  74. Studdert DM, Mello MM, Gawande AA, et al. Claims, errors, and compensation payments in medical malpractice litigation. N Engl J Med. 2006;354:2024–2033
  75. Schiff GD. Commentary: diagnosis tracking and health reform. Am J Med Qual. 1994;9:149–152
  76. Redelmeier DA. Improving patient care: the cognitive psychology of missed diagnoses. Ann Intern Med. 2005;142:115–120
  77. Gandhi TK, Kachalia A, Thomas EJ, et al. Missed and delayed diagnoses in the ambulatory setting: a study of closed malpractice claims. Ann Intern Med. 2006;145:488–496
  78. Kirch W, Schafii C. Misdiagnosis at a university hospital in 4 medical eras. Medicine (Baltimore). 1996;75:29–40
  79. Goldman L, Sayson R, Robbins S, Cohn LH, Bettmann M, Weisberg M. The value of the autopsy in three different eras. N Engl J Med. 1983;308:1000–1005
  80. Shojania KG, Burton EC, McDonald KM, Goldman L. Changes in rates of autopsy-detected diagnostic errors over time: a systematic review. JAMA. 2003;289:2849–2856
  81. Sonderegger-Iseli K, Burger S, Muntwyler J, Salomon F. Diagnostic errors in three medical eras: a necropsy study. Lancet. 2000;355:2027–2031
  82. Berner ES, Miller RA, Graber ML. Missed and delayed diagnoses in the ambulatory setting. Ann Intern Med. 2007;146:470–471
  83. Gawande A. Final cut. Medical arrogance and the decline of the autopsy. The New Yorker. March 19, 2001:94–99.
  84. Kruger J, Dunning D. Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. J Pers Soc Psychol. 1999;77:1121–1134
  85. LaFee S. Well news: all the news that's fit. The San Diego Union-Tribune. March 7, 2006. Available at: http://www.quotegarden.com/medical.html. Accessed February 6, 2008.
  86. Graber ML. Diagnostic error in medicine: a case of neglect. Jt Comm J Qual Patient Saf. 2005;31:112–119
  87. Covell DG, Uman GC, Manning PR. Information needs in office practice: are they being met?. Ann Intern Med. 1985;103:596–599
  88. Gorman PN, Helfand M. Information seeking in primary care: how physicians choose which clinical questions to pursue and which to leave unanswered. Med Decis Making. 1995;15:113–119
  89. Osheroff JA, Bankowitz RA. Physicians' use of computer software in answering clinical questions. Bull Med Libr Assoc. 1993;81:11–19
  90. Rosenbloom ST, Geissbuhler AJ, Dupont WD, et al. Effect of CPOE user interface design on user-initiated access to educational and patient information during clinical care. J Am Med Inform Assoc. 2005;12:458–473
  91. McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–2645
  92. Cabana MD, Rand CS, Powe NR, et al. Why don't physicians follow clinical practice guidelines? (A framework for improvement). JAMA. 1999;282:1458–1465
  93. Eccles MP, Grimshaw JM. Selecting, presenting and delivering clinical guidelines: are there any ”magic bullets”?. Med J Aust. 2004;180(suppl):S52–S54
  94. Pearson TA, Laurora I, Chu H, Kafonek S. The lipid treatment assessment project (L-TAP): a multicenter survey to evaluate the percentages of dyslipidemic patients receiving lipid-lowering therapy and achieving low-density lipoprotein cholesterol goals. Arch Intern Med. 2000;160:459–467
  95. Eccles M, McColl E, Steen N, et al. Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial [primary care]. BMJ. 2002;325:941
  96. Smith WR. Evidence for the effectiveness of techniques to change physician behavior. Chest. 2000;118:8S–17S
  97. Militello L, Patterson ES, Tripp-Reimer T, et al. Clinical reminders: why don't people use them? In: Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting, New Orleans LA, 2004:1651–1655.
  98. Patterson ES, Doebbeling BN, Fung CH, Militello L, Anders S, Asch SM. Identifying barriers to the effective use of clinical reminders: bootstrapping multiple methods. J Biomed Inform. 2005;38:189–199
  99. Berner ES, Maisiak RS, Heudebert GR, Young KR. Clinician performance and prominence of diagnoses displayed by a clinical diagnostic decision support system. AMIA Annu Symp Proc. 2003;2003:76–80
  100. Steinman MA, Fischer MA, Shlipak MG, et al. Clinician awareness of adherence to hypertension guidelines. Am J Med. 2004;117:747–754
  101. Tierney WM, Overhage JM, Murray MD, et al. Can computer-generated evidence-based care suggestions enhance evidence-based management of asthma and chronic obstructive pulmonary disease (A randomized, controlled trial). Health Serv Res. 2005;40:477–497
  102. Timmermans S, Mauck A. The promises and pitfalls of evidence-based medicine. Health Aff (Millwood). 2005;24:18–28
  103. Tanenbaum SJ. Evidence and expertise: the challenge of the outcomes movement to medical professionalism. Acad Med. 1999;74:757–763
  104. van der Sijs H, Aarts J, Vulto A, Berg M. Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006;13:138–147
  105. Katz J. Why doctors don't disclose uncertainty. Hastings Cent Rep. 1984;14:35–44
  106. Graber ML, Franklin N, Gordon RR. Diagnostic error in internal medicine. Arch Intern Med. 2005;165:1493–1499
  107. Croskerry P. Achieving quality in clinical decision making: cognitive strategies and detection of bias. Acad Emerg Med. 2002;9:1184–1204
  108. Friedman CP, Gatti GG, Franz TM, et al. Do physicians know when their diagnoses are correct. J Gen Intern Med. 2005;20:334–339
  109. Dreiseitl S, Binder M. Do physicians value decision support (A look at the effect of decision support systems on physician opinion). Artif Intell Med. 2005;33:25–30
  110. Baumann AO, Deber RB, Thompson GG. Overconfidence among physicians and nurses: the 'micro-certainty, macro-uncertainty' phenomenon. Soc Sci Med. 1991;32:167–174
  111. Podbregar M, Voga G, Krivec B, Skale R, Pareznik R, Gabrscek L. Should we confirm our clinical diagnostic certainty by autopsies?. Intensive Care Med. 2001;27:1750–1755
  112. Landefeld CS, Chren MM, Myers A, Geller R, Robbins S, Goldman L. Diagnostic yield of the autopsy in a university hospital and a community hospital. N Engl J Med. 1988;318:1249–1254
  113. Potchen EJ. Measuring observer performance in chest radiology: some experiences. J Am Coll Radiol. 2006;3:423–432
  114. Kachalia A, Gandhi TK, Puopolo AL, et al. Missed and delayed diagnoses in the emergency department: a study of closed malpractice claims from 4 liability insurers. Ann Emerg Med. 2007;49:196–205
  115. Croskerry P. The importance of cognitive errors in diagnosis and strategies to minimize them. Acad Med. 2003;78:775–780
  116. Bornstein BH, Emler AC. Rationality in medical decision making: a review of the literature on doctors' decision-making biases. J Eval Clin Pract. 2001;7:97–107
  117. McSherry D. Avoiding premature closure in sequential diagnosis. Artif Intell Med. 1997;10:269–283
  118. Dubeau CE, Voytovich AE, Rippey RM. Premature conclusions in the diagnosis of iron-deficiency anemia: cause and effect. Med Decis Making. 1986;6:169–173
  119. Voytovich AE, Rippey RM, Suffredini A. Premature conclusions in diagnostic reasoning. J Med Educn. 1985;60:302–307
  120. Simon HA. The Sciences of the Artificial. 3rd ed.. Cambridge, MA: MIT Press; 1996;
  121. Elstein AS, Shulman LS, Sprafka SA. Medical Problem Solving (An Analysis of Clinical Reasoning). Cambridge, MA: Harvard University Press; 1978;
  122. Barrows HS, Norman GR, Neufeld VR, Feightner JW. The clinical reasoning of randomly selected physicians in general medical practice. Clin Invest Med. 1982;5:49–55
  123. Barrows HS, Feltovich PJ. The clinical reasoning process. Med Educ. 1987;21:86–91
  124. Neufeld VR, Norman GR, Feightner JW, Barrows HS. Clinical problem-solving by medical students: a cross-sectional and longitudinal analysis. Med Educ. 1981;15:315–322
  125. Norman GR. The epistemology of clinical reasoning: perspectives from philosophy, psychology, and neuroscience. Acad Med. 2000;75(suppl):S127–S135
  126. Schmidt HG, Norman GR, Boshuizen HPA. A cognitive perspective on medical expertise: theory and implications. Acad Med. 1990;65:611–621
  127. Gladwell M. Blink: The Power of Thinking Without Thinking. Boston: Little Brown and Company; 2005;
  128. Klein G. Sources of Power: How People Make Decisions. Cambridge, MA: MIT Press; 1998;
  129. Rosch E, Mervis CB. Family resemblances: studies in the internal structure of categories. Cognit Psychol. 1975;7:573–605
  130. Eva KW, Norman GR. Heuristics and biases—a biased perspective on clinical reasoning. Med Educ. 2005;39:870–872
  131. Sieck WR, Arkes HR. The recalcitrance of overconfidence and its contribution to decision aid neglect. J Behav Decis Making. 2005;18:29–53
  132. Kruger J, Dunning D. Unskilled and unaware—but why (A reply to Krueger and Mueller (2002)). J Pers Soc Psychol. 2002;82:189–192
  133. Krueger J, Mueller RA. Unskilled, unaware, or both (The better-than-average heuristic and statistical regression predict errors in estimates of own performance). J Pers Soc Psychol. 2002;82:180–188
  134. Mele AR. Real self-deception. Behav Brain Sci. 1997;20:91–102
  135. Reason JT, Manstead ASR, Stradling SG. Errors and violation on the roads: a real distinction. Ergonomics. 1990;33:1315–1332
  136. Gigerenzer G, Goldstein DG. Reasoning the fast and frugal way: models of bounded rationality. Psychol Rev. 1996;103:650–669
  137. Hamm RM. Clinical intuition and clinical analysis: expertise and the cognitive continuum. In:  Elstein A,  Dowie J editor. Professional Judgment: A Reader in Clinical Decision Making. Cambridge, UK: Cambridge University Press; 1988;p. 78–105
  138. Gigerenzer G. Adaptive Thinking. New York: Oxford University Press; 2000;
  139. Berner ES, Webster GD, Shugerman AA, et al. Performance of four computer-based diagnostic systems. N Engl J Med. 1994;330:1792–1796
  140. Ely JW, Levinson W, Elder NC, Mainous AG, Vinson DC. Perceived causes of family physicians' errors. J Fam Pract. 1995;40:337–344
  141. Studdert DM, Mello MM, Sage WM, et al. Defensive medicine among high-risk specialist physicians in a volatile malpractice environment. JAMA. 2005;293:2609–2617
  142. Anderson RE. Billions for defense: the pervasive nature of defensive medicine. Arch Intern Med. 1999;159:2399–2402
  143. Trivers R. The elements of a scientific theory of self-deception. Ann N Y Acad Sci. 2000;907:114–131
  144. Lundberg GD. Low-tech autopsies in the era of high-tech medicine: continued value for quality assurance and patient safety. JAMA. 1998;280:1273–1274
  145. Darwin C. The Descent of Man. Project Gutenberg, August 1, 2000. Accessed November 28 http://www.gutenberg.org/etext/23002007;
  146. Leonhardt D. Why doctors so often get it wrong. The New York Times. February 22, 2006 [published correction appears in The New York Times, February 28, 2006]. Accessed November 28 http://www.nytimes.com/2006/02/22/business/22leonhardt.html?ex=1298264400&en=c2d9f1d654850c17&ei=5088&partner=rssnyt&emc=rss2007;
  147. Hodges B, Regehr G, Martin D. Difficulties in recognizing one's own incompetence: novice physicians who are unskilled and unaware of it. Acad Med. 2001;76(suppl):S87–S89
  148. Davis DA, Mazmanian PE, Fordis M, Van HR, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296:1094–1102
  149. Davis D, O'Brien MA, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A. Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes?. JAMA. 1999;282:867–874
  150. Bowen JL. Educational strategies to promote clinical diagnostic reasoning. N Engl J Med. 2006;355:2217–2225
  151. Norman G. Building on experience—the development of clinical reasoning. N Engl J Med. 2006;355:2251–2252
  152. Bordage G. Why did I miss the diagnosis (Some cognitive explanations and educational implications). Acad Med. 1999;74(suppl):S128–S143
  153. Norman G. Research in clinical reasoning: past history and current trends. Med Educ. 2005;39:418–427
  154. Singh H, Petersen LA, Thomas EJ. Understanding diagnostic errors in medicine: a lesson from aviation. Qual Saf Health Care. 2006;15:159–164
  155. Croskerry P. When diagnoses fail: new insights, old thinking. Canadian Journal of CME. 2003;Nov:79–87.
  156. Hall KH. Reviewing intuitive decision making and uncertainty: the implications for medical education. Med Educ. 2002;36:216–224
  157. Croskerry P. Cognitive forcing strategies in clinical decision making. Ann Emerg Med. 2003;41:110–120
  158. Mitchell DJ, Russo JE, Pennington N. Back to the future: temporal perspective in the explanation of events. J Behav Decis Making. 1989;2:25–38
  159. Schon DA. Educating the Reflective Practitioner. San Francisco: Jossey-Bass; 1987;
  160. Mamede S, Schmidt HG. The structure of reflective practice in medicine. Med Educ. 2004;38:1302–1308
  161. Soares SMS. Reflective practice in medicine (PhD thesis). Erasmus Universiteit, Rotterdam, Rotterdam, the Netherlands, 2006. 30552B 6000.
  162. Mamede S, Schmidt HG, Rikers R. Diagnostic errors and reflective practice in medicine. J Eval Clin Pract. 2007;13:138–145
  163. Reason J. Human error: models and management. BMJ. 2000;320:768–770
  164. Nolan TW. System changes to improve patient safety. BMJ. 2000;320:771–773
  165. Miller RA. Medical diagnostic decision support systems—past, present, and future: a threaded bibliography and brief commentary. J Am Med Inform Assoc. 1994;1:8–27
  166. Kassirer JP. A report card on computer-assisted diagnosis—the grade: C. N Engl J Med. 1994;330:1824–1825
  167. Berner ES, Maisiak RS. Influence of case and physician characteristics on perceptions of decision support systems. J Am Med Inform Assoc. 1999;6:428–434
  168. Friedman CP, Elstein AS, Wolf FM, et al. Enhancement of clinicians' diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. JAMA. 1999;282:1851–1856
  169. Lincoln MJ, Turner CW, Haug PJ, et al. Iliad's role in the generalization of learning across a medical domain. Proc Annu Symp Comput Appl Med Care. 1992; 174–178.
  170. Lincoln MJ, Turner CW, Haug PJ, et al. Iliad training enhances medical students' diagnostic skills. J Med Syst. 1991;15:93–110
  171. Turner CW, Lincoln MJ, Haug PJ, et al. Iliad training effects: a cognitive model and empirical findings. Proc Annu Symp Comput Appl Med Care. 1991;68–72
  172. Arene I, Ahmed W, Fox M, Barr CE, Fisher K. Evaluation of quick medical reference (QMR) as a teaching tool. MD Comput. 1998;15:323–326
  173. Apkon M, Mattera JA, Lin Z, et al. A randomized outpatient trial of a decision-support information technology tool. Arch Intern Med. 2005;165:2388–2394
  174. Ramnarayan P, Roberts GC, Coren M, et al. Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study. BMC Med Inform Decis Mak. 2006;6:22
  175. Maffei FA, Nazarian EB, Ramnarayan P, Thomas NJ, Rubenstein JS. Use of a web-based tool to enhance medical student learning in the pediatric ICU and inpatient wards. Pediatr Crit Care Med. 2005;6:109
  176. Ramnarayan P, Tomlinson A, Kularni G, Rao A, Britto J. A novel diagnostic aid (ISABEL): development and preliminary evaluation of clinical performance. Medinfo. 2004;11:1091–1095
  177. Ramnarayan P, Kapoor RR, Coren J, et al. Measuring the impact of diagnostic decision support on the quality of clinical decision making: development of a reliable and valid composite score. J Am Med Inform Assoc. 2003;10:563–572
  178. Ramnarayan P, Tomlinson A, Rao A, Coren M, Winrow A, Britto J. ISABEL: a web-based differential diagnosis aid for paediatrics: results from an initial performance evaluation. Arch Dis Child. 2003;88:408–413
  179. Miller RA. Evaluating evaluations of medical diagnostic systems. J Am Med Inform Assoc. 1996;3:429–431
  180. Berner ES. Diagnostic decision support systems: how to determine the gold standard?. J Am Med Inform Assoc. 2003;10:608–610
  181. Bauer BA, Lee M, Bergstrom L, et al. Internal medicine resident satisfaction with a diagnostic decision support system (DXplain) introduced on a teaching hospital service. Proc AMIA Symp. 2003;608–610
  182. Teich JM, Merchia PR, Schmiz JL, Kuperman GJ, Spurr CD, Bates DW. Effects of computerized physician order entry on prescribing practices. Arch Intern Med. 2000;160:2741–2747
  183. Croskerry P. The feedback sanction. Acad Emerg Med. 2000;7:1232–1238
  184. Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD. Does telling people what they have been doing change what they do? (A systematic review of the effects of audit and feedback). Qual Saf Health Care. 2006;15:433–436
  185. Papa FJ, Aldrich D, Schumacker RE. The effects of immediate online feedback upon diagnostic performance. Acad Med. 1999;74(suppl):S16–S18
  186. Stone ER, Opel RB. Training to improve calibration and discrimination: the effects of performance and environment feedback. Organ Behav Hum Decis Process. 2000;83:282–309
  187. Duffy FD, Holmboe ES. Self-assessment in lifelong learning and improving performance in practice: physician know thyself. JAMA. 2006;296:1137–1139
  188. Borgstede JP, Zinninger MD. Radiology and patient safety. Acad Radiol. 2004;11:322–332
  189. Frable WJ. ”Litigation cells” in the Papanicolaou smear: extramural review of smears by ”experts.”. Arch Pathol Lab Med. 1997;121:292–295
  190. Wilbur DC. False negatives in focused rescreening of Papanicolaou smears: how frequently are ”abnormal” cells detected in retrospective review of smears preceding cancer or high grade intraepithelial neoplasia?. Arch Pathol Lab Med. 1997;121:273–276
  191. College of American Pathologists. Available at: http://www.cap.org/apps/cap.portal.
  192. Raab SS. Improving patient safety by examining pathology errors. Clin Lab Med. 2004;24:863
  193. Nieminen P, Kotaniemi L, Hakama M, et al. A randomised public-health trial on automation-assisted screening for cervical cancer in Finland: performance with 470,000 invitations. Int J Cancer. 2005;115:307–311
  194. Nieminen P, Kotaniemi-Talonen L, Hakama M, et al. Randomized evaluation trial on automation-assisted screening for cervical cancer: results after 777,000 invitations. J Med Screen. 2007;14:23–28
  195. Fenton JJ, Taplin SH, Carney PA, et al. Influence of computer-aided detection on performance of screening mammography. N Engl J Med. 2007;356:1399–1409
  196. Hall FM. Breast imaging and computer-aided detection. N Engl J Med. 2007;356:1464–1466
  197. Hill RB, Anderson RE. Autopsy: Medical Practice and Public Policy. Boston: Butterworth-Heinemann; 1988;
  198. Cases and commentaries. AHRQ Web M&M, October 2007. Accessed December 12 http://www.webmm.ahrq.gov/index.aspx2007;
  199. Fischer MA, Mazor KM, Baril J, Alper E, DeMarco D, Pugnaire M. Learning from mistakes: factors that influence how students and residents learn from medical errors. J Gen Intern Med. 2006;21:419–423
  200. Patriquin L, Kassarjian A, Barish M, et al. Postmortem whole-body magnetic resonance imaging as an adjunct to autopsy: preliminary clinical experience. J Magn Reson Imaging. 2001;13:277–287
  201. Umpire Information System (UIS). Available at: http://www.questec.com/q2001/prod_uis.htm. Accessed April 10, 2008.
  202. Graber ML, Franklin N, Gordon R. Reducing diagnostic error in medicine: what's the goal?. Acad Med. 2002;77:981–992
  203. Deyo RA. Cascade effects of medical technology. Annu Rev Public Health. 2002;23:23–44
  204. Dijksterhuis A, Bos MW, Nordgren LF, van Baaren RB. On making the right choice: the deliberation-without-attention effect. Science. 2006;311:1005–1007
  205. Redelmeier DA, Shafir E. Medical decision making in situations that offer multiple alternatives. JAMA. 1995;273:302–305
  206. Miller RA, Masarie FE. The demise of the ”Greek Oracle” model for medical diagnostic systems. Methods Inf Med. 1990;29:1–2
  207. Tsai TL, Fridsma DB, Gatti G. Computer decision support as a source of interpretation error: the case of electrocardiograms. J Am Med Inform Assoc. 2003;10:478–483
  208. Galletta DF, Durcikova A, Everard A, Jones BM. Does spell-checking software need a warning label. Communications of the ACM. 2005;48:82–86
  209. Tolstoy L. Anna Karenina. Project Gutenberg, July 1, 1998. Accessed December 11 http://www.gutenberg.org/etext/13992007;
  210. Committee on Quality of Health Care in America, Institute of Medicine Report. Washington, DC: The National Academy Press, 2001.
  211. Gladwell M. Million-dollar Murray. The New Yorker. February 13, 2006:96–107.

 This research was supported through the Paul Mongerson Foundation within the Raymond James Charitable Endowment Fund (ESB) and the National Patient Safety Foundation (MLG).

 Statement of author disclosures: Please see the Author Disclosures section at the end of this article.

PII: S0002-9343(08)00040-5

doi: 10.1016/j.amjmed.2008.01.001

The American Journal of Medicine
Volume 121, Issue 5, Supplement , Pages S2-S23 , May 2008

Article Tools