- •Four positive domains are identified for long-standing Program Directors (PDs): purpose, culture, nature of the work, and sense of achievement.
- •Nature of the work is associated with long-standing PDs continuing in their role, finding joy, and thriving.
- •PDs who do not feel effective or thriving consistently describe threats.
- •Academic medicine leadership should prioritize mitigation of the identified threats because PD retention remains a major area of concern across graduate medical education.
Introduction
Methods
Survey Instrument and Ethical Approval
Data Collection
Accreditation Council for Graduate Medical Education (ACGME). Accreditation Database System Online (Public). Available at: https://apps.acgme.org/ads/Public/Programs/Search. Accessed December 12, 2018.
Data Analysis
US Census Bureau. Census regions and divisions of the United States. Available at: https://www2.census.gov/geo/pdfs/maps-data/maps/reference/us_regdiv.pdf. Accessed December 12, 2018.
American Medical Association (AMA. Fellowship and Residency Electronic Interactive Database Access System (FREIDA). Available at: https://freida.ama-assn.org. Accessed December 12, 2018.
Respondents (n = 78) | Nonrespondents (n = 34) | Total (n = 112) | ||
---|---|---|---|---|
No.(Column %) | No.(Column %) | No.(Column %) | P Value | |
Description (FREIDA) | ||||
University-based | 27 (34.6) | 10 (29.4) | 37 (33.0) | 0.666 |
All other program types | 51 (65.4) | 24 (70.6) | 75 (67.0) | |
US Census Bureau Region | ||||
Northeast | 25 (32.5) | 8 (24.4) | 33 (30.0) | 0.497 |
Midwest | 14 (18.2) | 12 (36.4) | 26 (23.6) | 0.051 |
West | 14 (18.2) | 5 (15.2) | 19 (17.3) | 0.789 |
South | 24 (31.2) | 8 (24.4) | 32 (29.1) | 0.502 |
Accreditation Status: Continued (ACGME) | 76 (97.4) | 33 (97.1) | 109 (97.3) | 0.910 |
Median (SD) | Median (SD) | Median (SD) | P Value | |
Program size: No. filled positions (ACGME) | 53.5 (39.5) | 51.5 (36.3) | 52.5 (38.5) | 0.837 |
Program director tenure (as of January 2019): years (ACGME) | 13 (6.5) | 13.5 (6.6) | 13 (6.5) | 0.668 |
Program accreditation year (ACGME) | 1965 (18.3) | 1964 (16.8) | 1964.5 (17.8) | 0.681 |
Development of the Coding Scheme
Reliability of the Results
Summative Approach to the Data
Domain | Definition/Example | Representative Quotes |
---|---|---|
Sources of joy/effectiveness/thriving | ||
Purpose | Overarching ideas or principles that give the respondent meaning in their work or a sense of mission | “I feel like I support, challenge, and encourage the growth of young physicians.” |
Culture | Institutional or department support that includes resources or “moral” support | “I feel like I am thriving—I have a lot of autonomy from my chair and a great team of APDs—I don't want another job.” |
Connections or relationships with others including their team of APDs, office staff, core faculty | “Fortunately for me, I work with some of the best faculty, who have been with me for over 30 years. My Program Director still works with me as a mentor and advisor to our residents. Many of our key faculty have been in the department for over 25 years. It's like a family. . . .” | |
Nature of the work | Attributes of the work, including being flexible, interesting, creative, and challenging | “I think what keeps me going is the drive to continually grow, improve, change, innovate, and challenge myself and my team. My job description stays the same, but my actual role is always evolving. I feel that as long as I continue to learn and be enriched by my residents and colleagues, I will feel that I am thriving. “ |
Content of the work, including relationships with residents, teaching, and recruitment of residents | “I love taking care of my residents, especially during tough times.” | |
Achievement or Performance | Program or individual resident outcomes or performance either external (ABIM, ACGME), institutional or departmental | “Absolutely Yes! I have significantly improved the quality of training through innovation and I also learned a lot from my residents. We also improved our board pass rate significantly and maintained it.” |
Professional development, including personal and professional growth and leadership development | “I feel effective in most parts of my job. After 14 years, my hospital offered me an executive coach who was remarkably helpful in grappling with areas that I was less effective at.” | |
Personal validation and confidence of being technically good at the job; developed the skill set to do the job; managerial, utilitarian perspective | “It took a while to reach this stage but I think I felt very effective by the time I had done the job at least 5 years. It does take a while. You think you're effective early on, but it's not until you reflect back on those early years that you realize you weren't in total control of everything. Experience takes time.” “ . . . experience of 25+ years promotes equanimity.” | |
Feeling valued, respected, or needed in their position | “I have finally gotten to a point where I feel not only effective, but truly valued and maybe even beloved. It took me at least ten years to feel this way.” | |
Threats to joy/effectiveness/thriving | ||
Nature of the work | Any threat that would fall under defined PD responsibilities; for example, working with ACGME changes or recruitment | “I have thrived less because more of what I do now is checking boxes, going to meetings, begging for money, and protecting the residents from being the solution to everyone's problems.” “ . . . Too much administrative work now.” |
Too many responsibilities | Anything outside of the PD role; too much service time, taking on a role outside of PD | “ . . .more and more administrative work has crept into my role, decreasing my direct contact time with the residents.” |
Culture | Instances with culture as a general concept noted a threat | “Over the past 2 years, we have been dealing with several disgruntled residents. Despite many years’ perspective on what a resident should be learning and implementing a multitude of educational innovations with regular resident input, there appears to be a disconnect in expectations.” |
Lack of support | Instances where lack of support is noted as a threat, including financial threats | “I love my faculty and residents, but don't feel supported by administration. Our DIO is viewed as a ‘threat’ to our program by both residents and faculty.” |
Other | Other threats not already defined | “Residents’ expectations and sense of entitlement have had a negative impact on my professional enjoyment as a PD.” |
Change over time | How PD feelings change over time | “I do feel effective, but perhaps less so than I felt ten years ago. This is largely due to hospital economics and 'throughput' concerns which are frequently given a higher priority by hospital administration than are the teaching programs' needs. This has been true at both institutions where I've served as PD, and includes the institution where I now serve as Medicine PD and DIO.” |
Results
No. Respondents (Column %) | |||||
---|---|---|---|---|---|
Domains * ,Multivariate tests for survey responses coded into each “domain” for each survey questions: Adjusted likelihood ratio χ2 (465 degrees of freedom): 635.41; P < .001; Lawley χ2: (464 degrees of freedom): 610.27; P < .001; Doornik-Hansen test for multivariate normality: χ2: (62 degrees of freedom): 5572.742; P < .001. † Multiple correspondence analysis (Burt/adjusted inertias) for confirmation of internal validity of the items within each “domain:” Why continue?: Total inertia (TI) = 0.02; 6 dimensions. Joy and Achievement: TI = 0.02; 7 dimensions. Feel Effective?: TI = 0.01; 8 dimensions. Thriving in Role?: TI = 0.02; 8 dimensions. PD Ledge: TI = 0.02; 6 dimensions. | Reasons why PDs continue in role (n = 74) | Things that bring PDs joy and achievement? (n = 78) | Reasons PDs feel they are effective (n = 68) | Reasons PDs feel they are thriving (n = 69) | Reasons PDs strongly considered leaving the position (n = 65) |
Purpose | 35 (47.3) | 37 (47.4) | 6 (8.8) | 7 (10.1) | 18 (27.7) |
Culture | 17 (23.0) | 15 (19.2) | 19 (27.9) | 18 (26.1) | 18 (27.7) |
Nature of the work | 50 (67.6) | 68 (87.2) | 12 (17.7) | 19 (27.5) | 14 (21.5) |
Achievement or performance | 17 (23.0) | 22 (28.2) | 37 (54.4) | 28 (40.6) | 3 (4.6) |
Threats | 3 (4.1) | 14 (18.0) | 18 (26.5) | 33 (47.8) | 61 (93.9) |
Change over time | 1 (1.4) | 32 (41.0) | 19 (27.9) | 0 (—) | 0 (—) |
No. of Respondents (Column %) | No. of Respondents (Column %) | ||
---|---|---|---|
Feels effective as PD | |||
Feels thriving as PD | Yes (n = 61) | No/Equivocal (n = 16) | P Value |
Yes | 35 (57.4) | 4 (25.0) | .026 |
No/Equivocal | 26 (42.6) | 12 (75.0) | |
Feels effective as PD | |||
Domains | Yes (n = 52) | No/Equivocal (n = 16) | P Value |
Purpose | 6 (11.5) | 0 (—) | .692 |
Culture | 19 (36.5) | 0 (—) | .030 |
Nature | 8 (15.4) | 4 (25.0) | .964 |
Achievement or performance | 34 (65.4) | 3 (18.8) | .007 |
Threats | 6 (11.5) | 12 (75.0) | <.001 |
Change over Time | 13 (25.0) | 6 (37.5) | .939 |
Feels thriving in role as PD | |||
Domains | Yes (n = 32) | No/Equivocal (n = 37) | P Value |
Purpose | 5 (15.6) | 2 (5.4) | .651 |
Culture | 12 (37.5) | 6 (16.2) | .240 |
Nature of the work | 13 (40.6) | 6 (16.2) | .032 |
Achievement or performance | 20 (62.5) | 8 (21.6) | .003 |
Threats | 0 (—) | 33 (89.2) | <.001 |

Q16: How have you used key institutional/departmental supports to be effective? Q17: How have you used your at-work team (e.g., APDs, program coordinator, chiefs) to be effective? Q19: In times when you have not had the support needed to be effective, what was your solution? Consider the following groups in your response: GMEC/DIO, Chair, Hospital Leadership, internal or external mentors, APDIM or other external organizations. |
Support from chiefs of hospital, GME leadership, and especially the department chair, including financial support and emotional security knowing the educational mission is valued |
ACGME requirements for the program and CLER visits for the institution |
Faculty development offerings by AAMC and other developmental training and coaching for the PD |
Cultivating effective relationships with leadership with regular communication about the training program |
Support for chief medical residents |
A team of Associate Program Directors, Program Coordinators, and faculty that have clear roles and responsibilities |
APDIM and other organizations that provide external mentorship |
Internal Mentorship and like-minded leaders |
Discussion
Conclusions
Acknowledgment
Appendix
Survey Instrument: Factors of Resilience and Sustainability of Long-Term IM PDs
- □Click “PROCEED” (below) to begin.
- ○Female
- ○Male
- ○Other
- ○Prefer not to answer
- ○Married
- ○In a relationship; not married
- ○Not in a relationship
- ○Prefer not to answer
- ○Yes
- ○No
- ○I am expecting/My partner or spouse is expecting
- ○Prefer not to answer
- ○Yes
- ○No
- □Allergy/Immunology
- □Cardiology
- □Critical Care Medicine
- □Emergency Medicine
- □Endocrinology
- □Gastroenterology
- □General Internal Medicine: ambulatory only
- □General Internal Medicine: hospital and ambulatory
- □Geriatrics
- □Hematology
- □Hospice and Palliative Care
- □Hospitalist: General Internal Medicine
- □Hospitalist: Subspecialty
- □Infectious Diseases
- □Medicine - Pediatrics
- □Nephrology
- □Oncology
- □Preventive/Occupational Medicine
- □Pulmonology
- □Rheumatology
- □Sleep Medicine
- □Other (please specify): ______
References
Association of American Medical Colleges (AAMC). Tomorrow's doctors, tomorrow's cures. Available at: https://www.aamc.org/. Accessed January 29, 2021.
Accreditation Council for Graduate Medical Education. The Program Directors’ Guide to the Common Program Requirements (Residency). Available at: https://www.acgme.org/Portals/0/PFAssets/ProgramRequirements/CPRResidency2020.pdf. Accessed January 29, 2021
- Directing an emergency medicine residency: the problems and their potential solutions.Acad Emerg Med. 1995; 2: 914-918
Alliance for Academic Internal Medicine (AAIM). Alliance for Academic Internal Medicine. Association of Program Directors in Internal Medicine Annual Survey of Residency Program Directors Study Database. 2018.
- Radiology resident' satisfaction with their training and education in the United States: effect of program directors, teaching faculty, and other factors on program success.AJR Am J Roentgenol. 2016; 206: 907-916
Accreditation Council for Graduate Medical Education (ACGME). Accreditation Database System Online (Public). Available at: https://apps.acgme.org/ads/Public/Programs/Search. Accessed December 12, 2018.
Qualtrics software, V.X.C.
US Census Bureau. Census regions and divisions of the United States. Available at: https://www2.census.gov/geo/pdfs/maps-data/maps/reference/us_regdiv.pdf. Accessed December 12, 2018.
American Medical Association (AMA. Fellowship and Residency Electronic Interactive Database Access System (FREIDA). Available at: https://freida.ama-assn.org. Accessed December 12, 2018.
- Competing paradigms in qualitative research.in: Denzin NK Lincoln YS Handbook of Qualitative Research. Sage Publications, Thousand Oaks, CA1994: 110-114
- Three approaches to qualitative content analysis.Qual Health Res. 2005; 15: 1277-1288
- Why do residency program directors consider resigning? A mixed-methods analysis of a national program director survey.Am J Med. 2020; 133: 761-767
- Qualitative content analysis.in: Liva J Laura AS Empirical Methods for Bioethics: A Primer. Emerald Group Publishing Limited, Bingley, UK2007: 39-62
- Medical school faculty discontent: prevalence and predictors of intent to leave academic careers.BMC Med Educ. 2007; 7: 37
- Internal medicine residency program director burnout and program director turnover: results of a national survey.Am J Med. 2019; 132: 252-261
- Job turnover and its correlates among residency program directors in internal medicine: a three-year cohort study.Acad Med. 2001; 76: 1127-1135
- Career fit and burnout among academic faculty.Arch Intern Med. 2009; 169: 990-995
- If every fifth physician is affected by burnout, what about the other four? Resilience strategies of experienced physicians.Acad Med. 2013; 88: 382-389
- To find meaning in your work, change how you think about it.Harvard Business Review. 2017 (Available at:) (Accessed September 29, 2020)
- Sources of satisfaction: a second administration of the program director satisfaction survey.Am J Med. 2009; 122: 196-201
- Basics of Qualitative Research: Grounded Theory Procedures and Techniques.Sage Publications, Inc, Thousand Oaks, CA1990: 270
- Design: selection of data collection methods.J Grad Med Educ. 2016; 8: 263-264
Article Info
Publication History
Footnotes
Funding: None.
Conflicts of Interest: None.
Authorship: All authors had access to the data and a role in writing this manuscript.