The USA faces a biomedical workforce crisis, specifically in research; 30 years ago, 4% of individuals in the biomedical workforce identified as researchers, and now that number is just 1% [1]. In addition, this constrained workforce is characterized by insufficient recruitment and retention of individuals from underrepresented backgrounds in biomedical training [Reference Nikaj, Roychowdhury, Lund, Matthews and Pearson2]. Among those initially recruited into science, technology, engineering, and mathematics (STEM) education, attrition from these fields starts at the beginning of undergraduate training, and students from underrepresented racial and ethnic group (also referred to as underrepresented minority, or URM) backgrounds exit STEM majors at an especially high rate, and disproportionate attrition perpetuates through training, career, and leadership positions. While racial and ethnic minorities comprise one-third of the US population, they represent only 10% of life science PhDs – and just 5% of tenure-track faculty in the biological sciences [3]. Systemic and structural barriers causing insufficient diversity, maintaining inequity, and limiting inclusion lead to the perpetuation of inequities in both research and healthcare delivery [1].
With support from the Burroughs Wellcome Fund, [blinded Entity 1] [Reference McElvaine, Hawkins-Salsbury and Arora4–Reference Hurst and Barrett6] launched an initiative to support individuals from URM backgrounds who have biomedical career interests. It developed a post-baccalaureate program to prepare students interested in pursuing a biomedical research career for acceptance to, and success in, graduate biomedical or medical scientist programs (MD or MD/PhD). Prior to program launch, [blinded Entity 1] partnered with [blinded Entity 2] to conduct a formative evaluation research study to determine areas of need among undergraduates and recent graduates at diverse academic institutions who are interested in biomedical careers. This aimed to inform the developing [blinded primary program name] program and other initiatives working to prepare individuals for successful completion of biomedical degree programs and to generate a cohort of diverse, well-trained scientists to strengthen the research enterprise.
Method
This project was guided by the following questions: What are the current challenges facing undergraduate students in gaining admission to and succeeding in biomedical graduate school? What supports or infrastructures may facilitate admission to and success in medical or graduate school? What factors are particularly salient for individuals from URM backgrounds?
An exploratory sequential mixed-method empirical process addressed these questions [Reference Creswell and Clark7]. Phase 1 included qualitative data collection with key informants to help inform factors for success and key challenges that would be addressed in a Phase 2 graduate student survey. This included focus groups with 10 faculty members from the [blinded Regional STEM Diversity Coalition] and thematic analysis of focus group data using NVivo 12. More information about Phase 1 methodology, including the focus group guide, is available as Supplemental Digital Appendix 1. Results from these focus groups informed the content and constructs included in a subsequent Phase 2 graduate student survey. The survey addressed areas including: skills and experiences needed for application to/success in a biomedical graduate degree, mentorship experience, and psychosocial challenges. Respondents were primarily recruited through [blinded Primary University] and secondarily via contacts at other institutions [blinded Universities 2–4] and [blinded Regional STEM Diversity Coalition] members; Table 1 shows participant race/ethnicity, gender, and URM status. Quantitative data were analyzed in SAS 9.4 and included descriptive statistics, Cohen’s d statistics to measure effect size of difference, independent t-tests to examine group differences, and selected ordinary least squares (OLS) regressions. Open-ended survey data were analyzed for themes using NVivo 12 [8]. More information on Phase 2 methodology and instruments is in Appendix 2.
Survey respondent demographics (n = 244)*
* N = 3 respondents did not respond to demographic questions and are excluded from this table, with total respondents including those missing demographic data = 247. These three respondents were not included in any analyses including demographic data (i.e., URM and non-URM-specific analyses).
Duke University Campus IRB approval was waived for key informant focus groups (IRB determined faculty involvement as expert consultation; 2/21/2021) and was granted for survey data (2022-0060, approved 10/8/2021).
Results
Phase 1: key informant faculty focus groups
Respondents reported that students’ early consideration of biomedical research careers, critical preparatory coursework, and research experience were key facilitators of biomedical graduate program entry. Additional critical skills and experiences included GRE/MCAT preparation, reading primary (academic or scientific) literature, basic laboratory competency, quantitative proficiency, critical thinking and analytic skills, writing/communication skills, and time management. Respondents reported that lack of awareness of biological science opportunities outside of medicine can be more prominent for URMs, first generation, and/or those attending non-R1 institutions. This lack of awareness was rooted in multiple factors including lack of role models. In addition, students at smaller or non-R1 undergraduate institutions may lack sufficient research experience, both in terms of quantity and quality, to be competitive graduate school candidates.
Respondents also noted challenges URM-identified students can face based on differences in their approach and confidence. For instance, attending an undergraduate institution with high admission rates, and high performance relative to their peers at their undergraduate institution, can lead to a less competitive mindset that can affect their likelihood of pursuing opportunities to improve chances of graduate school admission and, if admitted, preparation for rigor and competitiveness of study. Respondents reported that some URMs, especially Black or first-generation immigrants, may come from cultures that discourage assertiveness, leading them to be less likely to propose or advocate for their own research agendas than peers. Respondents indicated how imposter syndrome and can be exacerbated by a lack of diversity in a program and other direct experiences of racism or sexism.
Respondents addressed the deliberate cultivation of supportive communities a defining feature of successful training and preparatory programs and particularly consequential for underrepresented racial/ethnic minorities and women. Mentorship was also seen as essential and extending beyond faculty and principal investigators, needing to encompass post-docs and graduate students with more day-to-day involvement with students. Supportive institutional culture, especially in the laboratory, and strong mentorship (or the lack thereof) was often described as the determining factor in post-baccalaureate and first-year graduate students’ decisions of whether to continue in the biological sciences.
Phase 2: graduate student survey
Application to graduate programs
Survey respondents indicated that all skills/experienced assessed, conceptualized as potentially important to a successful biomedical degree program applications, were indeed at least moderately important (Table 2). Knowledge of how to complete applications and having good recommendation letters were rated as most essential. URM respondents indicated that time management and recommendations were significantly more important compared to non-URM respondents. In ratings of respondents’ strength at the time of their application to their degree program, URM respondents reported lower skills in basic laboratory competency compared to their non-URM peers (approaching significance, p < 0.10); however, URM respondents reported feeling marginally stronger than non-URM respondents in ability to complete applications and significantly stronger in good recommendation letters. Of note, focus group key informants indicated that URM participants, depending on their undergraduate institution, may not always realizing how strong their competition is for graduate school admission; this may be related to these sentiments of greater strength in these areas. Importance-strength discrepancies overall (i.e., the difference in means between relative importance and strength when applying) were greatest for in network connections and knowing what is needed for an application; URM respondents indicated the greatest discrepancies in network connections and as well as research/lab experience.
Importance of specific factors and strength in factors when applying to postgraduate institution (n = 241)a
a N for overall participants ranged from 240 to 241. Importance scale is 1–7, where 1 = not at all important and 7 = absolutely critical. Strength scale is 1–7, where 1 = extremely weak [novice] and 7 = extremely strong [expert].
b N for underrepresented minority (URM) participants ranged from 37 to 39.
c N for non-URM participants ranged from 200 to 205.
Success in graduate programs
Respondents considered all the skills and experiences indicated in the survey to be at least moderately important to success in their degree program, with critical thinking and time management as most important; see Table 3. However, URM respondents rated most skills and experiences as more important to success than non-URM respondents. In addition, as with the application itself, URM respondents stated that time management was more important compared to non-URM respondents (approaching significance, p < 0.10). Among research and professional competency skills directly assessed, reading scientific/academic literature, quantitative skills, network connections, and time management were described as most challenging for respondents. URM respondents indicated that network connections were significantly less challenging than non-URM respondents. Beyond skills, respondents reported that mentorship was a valuable support. Though the difference was not statistically significant, URM respondents reported that mentorship was more helpful compared to non-URM respondents. In an open-ended question about advice for incoming students (n = 202 responses), mentorship was second most frequently coded theme, and proportionately more URM respondents provided advice on the value of mentorship compared to non-URM respondents. Respondents spoke to the value of multiple mentorships, including developing relationships with faculty other than one’s advisor and seeking advice from peers.
Importance of specific skills/experiences to success compared to challenge in graduate program (n = 245) a
a N ranged from 242 to 245 overall. Importance to success of key factors uses scale 1–7, where 1 = not at all important and 7 = absolutely critical. Challenge in graduate program uses the scale 1–7, where 1 = extremely challenging and 7 = extremely easy.
b N = 39 for underrepresented minority (URM) respondents.
c N ranged from 200 to 203 for non-URM respondents.
Among all respondents, there were the greatest importance/challenge gap (importance for success vs. challenge experienced) for critical thinking, time management, and reading academic/scientific literature. URM respondents indicated the greatest gaps in reading academic/scientific literature, time management, and research/lab experience.
Regarding psychosocial and cultural challenges, respondents overall rated imposter syndrome (i.e., feelings of inadequacy) as the most challenging, followed by feelings of isolation. Respondents from URM backgrounds reported imposter syndrome as significantly more challenging compared to non-URM respondents and reported the competitive culture of their graduate program and feelings of isolation as marginally more challenging (p < .10). Overall, 42% of qualitative responses on advice to incoming students addressed psychosocial factors, representing the most frequently coded theme. URM respondents addressed psychosocial challenges at similar rates as non-URM respondents, but the content of that advice varied. Proportionately more URM respondents addressed finding a supportive community, self-care and wellbeing, and advice related to imposter syndrome; proportionately more non-URM respondents emphasized the importance of asking for help.
Discussion & conclusion
As skills assessed in the survey were considered at least slightly important to success during their graduate degree, they should be considered for post-baccalaureate programming. Post-baccalaureate programming could pay particular attention to skills and experiences where students face the greatest challenge or need relative to this skill/experience’s importance. For admission to graduate school, this includes knowing what is needed for an application and network connections; for success in graduate school, this includes critical thinking, time management, and ability to read academic/scientific literature. There are numerous areas in which we do not find significant differences between URM and non-URM students. This is critical to consider as it indicates that results may apply across students of different backgrounds and thus should be applied to any support programming. Yet, analyses speak to value of specific supports for URM-identifying students in select areas including research/lab experience, basic laboratory competencies, reading academic/scientific literature, and time management. URM respondents also reported greater psychosocial and cultural challenges, which suggests post-baccalaureate programs should consider how to best support and prepare these students for those challenges, particularly given historical institutional and structural sexism and racism within education, including within STEM higher education, that has systematically excluded women racial and ethnic minorities and led to specific challenges including lowered sense of belonging and self-efficacy [Reference Graves, Kearney, Barabino and Malcom9–Reference Marra, Rodgers, Shen and Bogue12]. Mentorship emerged as highly important, and URM respondents indicated relatively higher value for mentorship as a support compared to their peers; this echoes other work emphasizing the value of mentorship [Reference Kricorian, Seu, Lopez, Ureta and Equils13,Reference Lisberg and Woods14]. Mentorships established during post-baccalaureate can offer important support throughout graduate training, and a post-baccalaureate program could prepare students with an understanding of the importance of or strategies for identifying mentors in graduate school.
For [blinded primary program], this formative evaluation informed recruitment, application and review criteria, and mentor matching, and [blinded primary program] implemented recommendations from the study (e.g., providing specific support for desired skills, connecting participants to another on-campus program with an additional cohort of students, and strong mentorship). This formative evaluation has also informed efforts beyond [blinded primary program], such as the separate [blinded program 2] and can inform other related programs’ development, as well as broader research on support for biomedical graduate program success in general and for URM students.
Yet, this study, while contributing to knowledge on supporting a diverse biomedical field, has select limitations. The survey phase drew primarily from respondent trainees at one specific university, and it is possible that experience varies by institution. A larger sample size, particularly of URM respondents, may have highlighted more and/or varied statistically significant differences. Added research could further explore psychosocial and cultural challenges, including qualitative data collection (e.g., interviews and focus groups). Additional research could also further explore the role of undergraduate institution type, including designation (HBCU, R1, etc.) and students’ experience (e.g., degree of prior competitive culture) in informing their experience applying to and during graduate school. These research directions, building on the preliminary work discussed here, could further inform programs supporting biomedical graduate students.
Supplementary material
The supplementary material for this article can be found at http://dx.doi.org/10.1017/cts.2024.590.
Acknowledgements
The authors wish to thank the respondents who contributed to the data upon which this manuscript is based. Stephanie Rosner, as a graduate student intern, additionally contributed in initial steps of drawing together Phase 1 and Phase 2 results reports.
Author contributions
Conceptualization: ATM, RG, SP, and JS; Methodology: JS, NWR, WW, and ATM; Investigation: JS, NWR, and WW; Formal Analysis: NWR, WW, and JS; Writing – Original Draft: JS, NWR, and WW; Writing – Review & Editing: JS, NWR, WW, ATM, RG, and SP; Project Administration: JS, NWR, and ATM; Funding aquisition: RG.
Funding statement
This study was supported by Burroughs Wellcome Fund (RG, BWF #1018899; RG, BWF #1021772) and the Doris Duke Charitable Foundation (RG, DDCF #2020138).
Competing interests
ATM is a current employee of GSK. SRP serves as a consultant to Moderna, Merck, GSK, Pfizer, Dynavax, and Hoopika on their CMV vaccine programs and has held sponsored programs with Moderna and Merck on CMV vaccine development.
Open access
