Introduction
Rural populations experience significant health disparities compared to their urban counterparts. Rural Americans face an increased incidence of chronic and preventable diseases including heart disease, cancer, stroke and respiratory disease and a reduced life expectancy [1,Reference Coughlin, Clary and Johnson2]. Although multifactorial, a major driver of these disparities is access to care, including limited primary care physicians (PCPs). Although 17% of the US population lives in rural locations, only 10% of physicians practice there [Reference Nielsen, DAgostino and Gregory3,4]. Rural areas have 5.1 PCPs and 11.1 advanced practice providers (APPs) – nurse practitioners, physician assistants, and certified nurse midwives – per 10,000 residents compared to 8.0 PCPs and 14.7 APPs in urban areas [Reference Pender5]. The rural health workforce shortage of over 20,000 PCPs in 2025 further contributes to disparities given that higher densities of PCPs are associated with lower mortality rates [Reference Nielsen, DAgostino and Gregory3]. Current implemented solutions to alleviate the physician shortage include loan repayment programs, visa waivers, and scholarships. However, many programs focus on recruiting new physicians to areas with shortages rather than working to retain current rural physicians [Reference Arredondo, Touchett, Khan, Vincenti and Watts6]. Therefore, identifying solutions to support rural PCPs and APPs (herein: rural primary care clinicians [RPCCs]) is critical to addressing rural health disparities.
Programs supporting rural health need to address the unique challenges faced by RPCCs, including higher patient ratios and longer hours, a wider range of conditions treated due to fewer sub-specialists, and professional isolation [Reference Nielsen, DAgostino and Gregory3,7,Reference Weeks and Wallace8]. Project Extension for Community Healthcare Outcomes (ECHO) is an evidence-based, hub-and-spoke tele-education model aimed at improving the quality of care and reducing health disparities in rural communities [Reference Arora, Thornton and Murata9–Reference Kawasaki, Hwang and Buckner11]. A growing body of research demonstrates the efficacy and sustainability of the model across health care [12].
Our goal was to support RPCCs while disseminating guideline-concordant care to address rural health disparities. Therefore, we developed the Rural Health Project ECHO program, informed by rural health stakeholders and specifically designed to support RPCCs.
Methods
Project ECHO overview
The Rural Health Project ECHO program was developed over eight months in 2023 and delivered via two education cohorts, each consisting of nine, 60-minute sessions. The first cohort was held bi-weekly, November 3, 2023–March 8, 2024 with 32 participants, and the second cohort was held monthly, September 12, 2024–May 22, 2025, with 74 participants. Eight participants attended both cohorts. Session format followed the ECHO model® and included introductions, a 15-minute didactic presentation delivered by a medical expert on a rural health topic, 1–2 participant “spoke”-led de-identified patient case presentations, and a closing and debrief. Participant-shared de-identified patient case presentations served as the crux of each session ensuring mastery of content and skills. Following these case presentations, the participant group was encouraged to ask clarifying questions and offer recommendations. ECHO experts provided best-practice case recommendations, which were summarized verbally and by email follow-up. All sessions concluded with a hub-led debrief encouraging RPCCs to put into practice what they learned. The ECHO program was provided at no cost to participants, and all sessions were CME-eligible. Rurality was measured using the Center for Rural Pennsylvania’s county designations [13] (Table 1).
Rural health ECHO participant demographics
Stakeholder-engaged curriculum development
During the planning phase, we utilized several approaches to ensure the highest-impact topics were identified and covered early in the curriculum. First, our expert rural health physician hub team provided feedback on proposed topics based on their personal experiences in rural health. Second, our Stakeholder Advisory Board, comprised of one rural PCP, one physician assistant employed at a rural health clinic, the CEO of a rural-based federally qualified health center, and a former Internal Medicine Chief at a hospital system serving rural communities, reviewed and provided feedback on the proposed curriculum. Lastly, during the online registration process, we included the proposed topic list for participants’ feedback.
Community-engaged approaches were used to develop the Rural Health Project ECHO program to ensure it would be supportive of RPCCs. First, we identified publicly available educational programs for RPCCs and toolkits to combat burnout [14]. Next, we met one-on-one with RPCCs and organizational leaders (n = 6) to discuss unique challenges and barriers faced when working in rural areas. Our stakeholders expressed the need for practical and timely information, with a less overt wellness focus, which was discussed to address burnout. This feedback led to a session structure that promoted a learning community for isolated providers while providing much-needed evidence-based medical knowledge. RPCC input during registration informed topic priority and selection. This resulted in curriculum refinement to nine meaningful sessions in each cohort (Table 2).
Comparisons of mean knowledge retrospective pre–post ECHO session
Mean estimates, confidence limits, and p-values from a repeated measures model including terms for the session, pre/post time, and the interaction between the two terms. Means and confidence intervals were rounded to 1 decimal place.
* Glucagon-like peptide-1.
Participant recruitment
Participant recruitment for Cohort 1 was conducted August–October 2023. A purchased list of RPCCs in select Pennsylvania counties and an internal database of Penn State’s Project ECHO alumni participants were used to send two separate email invitations. Penn State recruitment partners, including Primary Health Network, Pennsylvania Association of Community Health Centers (PACHC), and the Pennsylvania Area Health Education Center, were also engaged to distribute recruitment materials to their respective networks. Additionally, members of the hub team distributed recruitment materials to their networks of RPCCs. Finally, the ECHO team distributed flyers at the PACHC Annual Conference and Clinical Summit in October 2023. Cohort 2 recruitment was conducted June–August 2024 and replicated Cohort 1 recruitment methods, with the exception of conference flyers. While the ECHO program was designed with RPCCs in mind, enrollment was not restricted to PCPs and APPs. Participants included nurses, community health workers, and social workers involved in rural health care as well as rural clinic administrators (Table 1). Multidisciplinary teams from 11 clinics participated in the Rural Health Project ECHO program. Registrants from non-rural counties were not excluded from participation as areas within these counties may be classified as rural using other definitions of rurality.
Program evaluation
Participant evaluation data was collected at registration (baseline), after each ECHO session (post-session), and at the end of the ECHO program (post-program). At registration, participants completed an electronic survey collecting demographic information and pre-ECHO measurements. Burnout was self-reported by participants pre- and post-participation using the non-proprietary single item burnout measure [Reference Dolan, Mohr and Lempa15]. This measure instructs participants to rate their level of burnout based on a 5-point ordinal scale, where 1 = “I enjoy my work. I have no symptoms of burnout.” and 5 = “I feel completely burned out and often wonder if I can go on. I am at the point where I may need some changes or may need to seek some sort of help.” Study data were collected and managed using REDCap electronic data capture tools hosted at Penn State Health Milton S. Hershey Medical Center and Penn State College of Medicine [Reference Harris, Taylor, Thielke, Payne, Gonzalez and Conde16].
Participants were evaluated after each ECHO session (nine sessions per cohort) regarding their medical knowledge on each curriculum topic. Participant knowledge changes were self-reported using a 5-point ordinal scale, using two separate questions phrased, “Please rate your knowledge before/after the ECHO session.” To minimize recall bias, the knowledge questions were asked using a retrospective post-pre approach, with the questions appearing in the session evaluation survey after each ECHO session. A generalized linear model for repeated measures, which included predictors for session (1–9), time within session (pre, post), and their interaction, was used to compare differences in mean knowledge between pre- and post-timepoints within each of the nine ECHO sessions and collectively across the program. The model used mean change as the measure of central tendency between pre- and post-session, and the distribution of responses was examined using histograms and residual diagnostics. Model assumptions were assessed using plots of the standardized and studentized residuals from the model as well as box plots of the outcome variable itself. All comparison testing was completed using SAS 9.4 software [17]. Also assessed were participants’ ability to provide care, intent to make changes in their practice due to ECHO session participation, and sense of professional isolation. These questions were developed using Moore’s Levels for CME framework [Reference Moore, Green and Gallis18].
Results
Two cohorts of the pilot Rural Health Project ECHO program have been completed with 106 participants (98 unique). Table 1 shows key participant demographic breakdowns for each cohort and overall. Approximately two-thirds of participants worked in primary care, and nearly half (45.3%) reported residing or working in rural counties in Pennsylvania. Professional roles held by all participants include physicians (36.8%), APPs (16.0%), nurses (22.6%), and other professionals involved in rural healthcare (23.6%), including community health workers, social workers, and rural clinic administrators.
A total of 167 ECHO session evaluations were collected for the 18 ECHO sessions across cohorts 1 (19 unique respondents) and 2 (46 unique respondents). Most participants (n = 65, 61.3%) completed at least one post-session evaluation. Participants self-reported changes in knowledge related to each session topic. The repeated measures model analysis of mean knowledge by session (Table 2) showed statistically significant (p < 0.05) increases in mean knowledge for 16 out of the 18 sessions. Mean knowledge was also assessed overall for all 18 sessions and was found to be statistically significant (p < .001)
Participants were also asked about changes in their ability to provide care, intent to make changes in their practice, and sense of professional isolation (Table 3). Among participants completing post-session evaluations (n = 65), many agreed or strongly agreed that because of their participation in an ECHO session, their sense of professional isolation decreased (71.9%), their ability to provide care in the topic area improved (88.6%), and they intended to make changes in their practice (74.3%).
Aggregated session evaluation results, cohorts 1 and 2 (n = 167)
Discussion
This pilot program found that participation in the Rural Health ECHO series can improve provider knowledge on a range of medical topics important to RPCCs, supporting their treatment of a wider range of conditions. This could potentially lead to a decrease in specialty referrals, alleviating pressure on the healthcare system and lessening patient burden. Programs such as this one could be used to enhance knowledge of evidence-based topics to address rural health disparities as well as prevent or alleviate professional isolation in RPCCs by establishing supportive virtual peer learning communities. While this program was initially conceptualized to address rural provider burnout, baseline participant data did not demonstrate high levels of burnout. It is possible that providers experiencing burnout are less likely to seek recurring continuing education sessions.
Limitations to our findings include a limited post-evaluation sample size. While all participants completed the baseline survey, the post-program response rate was 12.5% in Cohort 1 and 9.5% in Cohort 2. Due to the small post-program response rate and low pre-burnout values, post-program self-reported burnout values were not reported or analyzed. Another potential limitation was our use of the Center for Rural Pennsylvania’s definition for rural counties, which may have missed some rural providers. There are many definitions used to distinguish rural areas which may capture urban-designated counties with rural providers, such as (1) the US Bureau of the Census’ urban classification, (2) the Office of Management and Budget’s definition of metropolitan and non-metropolitan areas, (3) the Federal Office of Rural Health Policy’s Rural Urban Commuting Area Codes, and (4) the Health Resources and Services Administration’s definition of rural areas.
This study’s strength is the significant knowledge gain from ECHO attendance, supporting evidence of the model’s effectiveness in provider education [12]. Further, this program was strengthened by the stakeholder-focused curriculum design and range of participant roles in rural healthcare.
Future plans for this program include two additional cohorts 2026–2027, with the addition of a one-day in-person gathering to accompany the ECHO education sessions. This new event will provide RPCCs expert-led, hands-on training and networking with ECHO colleagues, specialists, and medical students and resident physicians training to work in rural settings. Future cohorts will incorporate strategies to increase post-program evaluation response rates.
Conclusions
Project ECHO presents many opportunities for future rural health programing. The pilot Rural Health ECHO program demonstrates the feasibility of the ECHO model and the viability of engaging rural health stakeholders in planning curriculum to ensure participants receive education tailored to address rural health challenges.
Acknowledgments
The authors would like to acknowledge the expert hub team and flash talk presenters for the ECHO program, including Matthew Nudy, Taraneh Soleymani, Paul Williams, Karen Krok, Rolling Wright, and Kathleen Dougherty. Additionally, the authors would like to thank senior project manager Jessica Beiler for her administration of the ECHO program. The authors would also like to thank the Project ECHO team at Penn State University for their work in facilitating the ECHO program. Lastly, the authors would like to thank Ross and Carol Nese for their support of this project and vision to support Pennsylvania’s rural health workforce.
Author contributions
Jennifer L. Kraschnewski: Funding acquisition, Supervision, Writing – original draft, Writing – review & editing; Laura L. Felix: Data curation, Visualization, Writing – original draft, Writing – review & editing; Sarah Cichy: Funding acquisition, Writing – original draft, Writing – review & editing; Matthew Silvis: Conceptualization, Resources, Writing – review & editing; Chad Shaffer: Conceptualization, Resources, Writing – review & editing; Erik Lehman: Formal analysis; Ruth Hogentogler: Funding acquisition, Writing – review & editing; Cynthia H. Chuang: Conceptualization, Supervision, Writing – review & editing.
Funding statement
The project described was supported by the Ross and Carol Nese Foundation and by the National Center for Advancing Translational Sciences, National Institutes of Health, through Grant UL1 TR002014 and Grant UL1 TR00045. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.
Competing interests
The author(s) declare none.
Ethical standards
This Project ECHO program received a not-human subjects research determination by the Pennsylvania State University Institutional Review Board (STUDY00018204) as it does not meet the definition of human subject research as defined in 45 CFR 46.102(e) and/or (I).
Open access
