Introduction
Community engagement is increasingly viewed as essential for advancing Clinical and Translational Science (CTS) and improving the public health [1–Reference Woolf, Zimmerman, Haley and Krist4]. Engagement strategies to promote bidirectional conversations with stakeholders on health research include Community Engagement Studios [Reference Joosten, Israel and Williams5], Science Cafés [Reference Ahmed, DeFino, Connors, Kissack and Franco6], Garden Cafés [Reference Balls-Berry, Sinicrope and Valdez Soto7], the HealthStreet model [Reference Cottler, McCloskey and Aquilar-Gaxiola8], and Community Advisory Boards [Reference Patten, Albertie and Chamie9,Reference Stewart, Boateng and Joosten10]. While effective, these face-to-face community outreach forums have limited reach and scale. With the COVID-19 pandemic and associated limits to group meetings and recommended social distancing measures to limit exposure, digital platforms hold promise as alternative channels to reach the broader public and enhance access to and engagement with CTS research [Reference Budd, Miller and Manning11,Reference Noonan and Simmons12]. In this program evaluation, our community-engaged research team at the Mayo Clinic (CTSA) and University of Minnesota (CTSI) NIH-funded centers for CTS evaluated the feasibility of a virtual, statewide, Facebook community platform to enhance public engagement with health research in Minnesota. Studies reported on the successful use of social media for participant recruitment to clinical trials and other research [Reference Darmawan, Bakker, Brockman, Patten and Eder13,Reference Topolovec-Vranic and Natarajan14]. However, to our knowledge, this is the first report of a social media-formed virtual community within the NIH-funded CTS Consortium.
Social media tools are widely adopted in the population. Nationally, YouTube and Facebook are the dominant social networking platforms used by 73% and 69% of online US adults, respectively [Reference Perrin and Anderson15]. Facebook use is similar across sociodemographic groups and geographic location (rural/urban), except for less use among men, those with less than a high school education and adults aged 65 and older [Reference Perrin and Anderson15]. A 2018 study conducted statewide in Minnesota explored the use of social media options for public engagement on transportation issues [Reference Schneider, Quick, Peck and Pflughoeft16]. Among 800 adult respondents, 72% reported using social media. Among social media users, Facebook had the highest use (92%) and daily use (88%) compared to YouTube or other platforms.
Formative work at Mayo Clinic indicated diverse community members in Minnesota preferred to receive information about health and research through social media platforms [Reference Balls-Berry, Quirindongo-Cedeno, Aleman, Grassie and Valdez Soto17,18]. Further, community member participants at Garden Cafés shared a desire for continued dialogues about research through social media [Reference Balls-Berry, Sinicrope and Valdez Soto7]. In pilot evaluations of two digital platforms (Twitter and a Web blog), content analysis of comments posted by community members indicated a key theme of increased awareness about health research and research findings (i.e., dissemination) [Reference Valdez Soto, Balls-Berry and Bishop19].
At the 2018 Minnesota state fair, our research team assessed adult Minnesota residents’ willingness and readiness to engage in a virtual Facebook community for conversations on health and research topics [Reference Eder, Patten and Brockman20]. Among survey respondents with a personal Facebook profile (n = 418; 66% women), about half (46%) agreed/strongly agreed they would be willing to join a Facebook page focusing on health and research topics. Content analysis of the open-ended survey questions indicated the types of information people wanted, the health topics people wanted to learn more about, and what would keep people engaged and interested. Based on this collective formative work, the research team created the Facebook page MN Research Link, a public, statewide, social media virtual platform to provide credible evidence-based health information and engage Minnesota residents in conversations on health and research topics. In this program evaluation, we assessed the feasibility of this Facebook community platform as indicated by participation, reach, and engagement. Because social media can be used to reach individuals in remote rural areas [Reference Noonan and Simmons12,Reference Perrin and Anderson15], we also assessed the proportion of our Facebook followers from rural counties.
Materials and Methods
The Mayo Clinic (CTSA) and the University of Minnesota (CTSI) NIH-funded CTS Community Engagement Programs partnered to design the Facebook platform and evaluation. The project was deemed exempt by the Mayo Clinic and University of Minnesota Institutional Review Boards.
Study Design
This program evaluation assessed uptake and engagement with the Facebook community platform MN Research Link from June 19, 2019 to June 30, 2020.
Facebook Page Design and Facilitation
The research team worked with social media and digital health experts at Mayo Clinic to design a public Facebook page titled MN Research Link. The goal of the MN Research Link was to serve as a credible source of health research information and research dissemination in Minnesota, and ultimately to enhance the public’s trust and engagement in health research.
Over the 12-month evaluation period, the MN Research Link page was facilitated by four social media managers (JC, IW, MVS, MZR). At any one time, the MN Research Link was facilitated by one–two individuals. Facilitators posted content daily. They scheduled live events and conducted interviews with researchers. Facilitators checked the page daily to review comments from followers. During the evaluation period, the four facilitators, along with four research team members (CAP, JBB, ELC, TAB) followed the page, but aside from posting content and sharing live events, team members were encouraged to have minimal engagement with the page.
MN Research Link Facebook Content
The project team collectively developed the content for the Facebook page. The research team has complementary expertise in community engagement, health communication, health education, psychology, behavioral science, epidemiology, and public health. We took into account the recommendations for developing health communication to engage stakeholders through social media platforms [21] and social media post design for Facebook [22].
Table 1 shows the major content domains for the postings and months the content was posted. Content included both noninteractive postings (e.g., research articles related to health research) and interactive postings/events (e.g., live interviews with researchers). Content for health topics was prioritized based on preferences suggested in our prior survey [Reference Eder, Patten and Brockman20], including mental health, health and wellness (e.g., nutrition, physical activity), chronic diseases (e.g., cardiovascular disease), and immunology/infectious diseases. The onset of COVID-19 changed some of the posting plans for MN Research Link. In response to the global pandemic and associated stay-at-home restrictions and masking mandate in Minnesota, beginning month 6 of the evaluation, content was added on COVID-19 and masking as a preventive strategy. Another topic receiving attention in the news media during the program evaluation period was the health effects of vaping/electronic cigarette use; therefore, content was created to address this topic. Our prior survey [Reference Eder, Patten and Brockman20] indicated that individuals wanted credible, accurate, and reliable health information and provision of research findings, as well as information about participating in research. For health topics, findings from research studies including research articles were included with a prioritization of research articles and studies with a connection to the Minnesota community. We also hosted live events where investigators shared information about their health research studies. These consisted of structured interviews with a question and answer session to foster bidirectional communication.
Content domains and illustrative topics of MN Research Link Facebook postings
Content was also posted on general research topics such as, “What happens when a person enrolls in a clinical trial?” (see Table 1). Additional content was designed to engage and keep people interested in the Facebook page, as recommended by survey respondents [Reference Eder, Patten and Brockman20]. These included holiday recipes, health reminders, and pets as well as live events and polls. An example of a poll was “Would you like to learn more about vaping?” with a yes or no response option.
As a way to plan and organize content [Reference Pagoto, Waring and May23], weekly social media content calendars were devised, focusing on several different topics; see Fig. 1, for example. A link post is a post that contains a direct link to other content, for example, video or research article.
The MN Research Link Facebook topic scheduling.
Facebook postings created by the research team included: (1) brief videos with an average duration of about 10–12 min, (2) text written in the English language and limited to about 120 characters [Reference Pagoto, Waring and May23], and (3) combined images with text, which has been shown to increase Facebook user engagement by 84% over text-only posts [Reference Corliss24,Reference Strekalova and Krieger25]. Where possible, the posting approach structured a claim with evidence and cue to action that was directed to laypeople. Posts also tagged the names of public health partner organizations where used, following best practice of social media post design for Facebook recommended by the CDC [22]. Facebook was used to post content that was actionable, asked users to do something within the posts, highlighted posts that encouraged CTS priorities by pinning or adding a milestone on the timeline, cross-promoted other social media channel content, and added information rather than removed comments that were not reflective of science [22]. During the 12-month period, a total of 328 posts were created, including 30 MN Research Link live events and 4 polls.
MN Research Link Facebook Recruitment
To enhance the reach of the MN Research Link statewide in Minnesota, 221 targeted Facebook advertisements or boosts were created, of which 20 targeted rural populations. The advertisements targeted residents of Minnesota statewide and aged 18 years or older. The Facebook page was also promoted using flyers and during presentations at community outreach events. University and community partners were asked to share the MN Research Link page on their organization’s Facebook page and with individuals in the community.
Feasibility Measures
Participants
We used Facebook analytics [26] to assess the number of new and total followers each month, an indicator of those who have joined the MN Research Link community [Reference Pagoto, Waring and May23]. The minimum number of social media followers recommended for adequate engagement is 200 [Reference Torossian27]. Our goal was to have 500 or more followers by the end of the 12-month period. Retention was calculated as the proportion of total followers who had not unfollowed the page by the end of the evaluation period [Reference Pagoto, Waring and May23].
To estimate the representativeness of our followers from rural areas, a random sample of 25% of our 1400 followers was generated and coded for rural/non-rural location in Minnesota, based on the US Census Bureau [28] classification. Followers were listed using a unique project ID number. Using a random number generator, 376 numbers were then created. The range 1–1400 was used for the parameters of the number generator and the 376 random numbers created corresponded to the project ID list of followers. Using the list of rural counties from the Minnesota Department of Health US census, each of the 376 IDs was classified as rural or non-rural based on the current county and/or city listed on their Facebook profile. Some individuals (n = 39) did not list location information on their Facebook profiles. Thus, 337 samples were used in calculations.
To calculate participation reach to the estimated Minnesota adult population using Facebook, we used the US Census Minnesota population estimates [29], and US Internet [Reference Anderson, Perrin, Jiang and Kumar30] and social media use [Reference Perrin and Anderson15] statistics. As of July 1, 2019, the Minnesota population estimate was 5,639,632 people, of which 76.9% (4,336,877) people were aged 18 or older. We further assumed that 90% (3,903,189) were online/Internet users, of which 73% (2,849,328) used Facebook. Participant reach was calculated as the total number of followers to our Facebook page during the 12-month period divided by the denominator of 2,849,328 potential Facebook users in Minnesota. We further calculated the total cost of advertising through Facebook ads and boosts, and the advertising cost per follower.
Content Reach (Views)
Another measure of the reach of our Facebook page was the number of views of our postings among Facebook users, whether or not they were followers to the MN Research Link [Reference Pagoto, Waring and May23]. For example, if one of our followers liked or shared a posting, it would be included in the news feed of all of their friends’ Facebook accounts, who each had an opportunity to view the posting. Number of views per month was calculated using Facebook analytics [26].
Facebook Engagement Among Followers
Standard engagement metrics [Reference Pagoto, Waring and May23] obtained from Facebook analytics [26] provided monthly, cross-sectional, de-identified, group-level data for the population of followers. The data were not provided at the level of individual followers nor were patterns of individual participant engagement represented over time. For each month, the number of follower likes, shares, comments, and clicks (defined as taking action on a posting by clicking on it to view a photo or expand to read a post, or on a post link to play a video or read a research article) was calculated. Engagement metrics were summarized independently, thus participants may have contributed to more than one metric. For example, if a participant both liked and shared a posting, these data were included in both the total likes and total shares. In addition, it is possible that participants may have clicked on several postings and/or clicked multiple times on the same video or other posting for which all were included in the monthly total for clicks. The engagement metrics were summed to create a monthly total engagement measure.
Statistical Methods
Descriptive statistics were implemented to summarize the reach and engagement with the Facebook page over a 12-month period.
Results
Participants
Figure 2 shows the number of new and total followers each quarter. At the start of the evaluation, there were no followers. During the first quarter, the page gained 99 followers. During the 12-month period, we acquired a total of 1406 followers, or about 117 per month; 4 individuals unfollowed the Facebook page. From 6 to 12 months, we increased the total number of followers by 81% (from 272 to 1402). The participation reach was estimated at 4.9% (1406/2,849,328). The total cost for Facebook ads/boosts was $1359 or less than $1 ($0.97) per follower. Representativeness of rural residents among followers was estimated at 30.8% (104 of 337 profiles randomly sampled).
Number of followers to the MN Research Link Facebook page by quarter, June 2019–June 2020.
Content Reach (Views)
Figure 3 shows the number of posting views per month among followers and non-followers. Mean number of views per month was 9379.83 (Mdn = 2791), range 724–41,510.
Number of MN Research Link posting views by Facebook users (content reach) per month.
Facebook Engagement Among Followers
Figure 4A shows the number of postings made each month and Fig. 4B displays the engagement among our followers each month. The mean number of posts per month was 27.33, standard deviation (SD) = 10.96, Mdn = 26, range 14–49. Engagement metrics indicated a mean of 535.17 (SD = 596.12, Mdn = 296.5) likes, shares, comments, and/or clicks each month, range 55–1,535. Increases in engagement occurred in months 3 and 4 toward the beginning of the evaluation period as well as in months 7 and 9, but decreases were observed in the last quarter.
(A) Postings to the MN Research Link Facebook page by month, June 2019–June 2020. (B) Engagement among followers to the MN Research Link Facebook page by month, June 2019–June 2020.
Discussion
A novel finding of our program evaluation is that Facebook is a feasible platform to engage a virtual Minnesota community on health and research topics. The number of followers to the Facebook page increased significantly (by 81%) over the 12 months of evaluation, and the total number of followers (1406) exceeded our goal of 500. Moreover, retention in this digital community was extremely high; 1402 of 1406 (99.7%). Representativeness of rural residents among our followers was estimated at 31%, which compares favorably to data indicating that 27% of the Minnesota adult population lives in rural areas [31]. Our followers engaged with the Facebook page, with an average of 535 likes, shares, comments, and/or clicks to postings per month. Our preliminary data demonstrate Facebook as a feasible channel for engaging a virtual community and provide a model for the CTSA Consortium for community outreach. Our findings are particularly timely and relevant given the current societal challenges with in-person connectivity and the increasing reliance on social media and other digital platforms due to COVID-19 [Reference Nguyen, Gruber, Fuchs, Marler, Hunsaker and Hargittai32].
The number of postings made each month generally mirrored the pattern of engagement and views (see Figs. 4A and 4B). The reasons for the large spike in engagement and views in months 3 and 4 relative to the number of postings is uncertain other than the efforts by the research team to recruit new followers. Table 1 does not suggest any unique content during this time. Decreases in postings, engagement, and views in months 5 and 6 could be explained by facilitator (staff) turnover at this time. Subsequent increases in engagement and views in months 7 and 9 could be due to new topics posted during this time on COVID-19 and ENDs/vaping (Table 1). Though engagement and views varied across months, our finding that a digital platform is feasible is encouraging given the program evaluation period coincided with the global COVID-19 pandemic. The effects of the COVID-19 pandemic on user engagement are uncertain. It is possible that the pandemic in Minnesota enhanced individual connectivity to social media or magnified individual media use overall. However, it is also possible that the “stay at home order” and fatigue over media stories of COVID-19 during this period increased individuals’ disengagement with news media as well as decreased engagement with our page in the final months of the evaluation. The last quarter of the evaluation also coincided with the Minnesota “stay at home order” enacted in response to the COVID-19 pandemic. Our followers may have needed to prioritize their attention on safety, family health, and ensuring adequate grocery and essential supplies; while some possibly dealt with changes in their work environments like working from home or reduced hours, unemployment, furloughs, and at-home schooling. Given the closure of clinical facilities and a choice to delay seeking care when available, it is also possible that people did not want to engage with content on health topics. Nevertheless, during this period the page continued to engage new followers.
Limitations
Our Facebook page was designed for and with input from Minnesota residents, so the results may not be replicable with individuals from other geographic locations. Our estimate of rurality was limited to the participants’ Facebook profile information and may have been under or overestimated. We did not assess the sociodemographic characteristics of followers. Our program evaluation was limited to a 12-month period; participation, engagement, and reach long-term need additional study. Engagement metrics were limited to cross-sectional, aggregate data among followers and were not based on individual participant-level data. While we observed high retention of followers, it is not certain if the majority of the group continued to engage with the page throughout the evaluation period.
Strengths
Based on substantial formative work, we designed an innovative digital platform to engage adults in conversations around health and research topics. The number of followers and retention was excellent, enabling us to meaningfully evaluate engagement and content reach over a 12-month period. The platform was successful in reaching both urban and rural residents of Minnesota.
Future Directions
Prior studies of online communities revealed stages of joining, maintaining presence, and disengaging [Reference Gruzd and Haythornthwaite33]. Our program evaluation assessed the first stage of joining. To enhance participation, we used Facebook ads and boosts, flyers, and community forums/outreach. The reach of our participants (followers) compared to the MN adult online population using Facebook was estimated to be 5%. Thus, strategies need to be implemented to expand the reach of followers, or those who will join the page. It is possible that with continued presence or exposure to Facebook postings among non-followers may eventually result in additional people joining MN Research Link. Because so many non-followers viewed our postings, future postings could promote our page with a call to action, for example, “Folllow Us!” with a QR code or other link to the Facebook page. Future communication and outreach efforts could use mass media and forming partnerships with organizations with larger Facebook followings (e.g., National Alliance on Mental Illness and rural Extension Offices) to promote and share our Facebook content to enhance its reach. An alternative approach is to plan more direct cross-channel promotion on other social media platforms like Twitter and Instagram as well as specific outreach to demographic groups more likely to use Facebook as well as other social networking sites. For example, young adults aged 18–24 are most likely to use Instagram compared to other age groups [Reference Auxier34]. Of interest are potential changes in social with the COVID-19 pandemic. In a US sample of 1374 adults, 35% reported an increase in the use of social media platforms for communication compared to before the COVID-19 pandemic; 56% reported the same and only 8% reported a decrease [Reference Nguyen, Gruber, Fuchs, Marler, Hunsaker and Hargittai32]. The oldest quartile of the sample was more likely to have reduced digital communications of any form and women were more likely than men to have increased communications. However, that study did not explore trends in the use of different types of social media platforms.
Future research will explore whether social media offers a scalable and sustainable engagement practice to provide credible, evidence-based health information and enhance bidirectional engagement about health and research. Future evaluations will assess implementation outcomes such as reach, adoption, and maintenance as well as cost-effectiveness. The ability to adjust criterion for group membership and focused sharing through privacy settings further expands the potential value of refining virtual communities around specific health and research topics. Moderating closed private groups would also allow us to conduct assessments of participant characteristics, health outcomes, and other factors such as community resilience and trust in research. This approach would also allow for the assessment of individual participant patterns and trajectories of engagement and retention.
Our long-term objective is to sustain a digital community of diverse voices and perspectives from across Minnesota. We have planned additional innovative and interactive methods to enhance engagement, such as holding Virtual Cafes and using Poll Everywhere. We also plan to form smaller, closed, private virtual groups to refine the Facebook content to focus on specific health topics of interest as well as cultural and linguistic identities among our followers. Smaller virtual communities can enhance engagement by fostering social support and connection [Reference Gruzd and Haythornthwaite33]. A sustainable community could engage former or current group participants to volunteer as peer facilitators and to design and contribute content. Forming partnerships with health and community organizations that could promote and contribute to the page would enhance sustainability. To reduce facilitator time needed to maintain the page, existing content could be organized as a content library [Reference Pagoto, Waring and May23] and prescheduled for automated posting. Future work could also use artificial intelligence/machine learning tools to evaluate followers’ comments to assess emerging health and research needs and interests in real time, and to tailor and automate content accordingly.
Conclusions
As the complexity of CTS continues to grow, along with social distancing measures resulting from the COVID-19 pandemic, the availability of virtual digital platforms to reach and engage community stakeholders in conversations about health and research has increasing importance. Preliminary findings from this program evaluation indicate that a Facebook community platform is feasible to engage Minnesota residents in conversations around health and research topics. Future work to evaluate its potential for reach, scale, and sustainability is warranted.
Acknowledgments
This project was supported by grant numbers UL1 TR002377 (Mayo Clinic CTSA) (CAP, JEB, TAB, MVS, IWW, MGZR), UL1 TR002494 (UMN CTSI) (ELC, JC, ME), and UL1 TR002494-S1 (UMN CTSI) (CAP, JEB, ELL, TAB, MVS, IWW, JC, MGZR, ME), from the National Center for Advancing Translational Sciences. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the National Institutes of Health.
We wish to thank Ida Darmawan BS Pharm, MBA, MA (University of Minnesota), and Martha Bock, Christine Hughes, and Lee Aase from Mayo Clinic for their contributions to this project. We thank Kimberly Kinnoin for manuscript assistance.
Disclosures
The authors have no conflicts of interest to disclose.
Open access
