Introduction
Hispanics/Latinos (referred to as Latino hereafter) constitute the largest ethnic minority in the United States, representing 18% of the nation’s total population or about 58 million people as of 2016 [1]. However, like some minority groups in the United States, including African Americans, Latinos experience numerous health disparities when compared with non-Latino whites. For example, compared with non-Latino whites, Latinos have higher incidence and prevalence of and/or higher mortality from obesity, cardiovascular disease, cancer, diabetes, human immunodeficiency virus (HIV) infection, sexually transmitted infections, chronic liver disease and cirrhosis, and hypertension and hypertensive renal disease. They also have decreased access to healthcare resources compared to non-Latino whites [Reference Dominguez2–Reference Ceballos5]. The National Institutes of Health requires the representation of minority racial/ethnic populations in sponsored human subject research to determine whether the intervention or therapy being studied affects members of minority populations and their subpopulations differently in order to reduce and not perpetuate health disparities [6]. Yet, to date, Latinos remain significantly underrepresented as participants in biomedical research [Reference Ceballos5].
Although adequate representation of Latinos has been expected within large clinical trials on, their numbers have been disappointingly small. For example, the small percentages of Latinos in the Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial (ALLHAT) [7], Systolic Pressure Intervention Trial (SPRINT) [Reference Wright8], and Action to Control Cardiovascular Risk in Diabetes (ACCORD) [Reference Cushman9] have prevented a complete understanding of disease progression and treatment among Latinos and subgroups. Thus, there is a profound need to improve Latino engagement in research to ensure that research improves rather than perpetuates health disparities [Reference Fisher and Kalbaugh10].
There are multiple factors that contribute to the underrepresentation of Latinos in biomedical research; among them are mistrust or concerns about being treated as “guinea pigs”; misconceptions about eligibility; fears of detention and deportation for those who lack proper immigration documentation; assumed connections between researchers and immigration officials among those who may be undocumented; stigma and discrimination related to being Latino, an immigrant, and/or a sexual and/or gender minority; concerns about confidentiality and privacy; and language barriers including limited bilingual and bicultural research staff and study materials [Reference George, Duran and Norris11–Reference Fischer13].
Over the past 15 years, our community-based participatory (CBPR) research partnership in North Carolina has been developing and implementing strategies to overcome these barriers to engage Spanish-speaking Latinos in cross-sectional observational and longitudinal studies designed to explore and improve the health of this growing and vulnerable population. Given our successes, we sought to identify and describe the strategies we have used to recruit and retain Spanish-speaking Latinos, including subpopulations such as Latino men who have sex with men (MSM) and Latina transgender women who are often considered difficult for researchers to reach.
Methods
Our partnership uses CBPR, which is based on the underlying principle that “outside” researchers, such as academic and government scientists, have limited understanding of the lived experiences of community members and cannot fully appreciate how social, cultural, political, and economic contexts affect members within a specific community. They may lack insights on what communities expect and how communities “get things done.” Thus, CBPR brings together diverse partners to engage in ongoing multidirectional dialog to improve each phase of the research process, including the identification of research needs and priorities; hypothesis generation; study design formulation; participant engagement; data collection, analysis, and interpretation; and dissemination of findings [Reference Minkler and Wallerstein14–Reference Rhodes16]. Long-term partnerships between Latino community members; representatives from community organizations, such as health departments, recreational Latino soccer leagues, and lesbian, gay, bisexual, and transgender (LGBT)-serving organizations; Latino and non-Latino business leaders and employees; and scientists from academic and government institutions have been critical to developing successful recruitment and retention strategies in our studies.
To date, our CBPR partnership has successfully recruited a total of 2083 Spanish-speaking Latino men and Latina women, including transgender women, to participate in 21 completed research studies. In each study, we met planned recruitment and retention benchmarks. Table 1 highlights each study, the number of participants enrolled, select demographics, the recruitment rate, and the follow-up period and retention rate, as applicable. Recruitment rates across observational studies ranged from 83% to 100%. Recruitment rates across longitudinal studies ranged from 90% to 100%.
Details of Latino men and Latina women and transgender women involvement by project
* Among those screened eligible.
AIDS, acquired immune deficiency syndrome; CBPR, community-based participatory research; CDC, Centers for Disease Control and Prevention; HIV, human immunodeficiency virus; MSM, men who have sex with men; NA, not applicable (e.g., as in not a longitudinal study); NC, North Carolina; STD, sexually transmitted disease; UK, unknown because denominator was unknown (e.g., as in a web-based study).
Retention rates varied by study and follow-up period. For example, the evaluation study of the HoMBReS-2 intervention retained 98% of Latino men (n=142) at 3-month follow-up [Reference Rhodes17]. The evaluation study of the HOLA en Grupos intervention retained 100% of Latino MSM and Latina transgender women participants (n=304) at 6-month follow-up [Reference Rhodes18]. The evaluation study of the HOLA intervention retained 95% of Latino MSM and Latina transgender women participants (n=189) at 12-month follow-up [Reference Rhodes19, Reference Rhodes20].
To identify successful strategies for recruitment and retention, an ad hoc subcommittee of the CBPR partnership abstracted and analyzed data from archived study notes, progress reports, team meeting minutes, and in-depth interview data collected annually from CBPR partnership members [Reference Rhodes21]. The subcommittee then grouped identified strategies into recruitment or retention strategies and combined strategies as appropriate. They developed a list of preliminary strategies and conducted an adapted nominal group process, a structured variation of a small-group discussion to reach consensus [Reference Delbecq, Van De Ven and Gustafson22], with the entire partnership to refine, prioritize, and interpret recruitment and retention strategies.
Results
A total, 13 recruitment strategies and 12 retention strategies emerged (Tables 2 and 3).
Strategies to increase recruitment of Latino men and Latina women and transgender women in research
Strategies to increase retention of Latino men and Latina women and transgender women in research
Recruitment Strategies
1. Recruiters were members of the study community and highlighted their similarities to potential participants. Community members who were similar to the study community based on numerous characteristics and identities, including age, culture, language, gender identity, and sexual orientation, recruited participants. Similarities between recruiters and potential participants helped recruiters connect with potential participants; however, recruiters who reflected the population being recruited only in terms of race/ethnicity were not as successful as recruiters who also shared other characteristics and identities with the target community. For example, Latino gay men were more successful than well-intentioned and well-trained Latino heterosexual men in recruiting Latino MSM. Furthermore, having similar immigration experiences or being able to relate to immigration experiences also facilitated mutual understanding of concerns and priorities that could build connectedness between recruiters and participants and reduce recruitment barriers.
Identifying recruiters was not easy. They often were identified by word-of-mouth. In many cases, recruiters worked in factories or community organizations and did not have a biomedical or research background prior to becoming a recruiter. They did not have high educational attainment, but they cared about and were connected to the community, were passionate about the research topic, and were interested in learning about research.
2. Community connections were nurtured to build trust. Recruiters, other study team members, including the principal investigator (PI), and other members of the CBPR partnership established a presence in the community before attempting to recruit participants. They met with community organizations that offered services to Latinos to introduce themselves. They did not assume that representatives at community organizations were as interested in the research as they were; rather, they asked questions about the experiences of and challenges faced by organizations in serving Latino populations. They prioritized what the organization representatives prioritized, described the study in ways that would resonate with these representatives, discussed ways to work together, and brainstormed strategies to recruit participants.
Recruiters, other study team members, and other members of the CBPR partnership also supported the work of these organizations and agencies by facilitating trainings, such as conducting resume writing trainings for clients and volunteering in organization-sponsored events (health fairs and fundraisers, as examples). This service illustrated their commitment to the organizations and to the community. Furthermore, to nurture and maintain established trust, our partnership has shared outcomes of studies with communities by conducting empowerment theory-based community forums. These forums bring together community members, organization representatives, and other stakeholders to learn about the progress and outcomes of a study and develop next steps. After reviewing findings, the group responds to 4 empowerment-based trigger questions that move from concrete (“What do you see in these findings?” and “In what ways do these findings make/not make sense to you?”) to validate and/or refine results and interpretations to more action-oriented and next steps (“What can be done?” and “What can we do?”) [Reference Mann23]. The objectives of the forums are to share study findings with community members and partners and be inclusive of community perspectives and priorities.
3. Materials that demonstrated university and organization affiliations legitimized studies. Although it is well established that study logos are critical for branding [Reference Taylor24], recruiters also carried university badges and business cards and wore shirts and jackets with university and organization logos when they were in the community. Recognizable logos of trusted partners, including university partners, built trust and overcame wariness of potential participants.
4. Social networks and social media were harnessed. Potential participants were more receptive to a study if participation was recommended by someone they knew who had participated in the study previously, and word-of-mouth was particularly successful if the person recommending the study was respected within the community. Also, potential participants were identified and recruited through advertising the study via social media including Facebook. For studies that recruited MSM and transgender persons, Global Positioning System (GPS)-based mobile applications (“apps”) that some use for sexual and social networking (e.g., A4A/Radar, badoo, Grindr, Growlr, Jack’d, and SCRUFF) were also particularly successful in reaching potential participants with information and answering initial queries about the study.
5. Study uniqueness was emphasized. Recruiters stressed that the study was specifically designed and developed in Spanish for the population for which they were recruiting by professionals who shared their characteristics (e.g., Latino, gay, and/or immigrant). For example, when recruiting for the HOLA en Grupos HIV prevention intervention for Latino MSM and Latina transgender women [Reference Rhodes18], recruiters mentioned to potential participants that no other HIV prevention intervention like it existed for these populations.
6. Potential participants were not pressured to enroll. Although recruiters wanted to engage potential participants in dialog to motivate their interest in a study, they did not focus exclusively on the study and their recruitment numbers. Instead, they focused on the potential participant and communicated in ways and at the pace that each potential participant seemed comfortable. Recruiters were also familiar with local resources and made referrals if they became aware of participants’ needs other than those addressed by the study (e.g., support related to immigration issues, mental health, or homelessness). This respectfulness and awareness of participants’ competing needs and priorities further helped to build trust and readied potential participants to hear about the study and how it might help them or their communities.
7. “Good will” and a sense of commitment to community were tapped into. Recruiters raised awareness of the health issue being studied and emphasized the importance of each study. For example, recruiters explained to potential participants that their participation would help their communities and they would be “game changers” and “pioneers.” Recruiters shared that findings from studies could lead to further research and future programming that might benefit their communities as well as potentially helping Latino communities in other parts of the United States and in Latin America.
8. Recruitment materials were concise, tailored, and engaging. Study-specific materials used were developed by members of the community for which they were intended for use. Materials included visually stimulating posters and brochures that very briefly described the study and featured pictures of the study team, previous participants (who provided media-use consent), and the incentives provided for participating in the study. These materials were displayed and distributed at recruitment locations, such as at soccer team meetings, soccer fields during practice and games, clubs and bars, house parties, community events (e.g., gay pride festivals and Latino cultural festivals), Latino community-oriented businesses [e.g., tiendas (grocers), hair salons, barbershops, radio stations, and restaurants], and in apartment complexes where large numbers of Latinos lived.
9. Teasers and samples of incentives were provided. Sample materials from studies were used as teasers to pique the interest of potential participants. Recruiters gave out rubber bracelets that included the study logo and telephone number and showed potential participants examples of incentives, including T-shirts and caps with the logo and a framed certificate of completion with staff and PI signatures. In addition, recruiters emphasized that participating in a study could provide the opportunity to make new friends or meet others with similar experiences to their own, if the study included a group activity (as in the case of data collection through focus groups [Reference Rhodes25] or photovoice [Reference Rhodes26] or participation in an intervention [Reference Rhodes18]).
10. Adapting to potential participants’ changing schedules and offering assistance to overcome challenges were critical. Recruiters accommodated potential participants’ changes of plans in terms of timing and location for in-person screening and/or enrollment. Recruiters were also trained to assist the potential participants overcome obstacles, such as a lack of transportation, that prevented them from screening and/or enrollment [Reference Rhodes, Yee and Hergenrather27]. Transportation is a challenge in states, like NC, that do not provide driver’s licenses to those who are undocumented [Reference Gill28] and at the same time have less developed public transportation infrastructures. Furthermore, recruiters did not assume a 9 am to 5 pm work schedule. They met potential participants where and when potential participants were available, including on weekends and late night.
11. Cash compensation was provided for participation. After consenting to participate in a study, participants were reimbursed with cash for their effort, transportation costs, and time. We have learned from participant feedback that cash is a preferable because it is perceived as more immediate and does not present real or perceived challenges for use compared with other formats such as gift cards or credit cards.
12. Participants were identified, enrolled, and consented in the field at times of day and in locations that were convenient for them. Rather than asking potential participants to come to study project offices, either at community organization and university offices, to discuss participation and complete enrollment and data collection, we met with potential participants in the field and completed enrollment and data collection at the same time whenever possible. Potential participants chose a variety of places (e.g., parking lots, fast food restaurants, Latino-owned stores, soccer fields, outside of parties and clubs/bars, and in or outside their homes). Recruiters also used their own cars as quiet and convenient locations for enrollment and data collection.
13. Flexible, persistent, and simultaneous use of multiple strategies was critical. We did not assume that one strategy would work to recruit all potential participants, and our partnership met frequently throughout the entire recruitment phase of each study to brainstorm new recruitment strategies, analyze successes and challenges of strategies, and tailor strategies to potential participant priorities. Recruiters were perseverant and creative and implemented multiple different strategies simultaneously.
Retention Strategies
1. The most convenient day, time, and location were used for study activities. Study activities, including data collection and intervention sessions, were scheduled on the day of the week and at the time of day that participants were available. The locations of study activities were also selected to ensure ease in accessing each location (e.g., proximity to major highways, easily recognizable landmarks, and availability and ease of parking).
The study team also collected follow-up data in a variety of settings, such as before participants met their friends at clubs, before or after soccer team practice or matches, at parties and social gatherings (including outside a baby shower that was being held for an MSM participant and his female partner), and at workplaces, as examples. It was not unusual for members of the study team to collect follow-up data from participants when participants got off shift work as late as 2:30 am.
2. Venues in which study activities occurred were familiar and comfortable. We did not ask participants to come to our universities or to the offices of community organization partners for study activities. Rather, we used spaces that were most familiar to or comfortable for participants. Group activities, for example, were held in hotel conference rooms or in private rooms in Latino-owned restaurants, which offered privacy, a sense of security, and a feeling of community, and where we knew the staff were friendly to sexual and gender identity minorities, when relevant.
3. Multiple names/nicknames used by an extensive contact information of participants were collected. Many participants in our studies use multiple names, nicknames, or aliases. To keep track of all participants, we created excel sheets or REDCap electronic data capture tools for each study with all names or aliases used by participants and various ways to contact them, including names and aliases used on social media, such as Facebook and GPS-based mobile apps, and the contact information of close friends and family members who could help locate the participants in the future. Social media, particularly Facebook, was effective for staying in touch with participants, especially gay, bisexual, and other MSM and transgender women participants [Reference Rhodes18].
4. The study team played “host” at study activities to make each participant feel special. Participants were made to feel comfortable from the moment they arrived to a study activity, whether data collection or intervention implementation. They were welcomed and thanked for taking time to participate. Often, some participants arrived earlier than others, and while waiting for a group activity to begin, the study team offered them snacks in addition to making “small talk.” The study team also played music or YouTube videos of songs by popular Latino singers and videos from popular Latino TV shows while waiting for others to arrive.
The study team also paid attention to each participant during group activities. They were careful to welcome and say goodbye to each participant, use their first names, and help engage those who were not engaged in conversations with other participants. Helping participants connect with other participants and build a sense of community were also critical.
5. Cash compensation was provided for participation. Cash compensation was provided to participants for their time. Again, our study team has learned that cash is a preferable form of compensation as described within recruitment strategies above.
6. Culturally congruent snacks, candy, and meals were provided during study activities, and holidays and birthdays were celebrated when they coincided with study activities. The study team created a friendly and celebratory atmosphere to make study activities enjoyable and participants feel special. Providing culturally congruent snacks, such as candy from Latino tiendas and restaurant-catered meals that many participants recognized from their countries of origin, helped to create a sense of connection between the study team and participants. Also, when holidays or participant or study team birthdays coincided with study activities, the study team brought decorations and food that corresponded to that particular celebration.
7. Teasers were used to entice participants to return for subsequent study activities. At the end of each study activity, and before participants departed, study staff gave a brief description of the next study activity. For example, to create interest and anticipation, intervention participants were provided brief previews of activities (e.g., DVD vignettes) that were part of the next session [Reference Rhodes17, Reference Rhodes18, Reference Rhodes20]. Participants were also reminded of the incentives they would be receiving and the process was designed to be interactive. For example, if the next session included the provision of t-shirts, participants were asked not only their preferred size but also color. If the next session included the distribution of graduation certificates, participants were asked what name they wanted printed on their certificate.
8. Participants were thanked for their participation and reminded of subsequent study activities via their preferred social media and telephone calls. Participants received personalized messages of appreciation the day after a study activity and friendly and encouraging reminders for subsequent activities, as relevant. Furthermore, if the subsequent study activity included incentives, the study team confirmed choices (e.g., preferred t-shirt size and color and name for graduation certificate) between study activities to ensure contact information remained current, remind participants of upcoming activities, and increase anticipation among participations.
9. Obstacles to complete study activities were identified and overcome. A number of challenges made it difficult for participants to complete study activities. For example, many participants had multiple jobs and some employers required participants to justify absences from work. Thus, for participants who wanted written documentation of their participation in a study, we wrote letters on university letterhead that the participants presented to their employer to request to be excused from work or to change their shift in order to attend and complete study activities. The letters stated that the participant was involved in a community project but did not specify the health outcome or population that the study focused on. Employers appreciated these letters and excused absences or altered the participant’s work schedule.
Some participants did not have driver’s licenses or access to a car, and all lived in areas where public transportation was limited. The study team also provided or coordinated transportation to study activities as needed. The time spent during car rides was an additional opportunity for participants to bond with each other and the study team member (if driving) and further build trust. These relationships promoted retention as well.
We also found that some participants moved out of the state or out of the country before they had completed study activities (e.g., follow-up data collection). In these cases, we completed data collection over the phone and sent compensation by money transfer services such as Western Union.
10. “Good will” and a sense of commitment to community were tapped into. The study team frequently reminded participants of the important role they were playing to potentially effect change not only in their local communities but also in other Latino communities, and stressed that retention was a contributing factor to study success.
11. Framed graduation certificates were provided to participants at the end of their participation. For most participants, receiving a graduation certificate was meaningful and served as an incentive to encourage retention. Participants were informed in advance and reminded frequently that they would receive a certificate at the end of their participation in a study. Many participants in our studies were recent immigrants and had not had the opportunity to complete school or receive other recognition; the certificates were highly valued. In group study activities, the distribution of these certificates became an event with some participants bringing and wearing a cap and gown to receive their certificate at “graduation” from the study.
12. Flexible, persistent, and simultaneous use of multiple strategies was critical. As we found with recruitment, we did not assume that any one strategy would work to retain all participants. Our partnership met frequently to brainstorm retention strategies, analyze retention successes and challenges, and tailor strategies to participant priorities. Study team members were perseverant and creative and implemented multiple different retention strategies simultaneously.
Discussion
Although there is growing recognition of the need to engage Latinos, including those who are primarily Spanish-speaking, in biomedical research, the development of Spanish-language materials alone is insufficient to ensure the recruitment and retention of this growing population. The barriers to the participation of Latino participation in biomedical research are profound, and some barriers may be intensifying due to the current political context and ongoing anti-immigration sentiment at both state and federal levels [Reference Philbin29, Reference Martinez30]. However, our CBPR partnership has found that barriers are not insurmountable. Based on our successes across 21 studies, we have identified 25 strategies that we have used to recruit and retain Latinos in research.
These strategies include building and nurturing trusting relationships with community organizations and potential (for recruitment) and current participants (for retention); focusing on each potential and current participant and respecting their priorities and needs; using culturally congruent materials and strategies that resonate with potential and current participants; and conducting screening, enrollment, and as much of the study activities as possible in the field, within the community, and in locations that are familiar, safe, and comfortable. Successful recruitment and retention also relied on the creativity of study team members and partners to determine what messages and strategies resonated with community members.
While we found that the use of university and organization affiliations and logos legitimized studies, that is not always the case within some communities [31, Reference Leshner32]. The affiliation of a trusted community-based, nonacademic partner organization may increase trust, at least initially, within communities where members have felt like they have been exploited by research. Study team members can also build trust by being present at community events. Cosponsoring community events such as street fairs, community festivals, church gatherings, and local forums; staffing a booth or table at events; serving on local boards; and conducting educational outreach aimed to reach community audiences are examples of strategies that can be used by study team members from universities to increase community trust. Participation in other nonresearch activities, such as volunteering with community organizations or serving on local health coalitions, by study team members further advances community trust.
Study team members also were flexible; they were ready to collect data at any time, including on weekends and late at night. They were committed to the research. All members of study teams, including recruiters, data collectors, and other study staff, understood the research questions that the study they were working on was designed to answer, and they understood that in order to answer these questions certain numbers of participants were required. In the case of longitudinal studies, they also understood that certain numbers of participants needed to be followed over time; they understood concepts of rigor, power, sampling, and bias, and how these related to the study they were working on.
Successful recruitment and retention also relied on infrastructures that supported novel strategies. For example, dialog with our study team and the Institutional Review Board of record was required at times when we wanted to use locally developed, innovative recruitment and retention strategies, including the use of social media, such as Facebook and GPS-based mobile apps, to communicate with participants; the provision of letters to employers regarding work absences of participants; and posters and brochures that featured pictures of the study team, previous participants, and the incentives provided in the study. Our university Controller’s Office also helped to establish accounting systems to track cash compensation in the field.
It is important to note that Latinos living in the United States represent a diversity of nationalities, cultures, and traditions. About three-quarters of Latinos are of Mexican, Puerto Rican, or Cuban origin. There are also sizable populations of Dominicans, Guatemalans, and Salvadorians. The health of these subpopulations differ depending on their country of origin. Increasing Latino engagement in biomedical research will generate better understandings of subpopulation differences. Moreover, there are Latinos who blend Spanish and English in their communications, and thus, recruitment and retention materials that include both Spanish and English may appeal. For example, a project in Philadelphia designed to test an HIV prevention intervention for Latino same-sex couples changed its name from “Conectando Latinos en Pareja” to “Connecting Latinos en Pareja” based on community member guidance [Reference Martinez33]; the blending of Spanish and English held meaning for the community being recruited and retained.
It is essential that study teams continue to develop and disseminate effective strategies that can successfully engage Latinos in biomedical research to improve our ability to reduce health disparities and promote health equity. We outlined strategies found to be successful but fundamental to our success was ongoing participation of our CBPR partnership and iterative discussion about what worked, what did not work, and what should be tried to ensure high recruitment and retention rates.
Disclosures
The authors have no conflicts of interest to declare.
Open access
