Young adults (aged 17–35 years) commonly develop poor lifestyle behaviours that track into later adulthood and increase the risk of chronic disease across the life course(Reference Liu, Daviglus and Loria1,Reference Zheng, Manson and Yuan2) . Rates of overweight and obesity have increased from 38 % to 46 % among those aged 18–24 years in the time periods from 2011–2012 to 2017–2018 in Australia(3,4) , while this has increased from 42 % to 60 % in 20–34-year-olds from 1994 to 2015 in the USA(5). The increase in overweight and obesity rates coincides with worsening dietary patterns and physical inactivity during this life stage. A systematic evaluation of dietary patterns in adults from 187 countries found that the unhealthiest dietary scores were in 20–29-year-olds compared with all other age ranges(Reference Imamura, Micha and Khatibzadeh6). Furthermore, a meta-analysis of physical activity change from adolescence to young adulthood demonstrated a 13–17 % (or 5·2–7·4 min/d) decline in moderate–vigorous physical activity from age 13 to 30 years(Reference Corder, Winpenny and Love7). Therefore, this represents a critical stage to establish healthy lifestyle behaviours.
Several reviews have provided insights into effective intervention approaches for improving health behaviour among young adults(Reference Ashton, Sharkey and Whatnall8–Reference Poobalan, Aucott and Precious14); however, a more focused enquiry on recruitment and retention strategies is required. Recruitment refers to the process of selection of participants, from becoming aware of the health programme to enrolment of participants(Reference Gul and Ali15), while retention refers to keeping participants enrolled for the duration of the health programme(Reference Gul and Ali15). Effective recruitment and retention of young adults in health behaviour programmes are critical, yet present ongoing challenges. Both recruitment and retention may be impacted by transient living arrangements which are common during this life stage, while competing time demands may be prioritised over participation (e.g. study, work, socialising, relationships, family obligations and/or parenthood)(Reference Moe, Lytle and Nanney16,Reference Ashton, Hutchesson and Rollo17) . Furthermore, the perceptions around the imminence of health problems for someone in their life stage may affect overall recruitment of young adults to a health programme(Reference Ashton, Hutchesson and Rollo17,Reference Poobalan and Aucott18) .
Issues with recruitment or retention can have serious consequences for any research study. Failure to recruit the desired sample size can lead to underpowered studies, leading to a type II error (false-negative findings), while under recruiting can impact representativeness of population samples and therefore the external validity of results(Reference Bower, Brueton and Gamble19). Furthermore, prolonged recruitment can affect overall research expenditure(Reference Torgerson, Arlinger and Kappi20) and adversely affect the commitment of those already enrolled in the study(Reference Gul and Ali21). Failure to retain sufficient numbers may implicate the study power by affecting the composition between treatment and control groups(Reference Gul and Ali21). In addition, differential dropout may occur, whereby particular sub-groups of individuals may be more likely to dropout than others(Reference Gul and Ali21). These issues pose a threat to a study’s internal and external validity(Reference Bower, Brueton and Gamble19). Consequently, successful and timely recruitment and retention of participants are vital to the success of the overall health programme.
There is a lack of evidence to guide successful recruitment and retention strategies for young adults in health behaviour change interventions(Reference Tate, LaRose and Griffin22,Reference Crane, LaRose and Espeland23) . The few studies that have explored this have documented serious challenges. For instance, a systematic review of weight gain prevention interventions in young adults identified recruitment rates to be low (between 7·5 % and 48 % of their intended targeted population)(Reference Lam, Partridge and Allman-Farinelli24), while another review of health behaviour interventions in young adult men(Reference Ashton, Morgan and Hutchesson25) identified only 30 % of studies had achieved appropriate retention in line with the CONSORT requirements (≥80 % retained for ≤6-month follow-up or ≥70 % for >6-month follow-up) to prevent bias. Neither review looked at recruitment or retention rates by the various strategies used, while both confirmed that insufficient reporting limited the ability to determine which strategies were most successful.
Furthermore, these reviews searched for studies up until 2015(Reference Lam, Partridge and Allman-Farinelli24) and 2014(Reference Ashton, Morgan and Hutchesson25). However, health behaviour interventions among young adults have increased significantly in recent years, with the number of published interventions doubling between 2015 and 2019 for studies targeting adiposity (n 26)(Reference Ashton, Sharkey and Whatnall8) and between 2014 and 2018 for studies aiming to improve dietary intake among young adults (n 29)(Reference Ashton, Sharkey and Whatnall9). This presents an opportunity to conduct a more focused enquiry into recruitment and retention strategies among this group.
To inform strategies to reach and retain young adults for effective implementation of interventions, evidence-based guidance is needed. Therefore, the current review aims to describe the strategies used to recruit and retain young adults in interventions targeting nutrition, physical activity or overweight/obesity in young adults (aged 17–35 years), and the success and efficiency of these strategies. The following research questions are answered in this review:
1. What are the most common recruitment strategies for young adults?
2. What are the most successful recruitment strategies for young adults?
3. Is recruitment success affected by number of strategies used?
4. What are the most efficient recruitment strategies for young adults?
5. What are the costs per participant recruited?
6. What are the most common retention strategies for young adults?
7. Do studies adequately retain young adults?
8. What are the most successful retention strategies for young adults?
9. What are the costs per participant retained?
10. What reporting is needed to assess the success of recruitment strategies?
11. What reporting is needed to assess the success of retention strategies?
Methods
This is a secondary analysis of included studies in a systematic review exploring the effectiveness of nutrition, physical activity or overweight/obesity interventions in young adults. The review protocol was registered with PROSPERO (CRD42017075795), and the methods are consistent with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Results for the effectiveness of interventions have been published previously(Reference Ashton, Sharkey and Whatnall8,Reference Ashton, Sharkey and Whatnall9,Reference Sharkey, Whatnall and Hutchesson26) . The current paper presents results for recruitment and retention data.
The eligibility criteria, literature search, study selection and risk of bias of individual studies in the systematic review have been previously described in detail(Reference Ashton, Sharkey and Whatnall8,Reference Ashton, Sharkey and Whatnall9) . Table 1 outlines the full eligibility criteria. In brief, included studies were randomised controlled trials (RCT) of behavioural interventions with the primary objective of improving nutrition or physical activity, or treating or preventing obesity. Participants were required to be healthy young adults (aged 17–35 years), and any comparator or control was considered for inclusion. The definition of young adults used in studies varies based on human development and sociological perspectives. For the current review, a broad age range was included to ensure a range of studies in healthy young adults across the age range of 17–35 years. Both the National Institute of Health(27) and the European commission of Men’s health(Reference White, De Sousa and De Visser28) have used 18–35 years to define young adults. The inclusion criteria for participants were shaped around this definition, and the rationale for including those aged 17 years was due to some countries enrolling those aged 17 years in tertiary education(29,30) . Articles were located by searching six databases (Medline, Embase, PsycINFO, Science Citation Index, Cinahl and Cochrane Library) for articles published in English from date of inception to 6 December 2019 (see online supplementary material, Supplementary Table 1), as well as searching reference lists of retrieved papers and key systematic reviews. In addition, citation searches of the final included papers were conducted in Scopus. Papers linked to relevant RCT, including published study protocol, recruitment or process evaluation papers, or those publishing outcomes at differing follow-up time points, were also considered. Two independent reviewers screened the title, abstract and keywords of articles, followed by assessment of full-text articles that appeared to meet the inclusion criteria and then selected studies for inclusion. A third reviewer was consulted if disagreement existed between the two reviewers. Reasons for exclusion were recorded for ineligible papers.
Eligibility criteria for participants, interventions, comparisons, outcomes and study design (PICOS)
Data extraction
Data relating to recruitment strategies (i.e. setting, method and duration), recruitment rates (i.e. number: invited, expressed interest/screened for eligibility, eligible, enrolled/randomised and commenced intervention), study characteristics (i.e. year of publication, country, intervention details and sample characteristics), retention strategies (i.e. any strategy used to keep participants enrolled for the study duration)(Reference Gul and Ali15), retention rates (i.e. number completing post-intervention and longest follow-up assessment) and cost of recruitment and retention strategies (total cost, cost per participant randomised and/or retained and breakdown of costs by each strategy) were extracted by one reviewer and checked by a second reviewer.
Synthesis of results and analytic strategy
Results are presented narratively to address all research questions. To evaluate the success of recruitment and retention strategies, the following metrics were used:
-
Recruitment rate (%) = total number of individuals randomised/total number who showed interest in the study
-
Participation rate (%) = total number of eligible participants randomised/total number eligible at baseline
-
Retention rate (%) = total number of participants who completed follow-up/total number who entered the study
Recruitment was considered successful if the pre-determined goal sample size was met(Reference Carroll, Yancey and Spring31). Recruitment efficiency was calculated as the number of participants randomised/recruitment duration in days. Retention was considered adequate if retention was ≥80 % for ≤6-month follow-up or ≥70 % for >6-month follow-up, as defined in several previous systematic reviews(Reference Ashton, Morgan and Hutchesson25,Reference van Sluijs, McMinn and Griffin32–Reference Young, Morgan and Plotnikoff34) . Retention efficiency could not be calculated due to insufficient reporting of duration for follow-up data collection. The success of individual recruitment and retention strategies was calculated the same way, that is the number of studies which used a given strategy and had successful recruitment or retention divided by the number of studies which used that strategy. Efficiency of individual recruitment strategies was calculated as the mean and standard deviation across studies which used each strategy. Differences in recruitment and retention characteristics by intervention focus were assessed using Fisher’s exact test for categorical variables and ANOVA for continuous variables. An overall test of significance was carried out using a contingency table between numbers of recruitment strategies using Monte–Carlo exact χ 2 test (SPSS version 25). Costs relating to recruitment and retention strategies were reported in USD. To standardise, studies reporting cost information in a currency other than USD (n 10 studies) were converted to USD using xe.com (https://www.xe.com/currencytables/) from the year and month that the study was conducted. Cost per participant randomised and cost per participant retained at post-intervention and at longest follow-up were then calculated. Finally, any gaps in reporting of recruitment and retention information were collated, and a summary was provided for key information required when reporting recruitment and retention in trials.
Results
Description of included studies
A total of 21 582 manuscripts were identified and screened, and of these, 107 individual RCT were included(Reference Allman-Farinelli, Partridge and McGeechan35–Reference Zhang and Cooke140) (Fig. 1). A summary of study characteristics is included in Table 2, with detailed characteristics presented in Supplemental Table 2. Fifty percentage of studies were published since 2015 (n 53), and around half were conducted in the USA (n 58, 54 %) and recruited participants from a University/College setting (n 84 studies, 79 %). There was a mean of 276 participants per study, and participants were mainly aged 17–25 years (n 60 studies, 56 %) and were of white/Caucasian ethnicity (n 62 studies, 58 %). Intervention focus was most commonly physical activity (n 31, 29 %) followed by nutrition (n 28, 26 %). The most common mode of intervention delivery was eHealth (e.g. email, mobile phone applications, websites and social media) (n 61 intervention arms, 35 %). The mean duration of interventions was 15·5 weeks, ranging from single session interventions to 3 years duration.
Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram of included studies
Summary of study characteristics in 107 studies of nutrition, physical activity and obesity interventions in young adults
* Reported by active intervention arms (n 173).
Recruitment
All recruitment details are summarised by intervention focus in Table 3. Responses to recruitment research questions are provided below.
Summary of recruitment details of 107 studies of nutrition, physical activity and obesity interventions in young adults, by intervention focus
Results in bold were statistically significantly different between groups of studies with different intervention focus (P < 0·05).
* n 48 studies (14 physical activity, 9 nutrition, 9 weight gain prevention, 8 weight loss, 8 nutrition and physical activity).
† n 21 studies (7 physical activity, 8 nutrition, 1 weight loss, 5 nutrition and physical activity).
‡ n 78 studies (20 physical activity, 18 nutrition, 14 weight gain prevention, 14 weight loss, 12 nutrition and physical activity).
§ n 96 studies (26 physical activity, 26 nutrition, 14 weight gain prevention, 16 weight loss, 14 nutrition and physical activity).
|| Results available for only one weight loss study and are not reported.
Research question #1: What are the most common recruitment strategies for young adults?
The most common recruitment strategies were flyers (n 40, 37 %) and using an existing cohort or participant database (n 29, 27 %). Recruitment strategies are summarised in Table 4.
Summary of recruitment strategies of 107 studies of nutrition, physical activity and obesity interventions in young adults
* n 1 study did not report the recruitment setting; therefore, the total includes all 107 studies, but the breakdown by recruitment setting includes 106 studies.
Research question #2: What are the most successful recruitment strategies for young adults?
The mean participation rate (% eligible who were randomised) could be calculated for ninety-six studies. The overall mean was 83 %. The mean recruitment rate (% interested who were randomised) was calculated for seventy-eight studies, with an overall mean of 55 %. The median recruitment rate (participants recruited per day) in the forty-eight studies which reported it was 1·9 participants per day.
Forty-six studies reported a power estimation (43 %), and seven pilot studies reported a goal sample size (7 %). Of these, forty-one studies (77 %) reported that participant recruitment reached the pre-determined sample size. Success of individual recruitment strategies was determined for forty-nine studies. To provide a meaningful representation of success, only recruitment strategies that were reported in at least three studies were considered, this included thirteen strategies. The top four strategies with the highest success rates were face-to-face (e.g. university/college fairs at start of semester open days) (n 13, 100 %), email (n 14, 88 %), newspaper advertisements (n 7, 88 %) and online advertisements (e.g. Google ads) (n 7, 88 %) (Fig. 2).
Success* of recruitment strategies used across forty-nine studies of nutrition, physical activity and/or obesity interventions in young adults. *Recruitment was considered successful if the pre-determined goal sample size was met
Research question #3: Is recruitment success affected by number of strategies used?
The median number of recruitment strategies used across the forty-nine studies was 2 (range 1–9 strategies per study). Figure 3 presents the percentage ratio of recruitment success by number of recruitment strategies, highlighting that no relationship exists based on whether fewer or more strategies are utilised. The overall test of significance using a contingency table indicates that there was no significant relationship (Monte–Carlo exact χ 2 test, χ 2(7) = 4·8, P = 0·73).
Recruitment success* (%) by number of recruitment strategies used. *Recruitment was considered successful if the pre-determined goal sample size was met
Research question #4: What are the most efficient recruitment strategies for young adults?
Efficiency of individual recruitment strategies was determined for forty-eight studies. As with recruitment success, to provide a meaningful representation of efficiency, only recruitment strategies that were reported in at least three studies were considered (n 13). The mean and standard deviation of recruitment efficiency was calculated for each recruitment strategy. The top four strategies which had the highest efficiency were advertising through letters (mean ± sd of 8·7 ± 14·1 participants recruited per day), using existing cohorts or participant databases (7·3 ± 10·8 participants recruited per day), face-to-face (6·4 ± 10·3 participants recruited per day) and advertising within university classrooms (6·1 ± 10·8 participants recruited per day) (Table 5).
Efficiency of recruitment strategies used across forty-eight studies of nutrition, physical activity and/or obesity interventions in young adults
* Recruitment efficiency = the number of participants randomised/recruitment duration in days. The (n) refers to the number of studies which used each strategy.
Research question #5: What are the costs per participant recruited?
Total cost of recruitment was documented in three studies (Project Grad, TXT2BFIT and SNAP study)(Reference Allman-Farinelli, Partridge and McGeechan35,Reference Calfas, Sallis and Nichols46,Reference Wing, Tate and Espeland139,Reference Partridge, Balestracci and Wong141,Reference Tate, LaRose and Griffin142) . Costs in ascendency were: Project Grad which spent US$20 729 for recruiting participants from a University setting and implemented two recruitment strategies (mailed literature and telephone calls to students)(Reference Calfas, Sallis and Nichols46). Next, TXT2BFIT spent US$32 861·98 for recruiting participants from a community and University setting and implemented fourteen recruitment strategies (GP letter, Facebook advertisement, Google advertisement, Gumtree advertisement, Social media page, University e-newsletter, University web home page, University research volunteer page, poster, brochures, commuter newspaper advertisement, local newspaper advertisement, students’ magazine and word of mouth)(Reference Allman-Farinelli, Partridge and McGeechan35,Reference Partridge, Balestracci and Wong141) . Last, SNAP study spent US$139 543 to recruit participants from a community setting and implemented nine strategies (television, print media, radio, mass mailing, website recruitment, email, flyers and community events, study referral and word of mouth)(Reference Wing, Tate and Espeland139,Reference Tate, LaRose and Griffin142) . Two of these studies provided a breakdown of costs by strategy. Specifically, the SNAP study reported mass mailings (US$76 466·34) and television ($24 074·00) to be most expensive, while the cheapest paid strategies were flyers and community events (costed together at US$2713·27) and website recruitment (US$5222·23). There were no costs associated with some strategies including word of mouth and study referral. The most expensive strategies in the TXT2BFIT programme were brochures (US$12 922·20) and letters sent from general practitioners (US$9316·20), while the cheapest paid strategies were Gumtree advertisement (US$34·08) and University student magazines (US$701·52). There were several free strategies provided by University resources (i.e. University e-newsletter, University volunteer page, University web home page).
Cost per participant randomised was established in three studies. In the PROJECT GRAD study, this was US$45 for the passive recruitment method and $79 for the active recruitment method(Reference Calfas, Sallis and Nichols46). The TXT2BFIT and SNAP studies were more expensive with a total cost per participant randomised of US$131·77 and US$232·96, respectively(Reference Allman-Farinelli, Partridge and McGeechan35,Reference Wing, Tate and Espeland139,Reference Partridge, Balestracci and Wong141,Reference Tate, LaRose and Griffin142) .
Retention
Retention details are summarised by intervention focus in Table 6. Responses to retention research questions are provided below.
Summary of retention details of 107 studies of nutrition, physical activity and obesity interventions in young adults, by intervention focus
* n 76 studies (21 physical activity, 16 nutrition, 16 weight gain prevention, 14 weight loss, 9 Nutrition and physical activity); 25 studies did not collect data at post-intervention, and 6 studies collected data but did not report retention.
† n 49 studies (11 physical activity, 16 nutrition, 9 weight gain prevention, 5 weight loss, 8 nutrition and physical activity); 57 studies did not collect data beyond the end of the intervention.
Research question #6: What are the most common retention strategies for young adults?
Of the included studies, seventy-six studies (71 %) reported strategies to retain participants. Almost half of these studies (n 44, 41 %) used financial incentives such as gift cards, twenty-two studies (21 %) used reminders and increased contact with participants and eighteen studies (17 %) gave participants credit for university/college courses in return for participation (Table 6).
Research question #7: Do studies adequately retain young adults?
In the seventy-six studies which reported retention rates at post-intervention (range 1 week to 3 years, median: 12 weeks), there was a mean ± sd retention rate of 83 ± 14 %. Forty-nine studies measured retention rates at the longest follow-up and found that a mean ± sd of 76 ± 23 % of participants was retained. Longest follow-up ranged from 1 week to 2 years from baseline (mean 25·9 weeks, median 17·5 weeks) and ranged from 1 week to 1 year and 11 months from the end of the intervention (mean 17·3 weeks, median 11·5 weeks). Overall, seventy studies (65 %) had adequate retention (≥80 % retained for ≤6-month follow-up or ≥70 % for >6-month follow-up).
Research question #8: What are the most successful retention strategies for young adults?
Success of individual retention strategies was determined for seventy-four studies (69 %). To provide a meaningful representation of each strategy’s ability to meet the criteria for acceptable retention, only retention strategies that were reported in at least three studies were considered (n 6). The most successful retention strategies were providing participants with course credit for university/college courses (n 15, 88 %), prize/prize draw (n 9, 75 %) and financial incentives (n 31, 72 %). (Fig. 4).
Adequacy* of retention strategies used across seventy-four studies of nutrition, physical activity and/or obesity interventions in young adults. *Retention was considered adequate if retention was ≥80% for ≤6-month follow-up or ≥70% for >6-month follow-up
Research question #9: What are the costs per participant retained?
Total cost of retention was documented in forty studies(Reference Allman-Farinelli, Partridge and McGeechan35,Reference Ashton, Morgan and Hutchesson38,Reference Brookie, Mainvil and Carr42–Reference Calfas, Sallis and Nichols46,Reference Chang, Nitzke and Brown49,Reference Do, Kattelmann and Boeckner55,Reference Franko, Cousineau and Trant58–Reference Gow, Trace and Mazzeo63,Reference Husband, Wharf-Higgins and Rhodes69–Reference Jakicic, Davis and Rogers71,Reference Jung, Martin Ginis and Phillips74,Reference Katterman, Butryn and Hood76,Reference Katterman, Goldstein and Butryn77,Reference Kypri and McAnally86,Reference LaRose, Tate and Gorin88–Reference LeCheminant, Smith and Covington91,Reference Meng, Peng and Shin101–Reference Napolitano, Hayes and Bennett103,Reference Park, Nitzke and Kritsch109,Reference Pope and Harvey114,Reference Pope, Barr-Anderson and Lewis115,Reference Sandrick, Tracy and Eliasson119,Reference Schweitzer, Ross and Klein120,Reference Stice, Rohde and Shaw126,Reference Weinstock, Capizzi and Weber134,Reference Werch, Moore and Bian136,Reference Whatnall, Patterson and Chiu137,Reference Wing, Tate and Espeland139,Reference Kreausukon, Gellert and Lippke143) ranging from US$50 (n 1 strategy was used) to US$202 700 (n 1 strategy used), with a median cost of US$1935. The costs per participant retained at post-intervention were established in thirty-eight studies, ranging from US$0·50(Reference Kypri and McAnally86) to US$553·83(Reference Laska, Lytle and Nanney90), with a median cost of US$22·55. Costs per participant retained at longest follow-up were established in eighteen studies, ranging from US$1·15(Reference Kreausukon, Gellert and Lippke143) to US$97·20(Reference Gow, Trace and Mazzeo63), with a median cost of US$20.
Discussion
The current study provides a comprehensive review of the recruitment and retention data of 107 RCT targeting nutrition, physical activity or overweight/obesity in young adults. Notably, the review highlights the poor reporting of details related to recruitment information across the trials (i.e. only 46 % of studies provided sufficient information to determine the ability of individual recruitment strategies to meet pre-determined sample sizes), although reporting for retention was better (69 % of studies provided sufficient information to determine whether individual retention strategies achieved adequate retention rates). Guidance is required for researchers on how to improve reporting practices to help improve recruitment and retention strategies for use with young adult population samples.
Recruitment findings
In terms of recruitment, 77 % of studies had participant recruitment that met pre-determined sample sizes, with face-to-face recruitment most likely to achieve recruitment goals. This is higher when compared with another review (n 151 RCT) of recruitment data from trials that had no restrictions for age and found 56 % of studies achieved their target sample size(Reference Walters, dos Anjos Henriques-Cadby and Bortolami144). The most efficient strategy was advertising through letters. However, results from the current review should be interpreted with caution. Given that 79 % of studies used a university setting to recruit potential participants, findings may not be applicable to other settings.
When planning health behaviour interventions with young adults, researchers need to consider the efficiency of recruitment approaches in order to make the most of available resources and time. Despite the limitations relating to poor reporting of recruitment rates, the review provides some guidance for researchers working with young adults in regard to the number of participants required to respond to recruitment strategies to ensure a sufficient sample size is recruited. Our findings suggest just under one-third of young adults who express interest and/or are screened for eligibility then provide consent and participate in the study. Of those individuals who meet study inclusion criterion, almost two-thirds go on to participate in a study. Practically speaking if a sample of ˜100 young adults is required, this means that ˜300 young adults must be engaged by the recruitment strategies and screened for eligibility, of which ˜200 would meet inclusion criteria, and ˜100 would go on to participate in the study. Furthermore, studies focusing on weight gain prevention or weight loss took longer to recruit the target sample (mean of 375 d and 183 d) compared with studies focusing on nutrition and/or physical activity. They also screened more people and reported a much lower proportion of those expressing interest being randomised (47·6 % and 29·3 %). This is likely due to stricter inclusion criteria, but is an important consideration for studies focusing on weight with a need to allocate extra time and resources for recruitment.
Few studies reported the cost information related to recruitment (n 3 studies). In these studies, recruitment costs in ascendency were US$20 729 to enrol 338 participants, US$32 861·98 to enrol 250 participants and US$139 543 to enrol 609 participants. However, in-kind support from the University (i.e. University e-newsletter) was common; therefore, costs will likely be higher if recruiting outside of a University setting. The costs associated with recruiting young adults may be higher than other population groups due to extra challenges of recruiting this population group(Reference Lam, Partridge and Allman-Farinelli24). When compared with another systematic review of physical activity interventions among all adults (19 years of age and above), costs per participant recruited were approximately US$27·62 (reported as £20·32 but converted to USD for comparison)(Reference Cooke and Jones145). Although this was only reported in one study in the review, this appears lower than costs per participant recruited in this current review which ranged from US$45 to US$232·96.
The recruitment strategies predominantly used were more traditional, such as flyers and email, as opposed to ‘newer’ strategies, such as online advertising and social media. This is consistent with other reviews which have reported this information(Reference Lam, Partridge and Allman-Farinelli24,Reference Foster, Brennan and Matthews146) . There is potential to further explore the success of ‘newer’ strategies, given the high use and engagement with electronic and social media among young adults(147). The use of online platforms for intervention delivery (e.g. e-Health and mHealth) has advanced substantially in recent years among young adults and was the most common mode of intervention delivery identified in this review. However, there has not been the same rise in use of online platforms as a means of recruitment.
Comparably, other reviews of recruitment data among physical activity interventions(Reference Cooke and Jones145,Reference Foster, Brennan and Matthews146) , mental health trials(Reference Liu, Pencheon and Hunter148) and those using digital tools(Reference Frampton, Shepherd and Pickett149) to recruit have all highlighted inadequate reporting and evaluation, while accentuating the need for better guidance in reporting(Reference Kearney, Harman and Rosala-Hallas150). Recently, the ORRCA project (Online Resource for Recruitment research in Clinical triAls, www.orrca.org.uk) has created a database of all RCT on recruitment to help improve recruitment of participants into trials.
Research question #10: What reporting is needed to assess the success of recruitment strategies?
Gaps in reporting of key recruitment information mean that the success of recruitment strategies could not be evaluated sufficiently. Similarly, issues with reporting recruitment information were emphasised in the 2016 review on weight gain prevention interventions by Lam et al.(Reference Lam, Partridge and Allman-Farinelli24). It was hoped that the review by Lam et al. would illicit better reporting, but gaps still remain. As such, we have outlined the key recruitment information that should be reported in trials and the benefits of reporting this information (Table 7).
Key reporting information for recruitment in trials
Retention findings
In terms of retention, 65 % of studies had adequate retention and the most successful retention strategy was course credit. The mean ± sd retention rate of 83 ± 14 % is slightly lower when compared with another review by Walters et al. (n 151 RCT) that had no restrictions for age and reported an average retention rate of 89 %(Reference Walters, dos Anjos Henriques-Cadby and Bortolami144). Of note, this current review included fewer longer-term trials with only 38 % having follow-up >6 months from baseline, compared with 64 % in the Walters review(Reference Walters, dos Anjos Henriques-Cadby and Bortolami144). Thus, young adults are likely to be harder to retain in the long term. Although reporting of retention was better than recruitment (69 % of studies provided sufficient information about retention strategies), results should be interpreted with caution. As was the case for the recruitment results, findings for retention (i.e. use of course credit) will unlikely be applicable outside of University or College settings.
Research question #11: What reporting is needed to assess the success of retention strategies?
Gaps in reporting retention information prevented detailed insights to inform successful retention strategies for use in this age group. Comparatively, a systematic review of smoking, nutrition, alcohol, physical activity and obesity RCT (n 10) also highlighted reporting issues about retention(Reference Ashton, Morgan and Hutchesson25). Therefore, we have outlined in Table 8 the key retention information to be reported in trials and the benefits of reporting this information.
Key reporting information for retention in trials
Once more studies are available with detailed information on recruitment and retention, as outlined in Table 7 and Table 8, it will be worthwhile to update the current review. Providing greater detail on these aspects will assist with truly determining successful, cost-effective and efficient strategies to recruit and retain young adults. Furthermore, this information will help ensure statistical power is achieved and retained, leading to fewer false-negative findings. Finally, project co-ordinators will be better informed on ways to improve budgeting, planning and time management.
Strengths and limitations of the review
This review is the largest and most comprehensive review to evaluate recruitment and retention information from behavioural interventions targeting nutrition, physical activity or overweight/obesity in young adults. Furthermore, the quantification of recruitment and retention success, efficiency and cost is useful to inform future study planning. There are a number of limitations to acknowledge. Primarily, to be included, all participants were required to be within the age range of 17–35 years. As such, this risks excluding studies that included mainly young adults but also had some outside the age range. In addition, the calculations to determine the success of individual recruitment and retention strategies were basic (i.e. number of times the strategy was used in a study with recruitment or retention meeting criteria/the total number of times the strategy was used in a study). In implementing this approach, we were unable to determine if certain strategies had more ‘weighting’ with regard to recruitment or retention success. However, this approach was considered most appropriate as few studies provided recruitment and retention numbers by each strategy. Exploration of the combinations of recruitment and retention strategies was not feasible due to the large number of combinations with very few studies using the exact same combination of strategies and thus may result in false-positive or false-negative findings. For the recruitment rate calculation, a denominator of all those reached was not used because of the difficulty of measuring reach when passive/reactive recruitment strategies are used that require the potential participants to contact the research team. The definition of adequate retention is limited in that the cut-off of 6-months for follow-up does not consider additional cut-offs for studies with longer-term follow-up (e.g. >12 months). However, in this review, only 15 % of studies included follow-up >12 months from baseline. In addition, studies were limited to those published in English, which may have excluded relevant studies and could limit the generalisability of the findings.
Recommendations from this research
-
Future studies should report complete details of recruitment and retention as outlined in Table 7 and Table 8 within the main paper or in protocol papers or Supplementary information. Alternatively, journals and researchers should publish papers specifically focusing on recruitment and retention.
-
Greater focus on recruiting diverse samples of young adults and determining successful strategies to do so. In particular, different ethnicities and samples from a variety of socio-economic backgrounds.
-
Researchers should consider the number of young adults that need to be reached to recruit the pre-determined sample size. Based on the current review, if a sample recruitment target is 100 young adults, then at least 300 participants need to be engaged by recruitment strategies.
-
Researchers should consider sufficient costs when budgeting for recruitment and retention. Recruitment costs per participant randomised in the university setting ranged from US$45 to US$232·96. Furthermore, median retention costs were US$22·55 per participant retained (range: US$0·50 to US$553·83).
Conclusions
Overall, the current review emphasises poor reporting of recruitment, retention and related costs within behavioural interventions that include young adults. Due to the large proportion of studies that have used a university setting to recruit potential participants, findings may not be applicable to other settings. Guidance is required for researchers on how to improve reporting practices to help better establish recruitment and retention strategies for use with young adult populations. Essential recruitment and retention data are required in established checklists of reporting for trials (e.g. CONSORT) or as an extension. An update of this review will be required once a sufficient number of new studies publish essential recruitment and retention data.
Acknowledgements
Acknowledgements: Not applicable. Financial support: This research was supported by the School of Health Sciences strategic pilot grant (University of Newcastle). C.E.C. is supported by a National Health and Medical Research Council of Australia Senior Research Fellowship, and a Gladys M Brawn Senior Research Fellowship from the Faculty of Health and Medicine, the University of Newcastle, Australia. F.T. was supported by a National Health and Medical Research Council (NHMRC) Career Development Fellowship (APP1143269). The funding bodies had no role in the design and conduct of the study; collection, management, analysis and interpretation of the data; preparation, review or approval of the manuscript; and decision to submit the manuscript for publication. Conflict of interest: None of the authors had any financial support or relationships that may pose a conflict of interest. Authorship: CRediT Author statement contributions: M.C.W.: methodology, formal analysis, investigation and writing – original draft; M.J.H.: funding acquisition, conceptualisation, methodology, investigation, writing – original draft and supervision; T.S.: investigation and data curation; R.L.H.: investigation and writing – review & editing; A.B.: investigation and writing – review & editing; C.E.C.: funding acquisition, conceptualisation, methodology, investigation, writing – review & editing and supervision; F.T.: writing – original draft; L.M.A.: funding acquisition, methodology, conceptualisation, formal analysis, data curation, investigation, writing – original draft, project administration and supervision. Ethics of human subject participation: Not applicable.
Supplementary material
For supplementary material accompanying this paper visit https://doi.org/10.1017/S1368980021001129
