Skip to main content
×
Home
    • Aa
    • Aa
  • Access

Strengthening the rigour of population-wide, community-based obesity prevention evaluations

  • Luke Wolfenden (a1) and John Wiggers (a1) (a2)
  • DOI: http://dx.doi.org/10.1017/S1368980012004958
  • Published online: 19 November 2012
Abstract
AbstractObjective

The aim of the present study was to review the methodological literature regarding evaluation methods for complex public health interventions broadly and, based on such methods, to critically reflect on the evaluation of contemporary community-based obesity prevention programmes.

Design

A systematic review of the methods and community-based literature was performed by one reviewer.

Results

The review identified that there is considerable scope to improve the rigour of community-based obesity prevention programmes through: prospective trial registration; the use of more rigorous research designs, particularly where routine databases including an objective measure of adiposity are available; implementing strategies to quantify and reduce the risk of selective non-participation bias; the development and use of validated instruments to assess intervention impacts; reporting of intervention process and context information; and more comprehensive analyses of trial outcomes.

Conclusions

To maximise the quality and utility of community-based obesity prevention evaluations, programme implementers and evaluators need to carefully examine the strengths and pitfalls of evaluation decisions and seek to maximise evaluation rigour in the context of political, resource and practical constraints.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Strengthening the rigour of population-wide, community-based obesity prevention evaluations
      Your Kindle email address
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Dropbox account. Find out more about sending content to Dropbox.

      Strengthening the rigour of population-wide, community-based obesity prevention evaluations
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Google Drive account. Find out more about sending content to Google Drive.

      Strengthening the rigour of population-wide, community-based obesity prevention evaluations
      Available formats
      ×
Copyright
Corresponding author
*Corresponding author: Email luke.wolfenden@hnehealth.nsw.gov.au
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

2.AD Lopez , CD Mathers , M Ezzati et al. (2006) Global Burden of Disease and Risk Factors. Washington, DC: The World Bank and Oxford University Press.

4.MBE Livingstone , TA McCaffrey & KL Rennie (2006) Child obesity prevention studies: lessons learned and to be learned. Public Health Nutr 9, 11211129.

7.B McCormick & I Stone (2007) Economic costs of obesity and the case for government intervention. Obes Rev 8, Suppl. 1, 161164.

9.NS Lavery (2008) Stop all further research – and act. BMJ 336, 7.

13.C Merzel & JD D'Afflitti (2003) Reconsidering community-based health promotion: promise, performance and potential. Am J Public Health 93, 557574.

17.L King , T Gill , S Allender et al. (2011) Best practice principles for community-based obesity prevention: development, content and application. Obes Rev 12, 329338.

19.SL Mercer , BJ DeVinney , LJ Fine et al. (2007) Study designs for effectiveness and translation research. Am J Prev Med 33, 139154.

23.AA Atienza & AC King (2002) Community-based health intervention trials: an overview of methodological issues. Epidemiol Rev 24, 7279.

24.L Hancock , R Sanson-Fisher , S Redman et al. (1996) Community action for cancer prevention: overview of the Cancer Action in Rural Towns (CART) project, Australia. Health Promot Int 11, 277290.

25.PL Pirie , EJ Stone , AR Assaf et al. (1994) Program evaluation strategies for community-based health promotion programs: perspectives from the cardiovascular disease community research and demonstration studies. Health Educ Res 9, 2336.

26.KR McLeory , BL Norton , MC Kegler et al. (2003) Community-based interventions. Am J Public Health 93, 529533.

28.MJ Friedrich (2007) Researchers address childhood obesity through community-based programs. JAMA 298, 27282730.

29.BA Swinburn & AM de Silva-Sanigorski (2010) Where to from here for preventing childhood obesity: an international perspective. Obesity (Silver Spring) 18, Suppl. 1, S4S7.

30.TT Huang & M Story (2010) A journey just started: renewing efforts to address childhood obesity. Obesity (Silver Spring) 18, Suppl. 1, S1S3.

31.American Evaluation Association (2005) American Evaluation Association: guiding principles for evaluators. Am J Eval 26, 297298.

32.C Gilligan , R Sanson-Fisher & A Shakeshaft (2010) Appropriate research designs for evaluating community-level alcohol interventions: what next? Alcohol Alcohol 45, 481487.

33.RW Taylor , KA Mcauley , SM Williams et al. (2006) Reducing weight gain in children through enhancing physical activity and nutrition: the APPLE project. Int J Pediatr Obes 1, 146152.

35.S Samuels , L Craypo , M Boyle et al. (2010) The California Endowment's Healthy Eating, Active Communities Program: a midpoint review. Am J Public Health 100, 21142123.

36.A Cheadle , P Schwartz , S Rauzon et al. (2010) The Kaiser Permanente Community Health Initiative: overview and evaluation design. Am J Public Health 100, 21112113.

37.AM de Silva-Sanigorski , CA Bell , P Kremmer et al. (2010) Reducing obesity in early childhood: results from Romp & Chomp, an Australian community-wide intervention program. Am J Clin Nutr 91, 831840.

38.CD Economos , RR Hyatt , JP Goldberg et al. (2007) A community intervention reduces BMI z-score in children: Shape Up Somerville first year results. Obesity (Silver Spring) 15, 13251336.

39.AM Sanigorski , AC Bell , PJ Kremer et al. (2008) Reducing unhealthy weight gain in children through community capacity-building: results of a quasi-experimental intervention program, Be Active Eat Well. Int J Obes (Lond) 32, 10601067.

40.VR Chomitz , RJ McGowan , JM Wendel et al. (2010) Healthy Living Cambridge Kids: a community based participatory effort to promote healthy weight and fitness. Obesity (Silver Spring) 18, Suppl. 1, S45S53.

41.A de Silva-Sanigorski , K Bolton , M Haby et al. (2010) Scaling up community-based obesity prevention in Australia: background and evaluation design of the Health Promoting Communities: Being Active Eating Well initiative. BMC Public Health 10, 65.


44.T Azzam (2010) Evaluator responsiveness to stakeholders. Am J Eval 31, 4565.

45.B Yazahmeidi & CDJ Holman (2007) A survey of suppression of public health information by Australian governments. Aust N Z J Public Health 31, 551557.

46.M Morris (2010) The good, the bad, and the evaluator: 25 years of AJE ethics. Am J Eval 32, 134151.

47.MB Cope & DB Allison (2010) White hat bias: examples of its presence in obesity research and a call for renewed commitment to faithfulness in research reporting. Int J Obes (Lond) 34, 8488.

48.CD DeAngelis , JM Drazen , FA Frizelle et al. (2004) Clinical trial registration: a statement from the International Committee of Medical Journal Editors. JAMA 292, 13631364.

51.L Wolfenden , J Wiggers , E Tursan d'Espaignet et al. (2010) How useful are systematic reviews of child obesity interventions? Obes Rev 11, 159165.

52.COMMIT Research Group (1995) Community Intervention Trial for Smoking Cessation (COMMIT), I: cohort results from a four year community intervention. Am J Public Health 85, 183192.

53.RW Sanson-Fisher , B Bonevski , LW Green et al. (2007) Limitations of the randomized controlled trial in evaluating population-based health interventions. Am J Prev Med 33, 155161.

54.ND Mdege , MS Man , CA Taylor et al. (2011) Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol 64, 936948.

55.MA Hussey & JP Hughes (2007) Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials 28, 182191.

57.JM Mellor , RB Rapoport & D Maliniak (2008) The impact of child obesity on active parental consent in school-based survey research on healthy eating and physical activity. Eval Rev 32, 298312.

59.L Wolfenden , K Kypri , R Hodder et al. (2009) Obtaining active parental consent for school based research: a guide for researchers. Aust N Z J Public Health 33, 270275.

60.ML Booth , AD Okely & E Denney-Wilson (2011) Validation and application of a method of measuring non-response bias in school-based surveys of pediatric overweight and obesity. Int J Pediatr Obes 6, e87e93.

61.AE Barry (2005) How attrition impacts the internal and external validity of longitudinal research. J Sch Health 75, 267270.

62.LL Davis , ME Broome & R Cox (2002) Maximizing retention in community-based clinical trials. J Nurs Scholarsh 34, 4753.

63.C Booker , S Harding & M Benzeval (2011) A systematic review of the effect of retention methods on response rates in population-based cohort studies. BMC Public Health 11, 249.

64.R Kane , K Wellings , C Free et al. (2000) Uses of routine data sets in the evaluation of health promotion interventions: opportunities and limitations. Health Educ 100, 3341.

65.C Breen , A Shakeshaft , T Slade et al. (2011) Assessing the reliability of measures using routinely collected data. Alcohol Alcohol 46, 501502.

66.P Hawe , A Shiell , T Riley et al. (2004) Methods for exploring implementation variation and local context within a cluster randomised community intervention. J Epidemiol Community Health 58, 788793.

67.CS Gorber , M Tremblay , D Moher et al. (2007) A comparison of direct vs. self-report measures for assessing height, weight and body mass index: a systematic review. Obes Rev 8, 307326.

68.H Roberts (2004) Intervening in communities: challenges for public health. J Epidemiol Community Health 58, 729730.

70.L Vanhees , J Lefevre , R Philippaerts et al. (2005) How to assess physical activity? How to assess physical fitness? Eur J Cardiovasc Prev Rehabil 12, 102114.

71.JR Sirard & RR Pate (2001) Physical activity assessment in children and adolescents. Sports Med 31, 439454.

72.SE Benjamin , B Neelon , SC Ball et al. (2007) Reliability and validity of a nutrition and physical activity environment self-assessment for childcare. Int J Behav Nutr Phys Act 4, 29.

73.MJ Bryant , DS Ward , D Hales et al. (2008) Reliability and validity of the Healthy Home Survey: a tool to measure factors within homes hypothesized to relate to overweight in children. Int J Behav Nutr Phys Act 5, 23.

74.E Cerin , B Saelens , J Sallis et al. (2006) Neighborhood environment walkability scale: validity and development of a short form. Med Sci Sports Exerc 38, 16821691.

75.ML Gattshall , JA Shoup , JA Marshall et al. (2008) Validation of a survey instrument to assess home environments for physical activity and healthy eating in overweight children. Int J Behav Nutr Phys Act 5, 3.

76.A Cheadle , TD Sterling , TL Schmid et al. (2000) Promising community-level indicators for evaluation cardiovascular health-promotion programs. Health Educ Res 15, 109116.

77.A Cheadle , B Psaty , E Wagner et al. (1990) Evaluating community-based nutrition programs: assessing the reliability of a survey of grocery store product displays. Am J Public Health 80, 709711.

78.A Oakley , V Strange , C Bonell et al. (2006) Process evaluation in randomised controlled trials of complex interventions. BMJ 332, 413416.

81.B Swinburn , C Bell , L King et al. (2007) Obesity prevention programs demand high-quality evaluations. Aust N Z J Public Health 31, 305307.

82.CG Victoria , JP Habicht & J Bryce (2004) Evidence-based public health: moving beyond randomized trials. Am J Public Health 94, 400405.

83.CH Hennekens & D DeMets (2009) The need for large-scale randomized evidence without undue emphasis on small trials, meta-analyses or subgrouop analyses. JAMA 302, 23612362.

84.M Cargo & SL Mercer (2003) The value and challenges of participatory research: strengthening its practice. Annu Rev Public Health 29, 325340.

85.LW Green , MA George , M Daniel et al. (1995) Study of Participatory Research in Health Promotion: Review and Recommendations for the Development of Participatory Research in Health Promotion in Canada. Ottawa: Royal Society of Canada.

86.JA Sandoval , J Lucero , J Oetzel et al. (2012) Process and outcome constructs for evaluating community-based participatory research projects: a matrix of existing measures. Health Educ Res 27, 680690.

87.DP MacKinnon & LJ Luecken (2008) How and for whom? Mediation and moderation in health psychology. Health Psychol 27, 2 Suppl., S99S100.


89.E Cerin , A Barnett & T Baranowski (2009) Testing theories of dietary behavior change in youth using the mediating variable model with intervention programs. J Nutr Educ Behav 41, 309318.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Public Health Nutrition
  • ISSN: 1368-9800
  • EISSN: 1475-2727
  • URL: /core/journals/public-health-nutrition
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords: