Population health interventions to address the high prevalence of overweight and obesity require information about the association between dietary habits and weight status. However, error in self-reported dietary intake data has been observed in many populationsReference Bedard, Statenstein and Nadon1–Reference Warwick and Reid10, and greater under-reporting has been noted among womenReference Bedard, Statenstein and Nadon1, Reference Briefel, Sempos, McDowell, Chien and Alaimo2, Reference Price, Paul, Cole and Wadsworth6, those with higher weight or body mass index (BMI)Reference Bedard, Statenstein and Nadon1–Reference Warwick and Reid10 and those who have reported some indication of weight loss effortReference Briefel, Sempos, McDowell, Chien and Alaimo2, Reference Lafay, Basdevant, Charles, Vray, Balkau and Borys5, Reference Pryer, Vrijheid, Nichols, Kiggins and Elliot7. As such, studies of diet and adiposity are complicated by not only the increased risk of under-reporting among those with greater adiposity, but also the potential for unusual dietary habits at the time of the survey such as deliberate weight loss effort or restricted intake due to food insecurity. The increased prevalence of under-reporting among overweight or obese individuals may simply be a marker of reduced energy intake (EI) among those trying to lose weight, but this is unclear from the existing researchReference Johansson, Wikman, Ahren, Hallmans and Johansson3, Reference Lafay, Basdevant, Charles, Vray, Balkau and Borys5, Reference Price, Paul, Cole and Wadsworth6. A clearer identification of factors that are associated with the quality of dietary reporting may be obtained by clarifying the independent contributions of weight loss effort and adiposity.
Under-reporters can be identified with a high level of accuracy using biomarkers such as doubly labelled water (DLW) or urinary nitrogen excretionReference Bingham11, Reference Livingstone and Black12. However, because these methods are costly and place a burden on the participants, they are impractical for the validation of EI in large population studies. Energy under-reporters have therefore typically been identified through comparisons of reported EI with basal metabolic rate (BMR), a value estimated from height, weight and age categoryReference Schofield13. In previous research, participants were often identified as under-reporters or non-under-reporters based on their EI:BMR values in relation to specific cut-offs established by GoldbergReference Briefel, Sempos, McDowell, Chien and Alaimo2, Reference Johansson, Solvoll, Bjorneboe and Drevon4, Reference Lafay, Basdevant, Charles, Vray, Balkau and Borys5, Reference Warwick and Reid10, Reference Goldberg, Black, Jebb, Cole, Murgatroyd and Coward14. With information about a population's physical activity level, the Goldberg cut-off can be used to evaluate the mean population bias in reported EI. However, this approach has limited sensitivity for identifying under-reporters at the individual level, and the application of a single cut-off point can result in gender- and age-specific biasesReference Livingstone and Black12, Reference Black15. In addition, energy reporting quality is consistent over several data collection periodsReference Price, Paul, Cole and Wadsworth6, Reference Black and Cole16, indicating that the error introduced by under-reporting cannot be diminished with increased days of intake data.
The 2005 Dietary Reference Intakes (DRIs) for energy include equations for estimating energy expenditure based on DLW studies of people with a wide range of age, weight and physical activity levels17. In contrast to the BMR, these equations provide an estimate of total energy expenditure based on height, weight and age, as well as a measure of physical activity. Furthermore, the DRI equations are specific to BMI groups17. These equations were not developed specifically for evaluating dietary reports in population surveys; however, a comparison of reported EI with estimated energy expenditure can serve as an indicator of dietary reporting quality.
The primary goal of the present analysis was to examine adiposity, weight loss effort and other personal characteristics in relation to energy reporting quality, measured by the ratios of reported EI to the conventional BMR and the new DRI estimates of total energy expenditure17. Lower ratios are more likely than higher ratios to be indicative of energy under-reporting. A secondary objective of the present analysis was to examine the consistency of energy reporting quality across two dietary recalls within individuals. The Ontario Food Survey (OFS) provided the opportunity to conduct such analyses, as there was a high proportion of overweight and obese participants, and data on several measures related to adiposity and energy reporting quality were available.
Methods
Sampling and recruitment
The OFS was conducted between June 1997 and September 1998. A full description of the survey method has been published previouslyReference Mendelson, Tarasuk, Chappell, Brown and Anderson18. Participants were drawn from the Ontario Health Insurance Program (OHIP) database using a stratified multistage probability design, and were contacted by letter and follow-up phone call. The participants were randomly assigned to different days of the week to allow for systematic day of the week variations in dietary intake, and were interviewed in their homes. Data were collected from 707 women and 480 men. The second dietary recall was collected at least 8 days later from a subset of the sample, and was conducted on a different day of the week. The present analysis includes only the 230 women and 158 men who completed two dietary recalls. The study protocol was approved by the Ethics Research Board at the University of Toronto.
Anthropometrics
Participants were weighed to the nearest 0.5 kg on a calibrated mechanical dial scale, and height was measured with a measuring tape to the nearest 0.1 cm. Height and weight measurements were obtained from 73% of men and 78% of women in the present analyses, with 27 and 22% of men and women, respectively, self-reporting one or both of height and weight values. BMI was defined as weight (kg)/[height (m)]2.
Demographic and lifestyle characteristics
An interviewer-administered questionnaire was used to collect data on participant's age, education and household income. Behaviours related to weight, the nature of occupational physical activity and the frequency and duration of vigorous leisure-time physical activity (LTPA) were addressed in a lifestyle questionnaire. Participants were asked if they were trying to lose, gain or maintain their current weight. Those who indicated that they were trying to lose weight were asked to identify from a list the methods they were using to achieve their weight loss. Participants were also asked four questions about their household food security over the past 12 monthsReference Carlson, Andrews and Bickel19. Individuals who gave an affirmative response to at least one question were considered to be in food-insecure households.
Energy intake measurement
Dietary intake data were collected in person with a standardised multiple-pass 24-hour recall. Portion size models, bowls, thickness indicators and measuring tapes were used to improve reporting accuracy. The interviewer recorded a list of all foods and beverages reported, probed this list for descriptive details and for other forgotten items, and reviewed the details of the 24-hour recall data with the participant. Data from the 24-hour recalls were coded and analysed by the Nutrition Research Division in the Food Directorate in Health Canada using the in-house Nutrition Survey System (NSS) software.
Measurement of energy reporting quality
The quality of self-reported EIs was first evaluated through a comparison of reported average EI with estimates of BMR (EI:BMR)Reference Schofield13 and then with the estimated energy requirements (EERs)17. Data on the frequency and duration of physical activity throughout the day were required for the EER equations. Because limited data were available on occupational physical activity, the classification of participants' activity levels was based on LTPA. Up to four levels of activity can be identified with the EER equations; however, with the OFS data only two levels of physical activity could be distinguished. Participants who reported 30 min or more of LTPA daily were classified as ‘low active’, otherwise they were considered sedentary. Consistent with the DRI report, the equations for overweight and obese individuals are referred to as measures of total energy expenditure (TEE) for weight maintenance instead of EERs17. For consistency across the sample, the term TEE is applied to all participants throughout the present analyses. As suggested in the introduction, the application of cut-off points to identify under-reporters and non-under-reporters has limitations; therefore, in the present analyses, energy reporting quality has been examined as a continuous measure.
Statistical analyses
Statistical analyses were performed with SAS (version 9.1, 2003; SAS Institute Inc.). Interrelationships among the variables under study were tested using χ2 analyses. Energy reporting quality from the first 24-hour recall was regressed onto energy reporting quality from the second 24-hour recall in order to examine the within-person variation in energy reporting quality.
Analysis of variance (ANOVA) was used to test differences in energy reporting quality across categories of age, income, education, weight loss status and food insecurity. In order to meet the ANOVA requirement of a normally distributed dependent variable, EI:BMR and EI:TEE values were transformed using the Box–Cox method, in which maximum likelihood estimates are used to determine the optimal power transformation. For variables with more than two levels, comparisons of least square means with a Bonferroni correction for multiple comparisons were conducted to identify which groups were significantly different from each other.
Multivariate linear regression analyses were conducted in order to identify variables that were independently associated with energy reporting quality. The calculation of BMI from self-reported height and weight values tends to produce erroneously low BMI valuesReference Kuczmarski, Kuczmarski and Najjar20–Reference Rowland24; therefore, a dichotomous variable for measured versus self-reported was also included in the adjusted models. The linear regression analyses were repeated excluding participants who had indicated they were attempting to lose weight at the time of the survey to examine how the expressed intention to lose weight may have affected observed associations with the ratios of reported EI:BMR and EI:TEE.
R 2 statistics are presented as an indicator of the amount of total variance in energy reporting quality that has been accounted for by variables in the models.
Results
Interrelationships among variables
Sample characteristics are presented in Table 1. Twenty-six per cent of men in the sample were obese and 29% were healthy weight, whereas among women, 31% were obese and 40% were of healthy weight. Thirty-seven per cent of men and 46% of women indicated that they were attempting to lose weight. Six per cent of men and 18% of women responded affirmatively to at least one question regarding food insecurity.
Distribution of personal characteristics among the Ontario Food Survey participants
BMI – body mass index.
* BMI group cut-offs (kg m− 2): healthy weight, BMI 18.5–24.9; overweight, 25–29.9; obese, >30.
χ2 analyses revealed that for men and women the proportion of participants reporting weight loss effort was greater among those identified as overweight or obese than those of healthy weight (P < 0.0001 for men and women, data not shown). Education level and BMI classification were associated among women (P < 0.05): 13% of healthy weight women had less than a high school education compared with 28% of obese women, and 21% of healthy weight women had completed university compared with 10% of obese women. Education level and BMI were not associated among men (P>0.05). The proportion of women reporting weight loss effort differed across education levels (P < 0.05); however, weight loss effort did not increase or decrease in a linear fashion with education level. BMI group was not associated with food insecurity or income for men or women (P>0.05).
Energy reporting quality
Linear regression analyses indicated that energy reporting quality on the first 24-hour recall was a significant predictor of energy reporting quality on the second 24-hour recall, measured by either EI:BMR or EI:TEE (P < 0.0001 for men and women). However, it accounted for only a limited amount of variance in energy reporting quality on the second day (EI:BMR, R 2 0.14 for men, 0.25 for women; EI:TEE, R 2 0.12 for men, 0.23 for women).
EI:BMR was associated with age category for men and women (Table 2). EI:BMR was lower among men who reported weight loss effort compared with those who did not, and mean EI:BMR values decreased as BMI category increased from healthy weight to obese (Table 2). Among women, EI:BMR values increased with education level, were lower among women reporting weight loss effort and decreased as BMI categories increased (Table 2).
Personal characteristics associated with energy reporting quality among men and women*
EI – energy intake; BMR – basic metabolic rate; TEE – total energy expenditure; SD – standard deviation; BMI – body mass index; NS – not significant.
* P-values are the significance probability associated with the F-value; means with the same superscript letter are different (P < 0.05)
† TEE not calculated for two men due to missing data on leisure-time physical activity.
‡ Participant indicated use of dietary change, pills, exercise, etc. for weight loss.
§ Adjusted for age, education, expressed intention to lose weight, food insecurity and BMI measurement type (measured or self-reported).
When the quality of energy reporting was measured by EI:TEE as opposed to EI:BMR, the only difference that emerged was that EI:TEE was significantly lower among women who reported food insecurity than those who did not (Table 2). Neither EI:BMR nor EI:TEE was associated with income for men or women (data not shown).
From the linear regression analyses of men, EI:BMR and EI:TEE were inversely associated with obesity and dieting, and positively associated with education (Table 3). Among women, EI:BMR was inversely associated with overweight, obesity and age; a positive association was detected for education (Table 3). Similarly, EI:TEE was positively associated with education and inversely associated with obesity and dieting; the inverse association between overweight and EI:TEE approached significance (Table 3). Neither food insecurity nor the nature of height and weight measurement (measured or self-reported) was associated with EI:BMR or EI:TEE among men or women (Table 3). The R 2 statistic indicated that a greater proportion of variance in energy reporting quality was explained by the multivariate EI:BMR model relative to the EI:TEE model for men and women, with 14 and 19% of the EI:BMR variance explained by all of the variables in the model (Table 3).
Multivariate regression analyses of energy reporting quality by gender
EI – energy intake; BMR – basic metabolic rate; TEE – total energy expenditure; SE – standard error; BMI – body mass index; NS – not significant (P>0.05).
* Compared with self-reported data for BMI.
Upon exclusion of adults who reported weight loss efforts, EI:BMR and EI:TEE remained positively associated with education for women and negatively associated with obesity for men (Table 4). However, EI:BMR and EI:TEE were no longer associated with education for men, or with obesity for women; marginal associations with overweight were observed for EI:BMR among women (Table 4). Again, the R 2 values were greater for the EI:BMR models than for EI:TEE (Table 4), but were lower than in the previous set of linear regressions.
Multivariate regression analyses of energy reporting quality by gender among adults not indicating weight loss effort
EI – energy intake; BMR – basic metabolic rate; TEE – total energy expenditure; SE – standard error; BMI – body mass index; NS – not significant (P>0.05).
* Compared with self-reported data for BMI.
Discussion
Despite the differences in the calculation of BMR and TEE, both approaches to measuring energy reporting quality yielded robust associations with education, weight loss effort and BMI classification in the present analyses. These findings are in accord with another study in which weight loss effort was significantly associated with under-reporting independent of BMIReference Lafay, Basdevant, Charles, Vray, Balkau and Borys5, and with other studies in which adiposity was associated with under-reportingReference Bedard, Statenstein and Nadon1–Reference Warwick and Reid10. Among OFS participants, there was evidence of higher EI:BMR and EI:TEE among those with higher levels of education, independent of BMI classification and weight loss effort. In some studies, lower levels of education have been associated with greater under-reporting among womenReference Bedard, Statenstein and Nadon1, Reference Briefel, Sempos, McDowell, Chien and Alaimo2, Reference Price, Paul, Cole and Wadsworth6 and menReference Briefel, Sempos, McDowell, Chien and Alaimo2, but many authors have found no association between education and energy reporting quality among womenReference Johansson, Wikman, Ahren, Hallmans and Johansson3, Reference Hall, Stephen, Reeder, Muhajarine and Lasiuk25 or menReference Bedard, Statenstein and Nadon1, Reference Johansson, Wikman, Ahren, Hallmans and Johansson3, Reference Price, Paul, Cole and Wadsworth6. The inconsistency of these findings may be due to variation in the dietary data collection methods and EI:BMR cut-off points for identifying under-reporters or to differences between the populations under study.
By conducting the linear regression analyses without the adults who were attempting to lose weight, we confirmed that some of the patterns of energy reporting quality observed in the full sample could not be accounted for by reported intention to lose weight. Other studies have chosen to remove participants who were dieting as their reported EI could be expected to be relatively lowReference Price, Paul, Cole and Wadsworth6, Reference Krebs-Smith, Graubard, Kahle, Subar, Cleveland and Ballard-Barbash26. However, even after the removal of adults who were trying to lose weight, energy reporting quality remained inversely associated with obesity for men and positively associated with education for women despite a considerable decrease in sample size.
The high prevalence of weight loss effort within the OFS sample raises the question of whether reported intention to lose weight resulted in restricted EI or was merely a function of a desire for social approval. Two studies from the USA found that social approval scores were positively associated with dietary under-reporting for men and womenReference Novotny, Rumpler, Riddick, Hebert, Rhodes and Judd27, Reference Tooze, Subar, Thompson, Troiano, Schatzkin and Kipnis28; the same trend was observed in another study of women, but only among those with college education or greaterReference Hebert, Peterson, Hurley, Stoddard, Cohen and Field29. However, energy under-reporting and restricted EI are not necessarily mutually exclusive practices. Some evidence of concurrent energy restriction and under-reporting comes from a longitudinal study of Australian young women in which under-reporters lost weight over time but not as much as expected based on their reported EI. However, height and weight data were self-reported in this study, and there were no data on weight loss intention. In order to understand energy under-reporting and restricted dietary intake better, longitudinal studies that include measures of weight loss intention, dietary intake and weight status are required. Regardless of whether lower EI is genuine or a function of reporting error, dietary records that are not representative of usual dietary habit present a problem for researchers who are attempting to identify relationships between dietary patterns and health status.
The proportion of women reporting weight loss effort was similar among those with relatively low and high education levels, therefore this cannot account for the low EI:BMR values among women with the lowest education level. Another potential explanation is that the dietary data collection method was particularly effective for women with higher education. A prior study found that higher literacy scores were associated with higher reported EIs; the author suggested that the skills of reading and writing might be related to the use of languageReference Johnson, Soultanakis and Matthews30. If higher literacy is associated with higher levels of education, the women with more education in the OFS may have had an advanced ability to communicate their intake. Furthermore, all of the OFS interviewers were highly educated women, having completed either university or a professional nursing programme. It is possible that the interviewers may have established a better rapport with those for whom they had the most in common (i.e. highly educated women) and thus obtained a more thorough dietary recall from these participants. Consideration of the demographics of the interviewers in relation to participants, as well as ensuring that dietary recalls are appropriate for participants across the spectrum of education levels, may improve the quality of dietary reports among those of lower education.
The present analyses were limited by the measure of physical activity in the OFS. The questions were not designed to measure total activity throughout the day, and the nature of the questions regarding occupational activity lacked the necessary detail to identify participants as having anything other than a relatively sedentary level of occupational activity. As such, overall physical activity may have been underestimated, resulting in relatively higher ratios of EI to BMR and TEE. Furthermore, only two levels of physical activity could be discerned from the available data; the crudeness of this approach may have contributed to the similarity between EI:BMR and EI:TEE values. Food insecurity was not associated with energy reporting quality in the OFS. This was counter to the expectation that individuals from households experiencing food insecurity might report a lower than expected EI. Also, food insecurity in some populations was associated with increased risk of obesityReference Olson31–Reference Townsend, Peerson, Love, Achterberg and Murphy33, and obesity has been associated with energy reporting qualityReference Briefel, Sempos, McDowell, Chien and Alaimo2–Reference Lafay, Basdevant, Charles, Vray, Balkau and Borys5Reference Warwick and Reid7. However, the use of a household-level measure of food insecurity over the past year may have impeded our ability to observe associations with individual-level energy reporting quality over 2 days. Furthermore, the food insecure categorisation in the present analyses included subjects who had reported relatively ‘mild’ household food insecurity. Therefore, it is possible that there were insufficient participants with food insecurity severe enough to be mistaken for poor energy reporting quality.
In addition to considering energy reporting quality in relation to a broad spectrum of factors separately for men and women, to our knowledge this is the first time that the DRI TEE equations have been applied for the study of under-reporting in a population survey. The method appears to yield results comparable with the traditional EI:BMR approach, though it is not known if this similarity would persist in the presence of more detailed data on physical activity.
It is preferable to improve data quality at the collection point rather than remove suspect reports or otherwise modify the data set. The present analyses suggest that the energy reports of highest quality come from adults with lower BMI, women with higher education or women who reported no current attempt to lose weight; however, the advancement of health research would be stunted if it were restricted to these groups alone. The substantial and ever-increasing body of evidence regarding the patterns of variation in energy reporting quality across population subgroups highlights the need for the development of methods to address this issue, and a reminder of the caution required when interpreting existing nutrition data.
Acknowledgements
Sources of funding: The Ontario Food Survey received funding from Health Canada, the Heart and Stroke Foundation (Ontario) and members of the Program in Food Safety, Nutrition and Regulatory Affairs at the University of Toronto.
Conflict of interest declaration: We have no other financial or contractual agreements that could cause or be perceived to cause a conflict of interest regarding this work.
Authorship responsibilities: H.W. carried out the statistical analyses and drafted the manuscript. V.T. made substantial contributions to the conception of the study, critically revised the manuscript and was a co-investigator of the Ontario Food Survey. R.M. was the Principal Investigator of the Ontario Food Survey, participated in the design of the study and provided critical feedback on the manuscript.
