The measurement of nutrient intake in dietary surveys represents a methodological challenge. This measurement sometimes relies on self-reports of food intake over varying periods of time. The most widely used methods are dietary recalls, where subjects report on foods consumed over the previous 24 hours; diet diaries, in which subjects record all food consumed on a daily basis; and food-frequency questionnaires, which require subjects to report food consumption patterns over times ranging from one month to one year or more. Because all dietary methods have their limitations, none of these can be considered a 100% reliable reference measure for assessing dietary intake. Therefore, biological markers of food intake have been sought in order to validate self-reported energy intake by objective measuresReference Zhang, Temme, Sasaki and Kesteloot1–Reference Goldberg, Black, Jebb, Cole, Murgatroyd and Coward5. The doubly labelled water technique is an example of a biomarker that can be used to validate self-reported energy intakeReference Zhang, Temme, Sasaki and Kesteloot1–Reference Subar, Kipnis, Troiano, Midthune, Schoeller and Bingham4. This technique is used to measure energy expenditure in free-living subjects and is currently considered the ‘gold standard’ for the measurement of total energy expenditure in humans. Comparing measured energy expenditure with reported energy intake gives an idea of the degree of misreporting in a dietary survey. All mentioned dietary methods are prone to under- or/and overreporting of energy intakeReference Bingham6. This misreporting may result from difficulties in accurately reporting food consumption and portion size, changing eating patterns or overestimating consumption of more socially desirable foods, etc.Reference Hebert, Clemow, Pbert, Ockene and Ockene7. Because the doubly labelled water technique is too complex and costly to be used in large epidemiological studies, alternative methods have been developed. One of these is the concept of cut-off values developed by Goldberg et al.Reference Goldberg, Black, Jebb, Cole, Murgatroyd and Coward5 and based on the ratio between observed energy intake and estimated basal metabolic rate (EI/BMRest) for a specified energy expenditure level (physical activity level, PAL).
The existence of under- and overreporting of energy intake may seriously distort the interpretation of results in dietary studies or obscure diet–disease relationshipsReference Gnardellis, Boulou and Trichopoulou8–Reference Paeratakul, Popkin, Kohlmeier, Hertz-Picciotto, Guo and Edwards10. PrenticeReference Prentice9 has argued that the lack of a relationship between dietary fat and breast cancer may be a result of non-systematic underreporting of fat and energy intake.
Underreporting is a well documented concern. A large number of studies show that the extent of underreporting varies among individualsReference Lafay, Basdevant, Charles, Vray, Balkau and Borys11–Reference Becker, Foley, Shelley and Gibney17. Reporting of low energy intake is frequently observed and more likely to occur among womenReference Becker, Foley, Shelley and Gibney17–Reference Johansson, Solvoll, Bjorneboe and Drevon19, obese individualsReference Harrison, Galal, Ibrahim, Khorshid, Stormer and Leslie13–Reference Johansson, Solvoll, Bjorneboe and Drevon19, subjects younger than 18 and older than 65 yearsReference Pomerleau, Ostbye and Bright-See14, Reference Becker, Foley, Shelley and Gibney17, Reference Mendez, Wynter, Wilks and Forrester18 and in various ethnic groupsReference Livingstone and Black15. Some studies have found cultural differences in dietary reporting behavioursReference Pomerleau, Ostbye and Bright-See14, Reference Livingstone and Black15. Fewer studies have examined energy overreporting and found that it is more likely to occur among lean and more educated subjectsReference Mendez, Wynter, Wilks and Forrester18. To our knowledge, no studies have specifically examined the extent of under- and overreporting among the elderly in Belgium.
The aims of the present study were to evaluate the prevalence and identify some predictors of under- and overreporting in an elderly Belgian population and to assess the effect of misreporting on the estimated intakes of macronutrients and foods.
Materials and methods
Study population
The data used for the present analyses come from the ‘Quality of life after 65’ study. The population of this study was selected from participants in the Belgian Interuniversity Research on Nutrition and Health (BIRNH), carried out between 1979 and 1984 within a random sample stratified by age and sex and representative of the Belgian population from the ages of 25 to 74 years. The methodology of the BIRNH study has been presented in detail elsewhereReference Kornitzer and Dramaix20.
Ten years after the BIRNH study, former respondents aged 65 years or more on 1st January 1994 (n = 4446) were invited to participate in a new survey, the ‘Quality of life after 65’ study. Of the 4446 subjects, 28% had died, 3% were lost to follow-up and 3045 were living. From these, 11% were in a medical institution and excluded from the survey, and a further 26% refused to participate in the study. The final study sample comprised 2083 subjects (participation rate of 49.5%).
The aims of the ‘Quality of life after 65’ study were to measure chronic morbidity, invalidity and mortality in a cohort of elderly subjects.
Data collection
In the current study two contact points were foreseen. During the first contact, all subjects received a standardised, structured questionnaire that was to be self-administered at home. This questionnaire surveyed lifestyle (including smoking status) and socio-economic characteristics (age, gender, education level), and contained a semi-structured food diary in which the dietary intake of the subject was assessed by a 1-day estimated food record. Respondents were informed about the aim of the study and were given necessary instructions for accurate completion of the food diary. Special attention was given to the issue of portion size of food items. Information on the type (including brand names) and amount of foods consumed was collected through an open entry format. For each eating occasion, the time of day was recorded. During the second contact the participants came to the survey centre, where all questionnaires were checked and verified by trained, experienced dietitians. At the same time body weight was measured according to standardised methods recommended by the World Health Organization (WHO)21.
The amount of food items was quantified by using standardised methods to assign weights or volumes to certain amounts of food. The conversion of food items into nutrients was based on the Dutch and Belgian food composition tables22, Reference Paul and Southgate23.
Evaluation of under- and overreporting
The ratio EI/BMRest, described by Goldberg et al.Reference Goldberg, Black, Jebb, Cole, Murgatroyd and Coward5, was used to estimate the prevalence of under- and overreporting of energy intake. For individuals with a normal (not bed-bound) lifestyle, EI/BMRest ratio of 1.35 is considered to indicate the lowest value for habitual energy intake. For an individual the cut-off value for probable underreporting depends on the number of days the survey covers, the value of BMRest and the lower limit of the 95% confidence interval (CI). BMRest was obtained by the Schofield equationReference Schofield24 based on age, gender and body weight. The ratio was then compared with Goldberg et al.’s cut-off for plausible energy intake, depending on the sample size and number of days. With a 1-day dietary record, the minimum plausible energy intake at the individual level occurs at EI/BMRest = 0.90. At group level, the cut-off value for probable underreporting is estimated at EI/BMRest = 1.53. Overreporting was defined as EI/BMRest>2Reference Schofield24, Reference Black, Goldberg, Jebb, Bingham, Livingstone and Prentice25. Others studies have defined overreporting as EI/BMRest>2.4Reference Mendez, Wynter, Wilks and Forrester18, Reference Johansson, Solvoll, Bjorneboe and Drevon19, the maximum for a very active lifestyle in a general population. However, people aged 65 years and over have lower energy expenditure than younger adults, and Black et al.Reference Black, Goldberg, Jebb, Bingham, Livingstone and Prentice25, Reference Black, Coward, Cole and Prentice26 consider that PAL>2.0 is rare in this relatively inactive sample.
Statistical analysis
Statistical analyses were carried out using SPSS software, version 10 (SPSS Inc., 1999). Usual descriptive statistics were computed for the variables taken into account in the analysis. The potential predictors of underreporting (low-energy reporters, LER) and overreporting (high-energy reporters, OER) taken into account were age, gender, educational level, smoking status, body mass index (BMI) and cultural origin. Means and standard deviation (SD) were calculated for EI and EI/BMRest. Differences in mean values of EI and EI/BMRest between predictors were tested using the t-test for independent samples and analysis of variance. The prevalence of LER and OER was also compared using Pearson's chi-square test. Logistic regression analyses were used to examine predictors of LER and OER controlling for potential covariates. The variables finally included in the models were selected step-by-step using a backward procedure. Odds ratios (OR) and their 95% CI were derived from the different logistic regression models. Adequacy of the logistic regression models was checked by residual analysis and application of the Hosmer–Lemeshow goodness-of-fit test. Mean nutrient and food intakes (absolute intake and intake expressed as a percentage of total energy) of misreporters (LER and OER) and accurate reporters were compared using the non-parametric Mann–Whitney test for independent samples. A P-value of < 0.05 was taken as the threshold for significance.
The number of respondents presented in the tables varies owing to missing values.
Results
The general characteristics of the study population are described in Table 1. The respondents comprised 1126 men and 957 women with a mean (SD) age of 74.4 (5.6) years. More than 60% of the subjects were Flemish and a majority had low education level. The prevalence of current smokers was 42% and almost 20% of the subjects were obese according to the WHO definition of obesity.
Sociodemographic and lifestyle characteristics of respondents, and reported EI and EI/BMRest by demographic and lifestyle characteristics
EI – energy intake; BMRest – estimated basal metabolic rate; BMI – body mass index.
Data presented as mean (standard deviation) or %.
* P-values derived using the t-test for independent samples.
† P-values derived by analysis of variance.
Table 1 also presents EI and EI/BMRest according to demographic and lifestyle characteristics. Mean (SD) EI for the total population was 1948 (738) kcal day− 1 and was significantly higher in men. EI decreased significantly with age. Significant differences in EI were observed across categories of BMI and education level: EI decreased as BMI increased and increased as education level increased. Non-smokers had significantly lower EI. No difference in EI was seen according to cultural origin.
Mean (SD) EI/BMRest was 1.37 (0.50), below the acceptable limit of 1.53 defined by Goldberg et al.Reference Goldberg, Black, Jebb, Cole, Murgatroyd and Coward5, indicating that EI was underreported in the group as a whole. By BMI subgroup, EI/BMRest ranged from 1.20 in obese subjects (BMI ≥ 30 kg m− 2) to 1.51 in normal-weight subjects (BMI < 25 kg m− 2). Significant differences in EI/BMRest were observed by gender, smoking status and BMI: the ratio was significantly lower among females, non-smokers and obese subjects. Mean EI/BMRest was also slightly lower among Walloons, oldest subjects ( ≥ 85 years) and respondents with a low education level; however these differences were not significant.
Extent of misreporting
The prevalence of misreporting in our sample was 22%. More than 70% (n = 1626) of the subjects reported their energy intake plausibly.
Using EI/BMRest < 0.90 as the cut-off to classify LER and EI/BMRest>2 to define OER, underreporting occurred in 13.6% (n = 293) and overreporting in 7.9% (n = 164) of food records. The prevalence of LER differed significantly by gender, education level, smoking status and BMI, being highest in females, non-smokers, those with low education level and those with high BMI. LER prevalence was also higher in Walloons compared with Flemish, but the difference was not significant (Table 2). The prevalence of OER differed significantly by gender, education level and BMI, being higher in males, those with high education level and those with low BMI (Table 2).
Prevalence of under- and overreporting by demographic and lifestyle characteristics
LER – low-energy reporters; OER – high-energy reporters; BMI – body mass index.
* P-values derived using Pearson's chi-square test.
Logistic regressions employing respectively EI/BMRest < 0.90 and EI/BMRest>2 as dependent variable and age, gender, smoking status, cultural origin, education level and BMI as independent variables confirmed the results of bivariate analysis. After adjustment, high BMI, gender and cultural origin were independently associated with underreporting and low BMI, gender and education level were independent predictors of overreporting (Table 3).
Odds of under- and overreporting in the study population
LER – low-energy reporters; OER – high-energy reporters; OR – odds ratio; CI confidence interval; BMI – body mass index.
* Adjusted for gender, cultural origin and BMI compared with those who accurately reported energy intake. Age, smoking and education level were not significant (Hosmer–Lemeshow goodness-of-fit test).
† Adjusted for gender, education level and BMI compared with those who accurately reported energy intake. Age, smoking and cultural origin were not significant (Hosmer–Lemeshow goodness-of-fit test).
Dietary characteristics of LER and OER
Table 4 shows the percentage of energy from different nutrients according to category of energy reporting (low, high and accurate). Percentages of energy from protein and carbohydrates were significantly higher in LER, whereas the percentage of energy from fat tended to be lower. The percentage of energy from alcohol was also lower in LER, but not in a significant manner. Conversely, the percentages of energy from protein and carbohydrates were significantly lower in OER than in accurate reporters.
Macronutrient intakes of LER, OER and accurate reporters (NLER, NOER)
LER – low-energy reporters; OER – high-energy reporters; %E – percentage of energy; SFA – saturated fatty acids; MUFA – monounsaturated fatty acids; PUFA – polyunsaturated fatty acids.
Data presented as mean (standard deviation).
* P-values derived using the Mann–Whitney test.
When considering food groups, LER reported significantly lower absolute intakes of all food groups examined, with the exception of fish (Table 5). Using relative (percentage of energy) rather than absolute intake (data not shown), LER reported significantly higher intakes of meat, dairy products, bread, fruit and vegetables, and significantly lower intakes of cheese, chicken and sweets. OER reported significantly higher absolute intakes of bread, cheese, dairy products, meat, fat and sweets (Table 5).
Intake of some food groups among LER, OER and accurate reporters (NLER, NOER)
LER – low-energy reporters; OER – high-energy reporters.
Data presented as mean (standard deviation).
* P-values derived using the Mann–Whitney test.
Discussion
Ratios of EI/BMRest were calculated for each respondent of the ‘Quality of life after 65’ study. The mean (SD) EI/BMRest was 1.37 (0.50), which was below the acceptable limit of 1.53 defined by Goldberg et al.Reference Goldberg, Black, Jebb, Cole, Murgatroyd and Coward5, indicating that energy intake was underreported in the group. The finding of low EI/BMRest in the present study is consistent with other published data using one 24-hour dietary recallReference Livingstone and Black15.
Using the Goldberg cut-off of EI/BMRest < 0.90 to classify LER, underreporters accounted for 13.6% of our study population. The percentage of underreporters observed in this study is consistent with or lower than that in other studies. Direct comparison of the magnitude of underreporting in different dietary studies is difficult because the definition used varies considerably, with cut-offs ranging from 0.9 to 1.55Reference Livingstone and Black15. The percentage of subjects who underreported their energy intake varied from 12 to 81% for men and 11 to 81% for womenReference Livingstone and Black15. The low percentage of underreporters may be explained by the fact that the Goldberg methodology used in this study provides a conservative estimate of low-energy reporting, because it does not identify those with high energy needs who might be reporting low energy as well. It identifies only those persons who are at the extreme end of the distribution and reports intakes that are not feasible to sustain a sedentary lifestyle. Use of the Goldberg method to estimate LER has considerable limitations. In a critical evaluation of the Goldberg technique Black et al.Reference Black27, Reference Black, Goldberg, Jebb, Livingstone, Cole and Prentice28 showed that the cut-off assesses overall bias well at group level, whereas the cut-off is limited by low sensitivity and poor specificity at the individual level. So the use of calculated energy requirement, as a proxy, may not be very satisfactory. Without a biomarker, the estimates of rates low- and high-energy reporting may not be very precise. Another factor contributing to imprecision in the estimates is the lack of information on physical activity. As noted by others (e.g. by Black), a measure of PAL is crucial when using a cut-point such as the Goldberg cut-off for the ratio of energy intake to energy expenditure. When the ratio is EI/BMRest, with no consideration of PAL some misclassification may occur unless there is little variation in activity levels across the group. We think that assuming an elderly population to be relatively inactive is reasonable.
The present study confirms that under- and overreporting is unevenly distributed in the population. Consistent with other studies, genderReference Gnardellis, Boulou and Trichopoulou8Reference Lafay, Basdevant, Charles, Vray, Balkau and Borys11–Reference Harrison, Galal, Ibrahim, Khorshid, Stormer and Leslie13Reference Livingstone and Black15Reference Becker, Foley, Shelley and Gibney17Reference Mendez, Wynter, Wilks and Forrester18 and BMIReference Gnardellis, Boulou and Trichopoulou8Reference Lafay, Basdevant, Charles, Vray, Balkau and Borys11–Reference Johansson, Solvoll, Bjorneboe and Drevon19 were predictors of misreporting. Whereas women were more likely to underreport energy intake, the prevalence of overreporting was higher in men. As observed in other studies, underreporting was more prevalent among obese peopleReference Gnardellis, Boulou and Trichopoulou8Reference Lafay, Basdevant, Charles, Vray, Balkau and Borys11–Reference Johansson, Solvoll, Bjorneboe and Drevon19. Among normal-weight, overweight and obese subjects, the prevalence of underreporting was 6, 13 and 27%, respectively. Conversely, overreporting decreased from 13% in normal-weight subjects to 4% in obese subjects.
The present data also indicate that smoking status and education level do not predict underreporting, which is consistent with some studiesReference Pomerleau, Ostbye and Bright-See14, Reference Johansson, Wikman, Ahren, Hallmans and Johansson16 but not othersReference Gnardellis, Boulou and Trichopoulou8Reference Lafay, Basdevant, Charles, Vray, Balkau and Borys11–Reference Johansson, Wikman, Ahren, Hallmans and Johansson16Reference Mendez, Wynter, Wilks and Forrester18Reference Johansson, Solvoll, Bjorneboe and Drevon19. The relationship between education level and misreporting is complex. Epidemiological studies indicated that underreporting of energy intake was more frequent in subjects with either a lowReference Gnardellis, Boulou and Trichopoulou8, Reference Johansson, Solvoll, Bjorneboe and Drevon19 or a highReference Lafay, Basdevant, Charles, Vray, Balkau and Borys11, Reference Mendez, Wynter, Wilks and Forrester18 education level. In our study, we found no association between LER and education level. This could possibly be explained by the fact that almost 60% of the population had a low educational level. On the other hand, in our study overreporting was more likely to occur in more highly educated subjects, which is consistent with other studiesReference Mendez, Wynter, Wilks and Forrester18.
In agreement with othersReference Pomerleau, Ostbye and Bright-See14 we also found a cultural difference in the reporting of nutrient intakes, with the percentage of underreporters being higher among Walloons compared with Flemish. In the Ontario Health Survey, Pomerleau et al.Reference Pomerleau, Ostbye and Bright-See14 found a higher prevalence of underreporting in those born in Asia compared with Canadian-born respondents.
The importance of underreporting depends on the technique used in food data collection. In an evaluation of 37 food intake studies, Black et al. showed that underreporting is more likely to occur when 24-hour recalls are used compared with dietary history and dietary record techniquesReference Black, Goldberg, Jebb, Livingstone, Cole and Prentice28.
The present data showed that subjects reporting implausibly low energy intake had lower mean intake of fat but higher mean intakes of protein and carbohydrates (expressed as a percentage of energy) than those reporting acceptable energy intake. Similar results have been reported previously showing that underreporters have diets more closely resembling dietary guidelinesReference Lafay, Basdevant, Charles, Vray, Balkau and Borys11Reference Pomerleau, Ostbye and Bright-See14–Reference Johansson, Solvoll, Bjorneboe and Drevon19. The current results indicate that underreporting affected all consumed food items (in terms of absolute intake). In terms of relative intake, the results show specific underreporting of energy-rich and micronutrient-poor foods such as sweets and overreporting of healthier foods as bread, fruit and vegetables. If this not accounted for, the proportion of the population meeting recommendations may be overestimated. For micronutrients, underreporting might lead to an overestimation of the proportion of the population not meeting certain recommendations. This is illustrated by a Swedish surveyReference Becker, Foley, Shelley and Gibney17.
Given the moderate response rate, we cannot exclude the possibility of bias. As we cannot ascertain how dietary attitudes or psychological characteristics of non-respondents might differ from those of respondents, it is unclear whether and how non-response may have affected our findings. However, comparison of some characteristics (age, sex, education, and some macronutrients collected at the first screening) between respondents and non-respondents showed no clear differences.
In summary, the results from this study in an elderly population support conclusions from the majority of other studies investigating misreporting in the general population. BMI seemed to be one of the most important factors in underreporting. This calls for to special attention when dietary surveys are performed on obese or lean people. At present, there is still no answer to the question of how to deal with misreporters. In general, it is not possible to exclude underreporters from further investigations. Therefore, it is important to characterise underreporters and keep those characteristics in mind when interpreting the data. The use of relative intakes and adjustment for misreporting may help to reduce bias in associations between food intakes and health outcomes.
Acknowledgements
The authors would like to thank the dietitians, Mrs M Bellemans, Mrs M De Maeyer and Mrs M Vanderelst, for their important contribution to the fieldwork and the data input. The original survey was financially supported by the National Fund for Scientific Research (fund no. 3.9002.79), the Ministry of Public Health (fund no. 160D1296) and the Institute of Public Health (fund no. 160A8993).
