Early-life nutrition has been established not only as a key component for the maintenance of lifelong health(Reference Koletzko, Brands and Poston1), but also as a major determinant of chronic diseases such as type 2 diabetes(Reference Hussain, Claussen and Ramachandran2), CVD(Reference Flock and Kris-Etherton3, Reference Osler4), obesity(Reference Johnson, Mander and Jones5, Reference Reilly, Armstrong and Dorosty6), hypertension(Reference Becton, Shatat and Flynn7, Reference Labarthe, Eissa and Varas8), allergies(Reference Rosenlund, Kull and Pershagen9, Reference Chatzi, Torrent and Romieu10) and certain cancers(Reference Vergnaud, Romaguera and Peeters11). Contrary to other risk factors, diet is potentially modifiable, especially in childhood. It is therefore important to assess dietary intake with valid tools in order to establish the role early nutrition plays in chronic disease promotion or prevention.
In large-scale population studies, it is a continuous challenge to assess diet during childhood. FFQ, 24 h recalls and food records (FR) are well-known dietary assessment instruments based on parental report(Reference Treiber, Leonard and Frank12). Although accurate, 24 h recalls and FR are time consuming and costly(Reference Watson, Collins and Sibbritt13). On the other hand, FFQ are designed to measure long-term intake and are a less expensive and lengthy option(Reference Kobayashi, Kamimura and Imai14, Reference Subar, Thompson and Kipnis15). In order to assess the relative validity of an FFQ, 24 h recalls and FR are usually used as they do not require participant literacy and provide high levels of specificity(Reference Koletzko, Brands and Poston1, Reference Watson, Collins and Sibbritt13, Reference Schatzkin, Kipnis and Carroll16, Reference Willett17).
The aim of the present study was to examine the relative validity of an FFQ designed for pre-school children aged 4 years in the region of Heraklion, Crete, Greece, against 3 d FR.
Methods
Validation study participants and design
The present study is a sub-project of the mother–child ‘Rhea’ study in Crete(Reference Chatzi, Plana and Daraki18). In summary, the Rhea study has been following a total of 1317 women and their offspring since 2007–2008. Healthy children participating in the Rhea cohort were invited to take part in the validation study when they came for their routine follow-up at 4 years (2011–2012), which included children’s dietary assessment via an FFQ. The Rhea cohort has obtained dietary information for mothers and children at different time points up to 4 years: during pregnancy, at 9 and 18 months postpartum and recently at 4 years. The mothers who agreed to participate in the validation study were asked to keep a 3 d weighed FR for their children. Of the 204 mothers who were invited to participate in the validation study, 104 completed the FR. Five of them did not complete the FR correctly and thus were excluded from the analysis. The final number of participants included in the validation study was ninety-nine children (fifty-one boys, forty-eight girls). Information on child and maternal characteristics such as weight, height, lifestyle characteristics, parity, marital status, smoking status and maternal education were gathered at enrolment and during the 4-year follow-up.
The study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects were approved by the ethical committee of the University Hospital in Heraklion, Crete, Greece. Written informed consent was obtained from all women participating in the study.
Dietary assessment
The Rhea follow-up FFQ is a newly developed questionnaire designed to assess habitual dietary intake in pre-school children. The Rhea follow-up FFQ was completed by telephone interview where parents were asked to recall their child’s diet for the previous year. The Rhea follow-up FFQ is a semi-quantitative questionnaire that asks about the intake of 118 food items. It also includes nine supplementary questions regarding type of meals during the day (breakfast, morning snack, lunch, afternoon snack, dinner, evening snack), use of dietary supplements (brand name of product, number of daily doses, time period of intake), type of fat used for cooking, medical conditions that can affect diet (i.e. high cholesterol), frequency of meals consumed in restaurants or takeaways, and television viewing during meals. The interviewer could also add anything else consumed by the child that was not included in the existing list of the 118 food items. Mothers could choose from one or two portion sizes, and reported the child’s frequency of intake (times per day, week, month or year, or never). Seasonality of consumption could also be reported in all food items.
In the validation study, the FR was self-administered by the participants who received the FR via post (including a prepaid envelope) together with instructions on how to complete it. Additional information and clarifications were provided by telephone. Parents were asked to feed their child his/her normal diet, to weigh and record all foods, beverages and dietary supplements consumed by their child during two consecutive weekdays and one weekend day, and were also asked to collect information about their child’s diet from the caregiver or day nursery. Upon collection, the FR were checked for completeness by a nutritionist.
Analysis of food consumption data
In the present study, FFQ and FR data were converted into daily intakes of foods and nutrients using the UK food tables (McCance & Widdowson’s The Composition of Foods, 6th summary edition) and standard Greek recipes for complex mixed dishes. For the FR, the mean of the three recording days was assessed. The dietary intake data were analysed by using a software program developed at the Department of Applied Information Technology and Multimedia, TEI-Crete, Heraklion, Crete, Greece.
Statistical analysis
Pearson’s χ 2 test for independence was used to compare the number of participants classified according to maternal education, marital status, residence, smoking status, parity and child gender in the validation study sample and the Rhea sample, as well as in the validation study sample and those who did not send back FR (non-responders). The Mann–Whitney U test was used to compare both maternal and child age and BMI. The nutrients presented in the current study were extracted from food sources only. The differences in food group and nutrient intakes between the Rhea follow-up FFQ and the FR were tested with the Wilcoxon signed-rank test in order to identify systematic bias. The relationship between the two dietary methods was assessed by using the Spearman rank correlation coefficient.
The agreement between the two methods was analysed as proposed by Bland and Altman(Reference Bland and Altman19), using a graphical technique and simple calculations for all nutrient and food group intakes. This was accomplished by plotting the differences in intakes between the FFQ and FR v. the mean intakes of the FFQ and FR. The 95 % limits of agreement (mean difference ±1·96 sd) show how well the two methods agree. This was performed for all nutrients and food groups, and some of the plots are presented herein. Following the graphical representation, when the standard error increased at higher measured values, the detection of heteroscedasticity was possible. The degree of heteroscedasticity was examined using Kendall’s tau correlation (τ) between the absolute differences and the mean of the two dietary methods. When τ>0·1 the data are heteroscedastic and when τ<0·1 or negative the data are homoscedastic.
Furthermore, agreement on a categorical level was examined by classification of food and nutrient intakes into the same (correct classification), adjacent or opposite tertiles (gross misclassification) by the FFQ and the FR for energy-adjusted intakes. The agreement between the two dietary methods was additionally assessed with the weighted kappa statistic (κ w) based on the Fleiss–Cohen quadratic weighting scheme and 95 % confidence intervals are presented(Reference Fleiss and Cohen20). The following ranges describe the different degrees of agreement: κ w=0·00 to 0·20 (slight agreement), κ w=0·21 to 0·40 (fair agreement), κ w=0·41 to 0·60 (moderate agreement), κ w=0·61 to 0·80 (substantial agreement) and κ w=0·81 to 1·00 (almost perfect agreement)(Reference Landis and Koch21).
All analyses were performed with crude data and energy-adjusted data using the residual method(Reference Willett22).
The significance level was set at 5 % and a two-sided alternative hypothesis. All statistical analyses were performed using the statistical software packages IBM SPSS Statistics version 20·0 and STATA SE version 13·0.
Results
The validation study participants were compared with the total population of the Rhea study (Table 1). No differences were found between these two groups regarding several sociodemographic characteristics such as maternal and child age, maternal education and origin, child gender, marital status, residence, maternal and child BMI and maternal parity. Similarly, no differences were found between the validation study participants and those who, though enrolled, did not send FR (non-responders), with the exception of smoking status (data not shown).
Characteristics of the participants included in the validation study of the mother–child ‘Rhea’ birth cohort, Heraklion, Crete, Greece, 2011–2012 and comparison with the total population of the Rhea study
Missing values have been excluded (pair-wise: validation study, Rhea): maternal education (n 0, n 52); Greek origin (n 0, n 12); marital status (n 0, n 49); residence (n 11, n 234); smoking status (n 11, n 232); parity (n 2, n 62); child gender (n 0, n 0).
* Statistically significant difference (P<0·05) based on Mann–Whitney U test for two independent samples and Pearson’s χ 2 test for independence.
The mean age of mothers participating in the current study was 33·6 years, 36·4 % of them were highly educated and the great majority were married and of Greek origin (87·9 % and 96·0 %, respectively; Table 1). The children participating in the validation study were 3·7 years old with a mean BMI of 16·5 kg/m2.
Table 2 presents the mean and median daily intakes of food groups and nutrients as assessed by the FFQ and the FR. In particular, the FFQ recorded higher intakes of vegetables, fruits, milk and eggs, while lower intakes were recorded for sugar preserves and confectionery, pulses, poultry and red meat. For all nutrients and food groups, according to the Wilcoxon signed-rank test, the mean difference between the methods (systematic bias) was not statistically significant. The average energy-adjusted correlation coefficient between the two dietary assessment methods for food groups was 0·380, ranging from r=0·109 for poultry to r=0·671 for milk. The mean and median intakes of all nutrients were larger when assessed by the FFQ than by the FR (Table 2). The average correlation between the two dietary assessment methods for nutrients was 0·315, ranging from r=0·099 for total fat to r=0·484 for vitamin B12 and iodine. The average energy-adjusted Spearman’s correlation coefficient reached statistical significance for almost all food groups and nutrients.
Daily food and nutrient intakes assessed by the FFQ and the 3 d food record (FR), and differences between both methods, among pre-school children (fifty-one boys and forty-eight girls) in the validation study of the mother–child ‘Rhea’ birth cohort, Heraklion, Crete, Greece, 2011–2012
IQR, interquartile range.
* Statistically significant Spearman’s r (P<0·05).
† Wilcoxon signed-rank test, adjusted for energy intake (P<0·05 indicates significance).
The differences between the FFQ and FR for absolute intakes of nutrients and foods were examined using Bland–Altman plots. The plots for all nutrients and food groups were similar to the plot for energy (Fig. 1(a)), fat (Fig. 1(d)) and carbohydrate intake (Fig. 1(e)). For all plots the 95 % limits of agreement indicated fairly good agreement between the two dietary methods, although for energy intake the limits of agreement were wide. The Bland–Altman analysis showed a positive mean difference, indicating that the FFQ recorded higher intakes than the FR. The plots for vegetable (Fig. 1(b)) and fruit intake (Fig. 1(c)) indicate a suspicion of data being heteroscedastic. This was examined using Kendall’s τ correlation, which was found not to be statistically significant for fruits (τ=−0·01; P=0·904) and vegetables (τ=0·08; P=0·112). Heteroscedasticity was tested for all nutrients and food groups with no significant results.
Bland–Altman plots showing the agreement between the FFQ and the 3 d food record (FR) in estimating daily nutrient and food group intakes among pre-school children (fifty-one boys and forty-eight girls) in the validation study of the mother–child ‘Rhea’ birth cohort, Heraklion, Crete, Greece, 2011–2012. The difference between the two methods (FFQ – FR) is plotted v. the mean of the two methods (FFQ + FR)/2), where ——— represents the mean difference between the two dietary methods and - - - - - represent the 95 % limits of agreement (LOA; corresponding to the mean difference±1·96 sd), for: (a) energy intake (mean difference=794 kJ and LOA=−2589 kJ, 4179 kJ); (b) vegetable intake (mean difference=61 g and LOA=−102 g, 225 g); (c) fruit intake (mean difference=45 g and LOA=−176 g, 226 g); (d) fat intake (mean difference=6 g and LOA=−42 g, 55 g); (e) carbohydrate intake (mean difference=25 g and LOA=−69 g, 120 g)
Cross-classification into tertiles showed that the percentage of participants correctly classified ranged from 37·3 % for Fe to 58·6 % for iodine, as regards nutrient intakes (Table 3). For food group intakes, the percentage of participants correctly classified ranged from 36·5 % for poultry to 58·5 % for both milk and fruits. On average, 89 % of children were classified by both methods into the same or adjacent tertiles according to their food group intakes and 87 % according to their nutrient intakes.
Cross-classification of participants by tertiles of calculated daily food group and nutrient intakes from the FFQ and the 3 d food record (FR) among pre-school children (fifty-one boys and forty-eight girls) in the validation study of the mother–child ‘Rhea’ birth cohort, Heraklion, Crete, Greece, 2011–2012
Correctly classified if classified into the same tertile and grossly misclassified if classified into opposing tertiles.
* Statistically significant κ w (P<0·05).
† κ w analysis of the agreement between the FFQ and the FR was undertaken on energy-adjusted data, using Fleiss–Cohen quadratic weight.
Overall, the agreement between the FFQ and the FR was generally moderate when tested with κ w (Table 3) since most food groups and nutrients reached statistical significance, although few moderate agreements were observed. After adjustment for total energy intake, the κ w values ranged from 0·12 (poultry) to 0·62 (milk) for the food groups and from 0·12 (SFA) to 0·48 (iodine) for the nutrients. Substantial agreement was observed for milk (κ w=0·62), while moderate agreement was observed for fruits, vitamin B12 and iodine (κ w=0·57, 0·44 and 0·48, respectively; Table 3).
Discussion
The present study is the first validation study of an FFQ addressed to pre-school children in Greece. The participants were selected from the population for which the questionnaire was designed, and there were no differences regarding sociodemographic characteristics between the study participants and the overall population of the Rhea cohort, with the exception of maternal smoking status.
The average correlations of energy-adjusted data between the FFQ and FR found in the present study (r=0·38 for food groups and r=0·31 for nutrients) are low to moderate but comparable to those reported in other validation studies. In a validation study conducted by Blum et al.(Reference Blum, Wei and Rockett23) on pre-school children aged 1–5 years, moderate correlations were reported for nutrients ranging from r=0·26 to r=0·63, while the average correlation was r=0·52. Similar correlations were found by Parrish et al.(Reference Parrish, Marshall and Krebs24), with range from r=0·33 to 0·42 for nutrients, in a study conducted in children aged 1–3 years. For older children aged 4–9 years, Wilson and Lewis(Reference Wilson and Lewis25) reported correlations from 0·40 to 0·55 for nutrients. Additionally, Treiber et al.(Reference Treiber, Leonard and Frank12) reported a mean correlation of 0·67 (range: r=0·42 to 0·83) for nutrients in a study of fifty-five children aged 3–5 years. Weaker correlations (r=0·48 for total energy, r=0·35 for total fat and r=0·37 for saturated fat) were observed in a study performed by Stein et al.(Reference Stein, Shea and Basch26), probably due to incorrect parental reports on dietary intake when children were not under their surveillance.
In our validation study, we found moderate agreement between the FFQ and FR as regards food groups and nutrients. Calculating solely correlations is not sufficient to give credence to the FFQ. Comparisons of tertiles are more informative than a correlation coefficient when reporting the capacity of an assessment method to rank persons with regard to their intake(Reference Garrow27). In our analysis, in spite of the relatively modest correlations between the two dietary methods, the Rhea follow-up FFQ and FR showed relatively good agreement in ranking participants based on their food and nutrient intakes. The degree of misclassification was overall small, while the majority of participants (88 %) were classified into the same or adjacent tertiles for both food groups and nutrients.
The moderate agreement found between the two dietary methods was also attested by the Bland–Altman technique. The plots for energy, fat and carbohydrate intakes suggest that the mean differences between the FFQ and FR are similar not only at low but also at high intakes, with the limits of agreement wide for energy intake. This was also observed in all plots for nutrients and food groups (data not shown), except for fruits and vegetables where the mean differences increased at high intake. Furthermore, the test for heteroscedasticity showed no significant correlations (P>0·05). Overall, the plots showed a small positive mean difference for food groups and nutrients between the two dietary methods, indicating that the Rhea 4 years FFQ tended to slightly overestimate food group and nutrient intakes compared with the FR. Nevertheless, the overestimation of nutrients suggested by the Rhea 4 years FFQ in the present study is in agreement with previous studies(Reference Treiber, Leonard and Frank12, Reference Parrish, Marshall and Krebs24, Reference Stein, Shea and Basch26).
The energy adjustment method was used in order to reduce dietary method error and to avoid misleading conclusions based on the differences found in total energy intake among participants. In fact, the energy-adjusted correlation coefficients were higher than the crude for almost all food groups and nutrients. In this analysis, we excluded those food groups with very low consumption (<50 % of study participants).
The degree of agreement between the FFQ and FR could also be affected by parameters such as time span covered by the dietary tool, the ability to record seasonality and day-to-day variability(Reference Cade, Thompson and Burley28). In particular, the great variation in dietary intake is more pronounced in children, leading to weakened agreement between the different dietary tools used(Reference Nelson, Black and Morris29). Finally, a limitation of validation studies is that they are not applicable to other populations(Reference Plummer and Kaaks30).
Conclusion
In summary, the present validation study indicates that the Rhea 4 years FFQ produces a realistic and relatively precise estimate of habitual intakes of food groups and nutrients among pre-school children in Crete, Greece.
Acknowledgements
Financial support: This project was co-financed by the European Union and the Hellenic Ministry of Health, ‘Program of prevention and early diagnosis of obesity and neurodevelopment disorders in preschool age children in the prefecture of Heraklion, Crete, Greece’ (NSRF 2007–2013 project, MIS 349580). The European Union and the Hellenic Ministry of Health & Social Solidarity had no role in the design, analysis or writing of this article. Conflict of interest: None. Authorship: V.L. was the field study co-coordinator, participated in the statistical analysis and wrote the first draft of the paper; V.G. supervised the statistical analysis and helped with the data interpretation and manuscript preparation; L.C. supervised the data collection and provided feedback and critical revision of the manuscript; K.S. participated in the design of the study, helped with data interpretation and manuscript preparation, and provided critical review of the manuscript. Ethics of human subject participation: The study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects were approved by the ethical committee of the University Hospital in Heraklion, Crete, Greece. Written informed consent was obtained from all women participating in the study.
