Hostname: page-component-7bb8b95d7b-l4ctd Total loading time: 0 Render date: 2024-10-05T18:56:22.190Z Has data issue: false hasContentIssue false

Validation of a semi-quantitative FFQ using food records as a reference in older women in the Kuopio Fracture Prevention Study (OSTPRE-FPS)

Published online by Cambridge University Press:  29 November 2011

Arja T Erkkilä*
Affiliation:
Institute of Public Health and Clinical Nutrition, Public Health, University of Eastern Finland, PO Box 1627, 70211 Kuopio, Finland
Ritva Järvinen
Affiliation:
Institute of Public Health and Clinical Nutrition, Clinical Nutrition, University of Eastern Finland, Kuopio, Finland
Henna Karvonen
Affiliation:
Institute of Public Health and Clinical Nutrition, Clinical Nutrition, University of Eastern Finland, Kuopio, Finland
Linda Keronen
Affiliation:
Institute of Public Health and Clinical Nutrition, Clinical Nutrition, University of Eastern Finland, Kuopio, Finland
Marjo T Tuppurainen
Affiliation:
Department of Obstetrics and Gynecology, Kuopio University Hospital, and Bone and Cartilage Research Unit, Clinical Research Center, University of Eastern Finland, Kuopio, Finland
*
*Corresponding author: Email arja.erkkila@uef.fi
Rights & Permissions [Opens in a new window]

Abstract

Objective

To validate an eighty-nine-item semi-quantitative FFQ for measurement of nutrient intakes in elderly women.

Design

FFQ and 3 d food records were filled in by women participating in the Kuopio Fracture Prevention Study (OSTPRE-FPS). Data on intakes of energy, fat, protein, carbohydrate, fibre, Ca, Fe, P, K, Mg, folic acid, vitamin B12, vitamin C, vitamin D and vitamin K from ninety-nine women were available to assess the agreement of the two methods. Validity was assessed using correlation coefficients, cross-classification into quintile categories and Bland–Altman plots. Nutrients relevant to bone health were assessed.

Setting

OSTPRE-FPS in Finland.

Subjects

Elderly women with a mean age 71·3 years.

Results

The FFQ overestimated energy and nutrient intakes as compared with food records by 30–50 %. The highest correlation coefficients of the energy-adjusted nutrient intakes between the methods were observed for fibre (0·60), Mg (0·56) and folic acid (0·49) and the lowest for protein and vitamin D (both 0·19). The cross-classification of energy-adjusted nutrient intakes showed that on average 68 % of the participants (range 62–78 %) were classified into the same or an adjacent quintile category.

Conclusions

The validity of energy and nutrient intakes measured with the FFQ was moderate as compared with 3 d food records in elderly women. The FFQ is a useful tool for the nutrient assessment of elderly women in epidemiological research.

Type
Research paper
Copyright
Copyright © The Authors 2011

Few studies have estimated the use and validity of FFQ in nutrient intake estimation in elderly populations(Reference Dumartheray, Krieg and Cornuz1Reference Klipstein-Grobusch, den Breeijen and Goldbohm3). However, determining nutrient intakes is critical in examining the effect of nutrition on health and disease. The FFQ is a useful tool to estimate long-term habitual dietary intake, can be self-administered and is relatively inexpensive. However, an FFQ should be tested in the specified population group before use(Reference Cade, Thompson and Burley4). Food records are a suitable reference method for assessing the validity of an FFQ because the errors associated with the two methods are independent(Reference Willett5).

The present study examined the nutrient intakes measured in the Kuopio Fracture Prevention Study (OSTPRE-FPS). Therefore, especially the nutrients related to bone health were of interest in the validation. Our aim was to develop a semi-quantitative FFQ for elderly women and to evaluate the relative validity of nutrient intakes estimated by the FFQ as compared with 3 d food records.

Experimental methods

Participants

Participants were recruited from the OSTPRE-FPS(Reference Kärkkainen, Tuppurainen and Salovaara6), which aims to examine the effect of Ca and vitamin D supplements on falls and fractures in women aged over 65 years during a 3-year intervention. The total number of women in the study was 3432, of whom 750 were randomly selected for a subsample participating in detailed examinations including measurement of bone mineral density and dietary records and FFQ. Dietary data used in the present study were collected at study year 3 (between April 2006 and June 2006). The convenience sample in the validation study included 102 women. Three were excluded from the analyses due to high energy intake >14·7 MJ/d (3500 kcal/d) in the FFQ, leaving ninety-nine women with food record and FFQ data.

The mean age of the women was 71·3 years in the validation study (sd 1·7, min 68·5, max 74·3 years). The mean height, weight and BMI of the women were 158 (sd 5) cm, 71·2 (sd 11·6) kg and 28·4 (sd 4·8) kg/m2, respectively. The participants lived Kuopio Province including rural and urban areas.

The ethics committee of Kuopio University Hospital approved OSTPRE-FPS. The trial was registered at Clinicaltrials.gov under identifier NCT00592917 (registration date: 2 January 2008).

Food records

Current diet was assessed using 3 d food records including two consecutive weekdays and one weekend day. The instructions to complete a food record were mailed to the participants beforehand and they returned the records on a research visit at the Bone and Cartilage Research Unit (BCRU) at the University of Kuopio. Participants were instructed to write down everything they ate and drank and to evaluate the amount of food using household measures. The types of fats used on bread, in cooking and in baking were asked separately. In case of uncertainties in the food record, a nutritionist called the participant for more information.

Nutrient intakes were calculated using Diet32 software version 1·40 (Aivo Finland Oy, Turku, Finland). The Finnish food composition database, Fineli, was used in the calculations (National Institute for Health and Welfare, Helsinki, Finland).

FFQ

The FFQ was designed based on previous data on food consumption derived using food records in the same sample of Finnish elderly women at the baseline examination. The contributions of different food groups to energy, fat, vitamin and mineral intakes were evaluated and used to make the food list. Portion sizes for the FFQ were determined based on previous food records and an earlier Finnish FFQ(Reference Paalanen, Männistö and Virtanen7). Previous FFQ from the Finnish Health 2000 study(Reference Paalanen, Männistö and Virtanen7), the British Aberdeen Prospective Osteoporosis Screening Study (APOSS)(Reference Macdonald, New and Fraser8) and the Swiss Evaluation of Nutrient Intake and Bone Ultra Sound (EVANIBUS) study(Reference Dumartheray, Krieg and Cornuz1) were used in developing the questionnaire structures. The FFQ included fourteen pages and eighty-nine food items. The FFQ was designed to measure habitual food intake. The FFQ were given to the participants at the visit to the BCRU and they mailed the filled FFQ back using a prepaid envelope. Again, the nutritionist telephoned the participant if more information was needed.

The eighty-nine food items were classified as cereal products; dairy products; potato, rice and pasta; meat and poultry; fish and egg; food preparation and sauces; vegetables; fruit and berries; drinks; and sweets and snacks. All of the food groups contained an empty line for participants to add foods not listed. There were nine frequency options ranging from ‘never or rarely’ to ‘over 5 times per day’. The type and amount of bread and fat spread were asked in more detail.

Daily nutrient intakes were calculated by multiplying the nutrient content per serving of each food item by the reported frequency of consumption and summing over all foods. Intake from supplements was not included in the calculated nutrient amounts. The nutrient contents were obtained from the Finnish food composition database, Fineli (National Institute for Health and Welfare). Nutrients calculated in the validation included protein, fat, carbohydrate, fibre, K, Ca, P, Mg, Fe, folic acid, and vitamins B12, C, D and K.

Assessment of under-reporting at group level

For evaluation of the plausibility of dietary intake data, the ratio of energy intake (EI) to estimated basal metabolic rate (BMRest) was calculated. BMRest was calculated based on body weight according to equations given by the Department of Health in the UK(9). The EI:BMRest cut-off value for under-reporting was chosen to be 1·49, as derived from Goldberg et al.(Reference Goldberg, Black and Jebb10) and Black(Reference Black11).

Statistical analyses

All data analyses were performed using the SPSS statistical software package version 14·0 (SPSS Inc., Chicago, IL, USA). The nutrient intakes were adjusted for energy intake using the residual method(Reference Willett and Stampfer12). Normality of the variables was tested by the Kolmogorov–Smirnov test. Pearson correlation coefficients were calculated to compare the two dietary assessments. In calculating the correlations log-transformed nutrient intakes were used to improve normality. The difference between the nutrient intakes from the two methods was tested using the paired-samples t test. The women were classified into quintile categories of nutrient intakes and the percentage classified into the same, an adjacent or the opposite quintile category was calculated. Bland–Altman plots were used to determine if the difference in intake between the FFQ and food records varied depending upon the average nutrient intake(Reference Bland and Altman13). The limits of agreement (mean difference ± 1·96 sd of the difference between the methods) indicate whether the agreement is acceptable on an individual level.

Results

The mean nutrient intakes were higher when measured with the FFQ than with food records (Table 1). The least overestimation was observed for fat intake, 28 %, and most of the nutrients were overestimated by 30–50 %. Intakes of vitamins C and K were overestimated the most. The differences in the intakes of energy and energy-adjusted nutrients between the two methods were statistically significant for all of the nutrients (paired-samples t test, P < 0·05).

Table 1 Comparison of daily nutrient intakes as measured by the FFQ and food records and correlation between the two methods (n 99): elderly women (mean age 71·3 years) in the Kuopio Fracture Prevention Study (OSTPRE-FPS), Finland

N/A, not applicable.

*Pearson correlation coefficients calculated for log-transformed energy-unadjusted and -adjusted values were significant for all nutrients (P ≤ 0·01), except for energy-adjusted protein and vitamin D intakes (P = 0·055 and P = 0·056, respectively).

†Calculated from energy-adjusted values.

Using the energy-unadjusted intakes, the lowest Pearson correlation coefficients were observed for protein (r = 0·26) and vitamin D (r = 0·29), whereas the highest correlations were found for Mg (r = 0·56) and fibre (r = 0·55; Table 1). Energy adjustment worsened the correlations for protein and vitamin D intakes (r = 0·19 for both). The correlations improved for fibre, P and Ca with energy adjustment. When using the energy-adjusted nutrient intakes, the highest correlation coefficients were observed for fibre (r = 0·60), Mg (r = 0·56) and folic acid (r = 0·49).

The participants were divided into quintile categories of energy and energy-adjusted nutrient intakes as measured by the FFQ and food records to evaluate the ability of the methods to classify participants similarly. The average proportion of participants classified into the same quintile category was 31 % (Table 2). When the classification into the same or an adjacent quintile category was considered the average proportion of participants was 68 %. The highest proportion of women classified into the same or an adjacent quintile category was observed for fibre, K, Mg, Fe and folic acid intakes. The highest proportion of grossly misclassified participants was observed for vitamin D and protein intakes.

Table 2 Classification of energy intake and energy-adjusted nutrient intakes into the same, adjacent or opposite quintile categories (n 99): elderly women (mean age 71·3 years) in the Kuopio Fracture Prevention Study (OSTPRE-FPS), Finland

The Bland–Altman plots show the average and agreement limits of the difference in energy and energy-adjusted nutrient intakes plotted against their mean (Fig. 1). For most of the nutrients the differences in intake were quite well within the 95 % agreement limits. For energy and vitamin D, the agreement was poorer when the average intake was higher.

Fig. 1 Bland–Altman plots for intake of (a) energy, (b) protein, (c) fat, (d) carbohydrate, (e) calcium and (f) vitamin D measured with the FFQ and the 3 d food record, showing the difference in the energy or energy-adjusted nutrient intake between the methods plotted against the average energy or energy-adjusted nutrient intake based on both methods, among elderly women (mean age 71·3 years) in the Kuopio Fracture Prevention Study (OSTPRE-FPS), Finland. The mean (——) and the limits of agreement (- - - -) for the differences are shown

Discussion

We evaluated the relative validity of energy and nutrient intakes estimated by a semi-quantitative FFQ as compared with a 3 d food record in free-living elderly Finnish women. We included especially nutrients relevant to bone health in the validation. We are not aware of any other FFQ specifically validated to be used in elderly subjects in Finland.

The FFQ overestimated energy and nutrient intakes as compared with the food records. Overestimation of energy and nutrient intakes is common when using FFQ and has been reported earlier in Finnish adult populations(Reference Paalanen, Männistö and Virtanen7, Reference Erkkola, Karppinen and Javanainen14) and in a Dutch elderly population(Reference Klipstein-Grobusch, den Breeijen and Goldbohm3). Two other studies in postmenopausal or elderly women have reported no significant differences in nutrient intakes measured with food records and FFQ(Reference Dumartheray, Krieg and Cornuz1, Reference Farrell, Harris and Lohman2). It is also noteworthy that food records are prone to under-reporting, which was indicated by the mean ratio of EI:BMRest being 1·23 for food records, below the cut-off value (1·49). It has been suggested that a cut-off value of 1·2 is suitable for chair-bound or bed-bound individuals(Reference Black11), which was barely met by the food record estimates. For the FFQ, the mean ratio of EI:BMRest (1·60) was above the cut-off value. A slightly lower ratio (1·46) was reported earlier in 55- to 75-year-old women(Reference Klipstein-Grobusch, den Breeijen and Goldbohm3) and even lower (1·24) in 75- to 87-year-old women(Reference Dumartheray, Krieg and Cornuz1).

The validation correlation coefficients are similar to those reported earlier in elderly(Reference Dumartheray, Krieg and Cornuz1, Reference Farrell, Harris and Lohman2, Reference Smith, Mitchell and Reay15) and in Finnish studies(Reference Paalanen, Männistö and Virtanen7, Reference Erkkola, Karppinen and Javanainen14). In agreement with our results the correlation coefficients have been low for protein(Reference Paalanen, Männistö and Virtanen7, Reference Smith, Mitchell and Reay15) and vitamin D(Reference Dumartheray, Krieg and Cornuz1) in previous studies. Portion size estimation in food records and FFQ is difficult for non-countable protein-containing foods like meat and fish. This might have affected the low correlation of protein intakes even though its overestimation with the FFQ was similar to that of other nutrients. Fish, which is a major dietary source of vitamin D(Reference Paturi, Tapanainen and Reinivuo16), is consumed once or twice weekly. Thus the 3 d food record is not optimal for capturing the habitual fish intake and the validity is likely to be lower than for nutrients derived from multiple sources daily. The FFQ has been suggested to be a valid tool to estimate the intake of occasionally or episodically consumed foods(Reference Paalanen, Männistö and Virtanen7). According to the FFQ, almost half of the vitamin D came from fish and fish products (4·7 μg/d).

The validity of measuring fibre intake was good as indicated by correlation coefficients and cross-classification. Similarly, earlier studies have reported good agreement between the two methods for assessment of fibre intake(Reference Dumartheray, Krieg and Cornuz1, Reference Farrell, Harris and Lohman2, Reference Paalanen, Männistö and Virtanen7, Reference Erkkola, Karppinen and Javanainen14, Reference Smith, Mitchell and Reay15). Questions asking about the type and amount of bread were detailed, which could have contributed to the strong correlation of fibre intakes. Bread contributes a significant proportion of fibre intake in Finland (approximately 40 % from bread in 65- to 74-year-old women)(Reference Paturi, Tapanainen and Reinivuo16). Furthermore, significant proportions of Mg and P are derived from cereal products and the validity of their intake was good in the present study.

In estimation of diet and disease associations ranking of individuals according to their nutrient intakes is critical. We observed that ranking of individuals was adequate based on the cross-classification for the majority of the nutrients. Substantial gross misclassification occurred only for vitamin D and protein intakes. The poor classification of vitamin D and protein was also apparent by values not meeting the agreement limits in Bland–Altman plots. Of note is that also for vitamin K intake the ranking was valid, even though the absolute intakes poorly agreed. This has also been reported earlier(Reference Presse, Shatenstein and Kergoat17). Green salads, chicken and vegetable soups were the most important sources of vitamin K in the FFQ. It is likely that vegetable use is overestimated by the FFQ, and episodically consumed vegetables are poorly accounted for in food records(Reference Paalanen, Männistö and Virtanen7, Reference Presse, Shatenstein and Kergoat17).

The number of women in the validation study can be considered reasonable(Reference Willett5). Furthermore, many elderly women have regular dietary habits, which facilitates filling out an FFQ(Reference Paalanen, Männistö and Virtanen7). Portion sizes are typically smaller in elderly women than in adults. Portion sizes in our FFQ were smaller than the average adult portion sizes(Reference Sääksjärvi and Reinivuo18). Nevertheless, we cannot exclude the possibility that the portion sizes were too big for the population and contributed to the overestimation of nutrient intakes. Furthermore, repeating the food records could have improved the agreement between the two methods. Food records and FFQ were collected in spring and early summer. Thus, we were not able to estimate the seasonal variation in dietary intake. Earlier it has been reported that consumption of leafy vegetables and vegetable fruits is higher in spring and summer in Finland(Reference Prasad, Lumia and Erkkola19).

In conclusion, the FFQ overestimated absolute nutrient intakes. However, the FFQ is a valid tool for ranking individuals according to their nutrient intakes. The FFQ can be used to classify elderly women according to their nutrient intakes for research purposes in Finland.

Acknowledgements

The OSTPRE-FPS was supported by the Academy of Finland (M.T.T.), a Kuopio University Hospital EVO grant and by Leiras-Nycomed Ltd for the Ca and vitamin D supplementation. The authors do not have a conflict of interest. M.T.T. was responsible for the original OSTPRE-FPS design. A.T.E., R.J. and H.K. planned the validation study and the FFQ. L.K. performed the nutrient calculations. A.T.E. was responsible for the data analyses and writing the first draft. A.T.E., R.J. and L.K. contributed to the data interpretation. All authors contributed to revising the manuscript and approved the final version. The authors thank Susan Lanham-New for her advice in the FFQ development.

References

1.Dumartheray, EW, Krieg, M, Cornuz, J et al. (2006) Validation and reproducibility of a semi-quantitative food frequency questionnaire for use in elderly Swiss women. J Hum Nutr Diet 19, 321330.CrossRefGoogle ScholarPubMed
2.Farrell, VA, Harris, M, Lohman, TG et al. (2009) Comparison between dietary assessment methods for determining associations between nutrient intakes and bone mineral density in postmenopausal women. J Am Diet Assoc 109, 899904.CrossRefGoogle ScholarPubMed
3.Klipstein-Grobusch, K, den Breeijen, JH, Goldbohm, RA et al. (1998) Dietary assessment in the elderly: validation of a semiquantitative food frequency questionnaire. Eur J Clin Nutr 52, 588596.CrossRefGoogle ScholarPubMed
4.Cade, J, Thompson, R, Burley, V et al. (2002) Development, validation and utilisation of food-frequency questionnaires – a review. Public Health Nutr 5, 567587.CrossRefGoogle ScholarPubMed
5.Willett, W (1998) Nutritional Epidemiology, 2nd ed. New York: Oxford University Press.CrossRefGoogle Scholar
6.Kärkkainen, M, Tuppurainen, M, Salovaara, K et al. (2010) Effect of calcium and vitamin D supplementation on bone mineral density in women aged 65–71 years: a 3-year randomized population-based trial (OSTPRE-FPS). Osteoporosis Int 21, 20472055.CrossRefGoogle Scholar
7.Paalanen, L, Männistö, S, Virtanen, MJ et al. (2006) Validity of a food frequency questionnaire varied by age and body mass index. J Clin Epidemiol 59, 9941001.CrossRefGoogle ScholarPubMed
8.Macdonald, HM, New, SA, Fraser, WD et al. (2005) Low dietary potassium intakes and high dietary estimates of net endogenous acid production are associated with low bone mineral density in premenopausal women and increased markers of bone resorption in postmenopausal women. Am J Clin Nutr 81, 923933.CrossRefGoogle ScholarPubMed
9.Department of Health (1991) Dietary Reference Values for Food Energy and Nutrients for the United Kingdom. London: HMSO.Google Scholar
10.Goldberg, GR, Black, AE, Jebb, SA et al. (1991) Critical evaluation of energy-intake data using fundamental principles of energy physiology 1. Derivation of cutoff limits to identify under-recording. Eur J Clin Nutr 45, 569581.Google ScholarPubMed
11.Black, AE (2000) Critical evaluation of energy intake using the Goldberg cut-off for energy intake:basal metabolic rate. A practical guide to its calculation, use and limitations. Int J Obes Relat Metab Disord 24, 11191130.CrossRefGoogle ScholarPubMed
12.Willett, W & Stampfer, MJ (1986) Total energy intake: implications for epidemiologic analyses. Am J Epidemiol 124, 1727.CrossRefGoogle ScholarPubMed
13.Bland, J & Altman, D (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1, 307310.CrossRefGoogle ScholarPubMed
14.Erkkola, M, Karppinen, M, Javanainen, J et al. (2001) Validity and reproducibility of a food frequency questionnaire for pregnant Finnish women. Am J Epidemiol 154, 466476.CrossRefGoogle ScholarPubMed
15.Smith, W, Mitchell, P, Reay, EM et al. (1998) Validity and reproducibility of a self-administered food frequency questionnaire in older people. Aust N Z J Public Health 22, 456463.CrossRefGoogle ScholarPubMed
16.Paturi, M, Tapanainen, H, Reinivuo, H et al. (editors) (2008) Finravinto 2007 -tutkimus (The National FINDIET 2007 Study). Helsinki: National Public Health Institute.Google Scholar
17.Presse, N, Shatenstein, B, Kergoat, M et al. (2009) Validation of a semi-quantitative food frequency questionnaire measuring dietary vitamin K intake in elderly people. J Am Diet Assoc 109, 12511255.CrossRefGoogle ScholarPubMed
18.Sääksjärvi, K & Reinivuo, H (2004) Ruokamittoja (Guide on Food Portions). Report B15/2004. Helsinki: National Public Health Institute.Google Scholar
19.Prasad, M, Lumia, M, Erkkola, M et al. (2010) Diet composition of pregnant Finnish women: changes over time and across seasons. Public Health Nutr 13, 939946.CrossRefGoogle ScholarPubMed
Figure 0

Table 1 Comparison of daily nutrient intakes as measured by the FFQ and food records and correlation between the two methods (n 99): elderly women (mean age 71·3 years) in the Kuopio Fracture Prevention Study (OSTPRE-FPS), Finland

Figure 1

Table 2 Classification of energy intake and energy-adjusted nutrient intakes into the same, adjacent or opposite quintile categories (n 99): elderly women (mean age 71·3 years) in the Kuopio Fracture Prevention Study (OSTPRE-FPS), Finland

Figure 2

Fig. 1 Bland–Altman plots for intake of (a) energy, (b) protein, (c) fat, (d) carbohydrate, (e) calcium and (f) vitamin D measured with the FFQ and the 3 d food record, showing the difference in the energy or energy-adjusted nutrient intake between the methods plotted against the average energy or energy-adjusted nutrient intake based on both methods, among elderly women (mean age 71·3 years) in the Kuopio Fracture Prevention Study (OSTPRE-FPS), Finland. The mean (——) and the limits of agreement (- - - -) for the differences are shown