In nutrition research, a major limitation is the notorious difficulty in measuring dietary intake with techniques that are precise, accurate and applicable to large numbers of free-living individuals( Reference Paeratakul, Popkin and Kohlmeier 1 , Reference Day, Wong and Bingham 2 ). All dietary assessment methods have strengths and limitations which need to be considered when choosing a dietary assessment method and analysing data in a study. Since erroneous food intake data could lead to false interpretations when evaluating diet–disease associations or calculating toxicological hazards, it is of major importance that the dietary assessment tools used in large population studies are up to date and validated for what they are intended to measure( Reference Margetts and Nelson 3 ).
Food records have long been considered the most accurate and detailed method for measuring dietary intake( Reference Barrett-Connor 4 , Reference Gibson 5 ). A major advantage with food records is the open format, which makes it possible to capture detailed information on food choices and timing of eating during the registration period. However, a few recording days may not be representative of habitual food intake or seasonal variations unless repeated several times over the year( Reference Champagne, Han and Bajpeyi 6 , Reference Tarasuk and Beaton 7 ). In addition, food records are time consuming for both participants and staff and are therefore expensive to administer in large-scale studies, and there is also the possibility that participants might deviate from their normal eating habits during the recording days. In contrast, FFQ are relatively easy to apply and the time burden is reduced for both participants and study staff. FFQ are therefore commonly used in large-scale epidemiological studies despite being less accurate and detailed. In recent years, the integration of repeated 24-h recalls together with FFQ has been discussed as a solution to improve the level of dietary data obtained( Reference Subar, Dodd and Guenther 8 ).
Advances in technology have enabled the development of innovative ways of measuring food intake and new methods have been developed which allow participants to report their dietary intake via the web( Reference Biltoft-Jensen, Trolle and Christensen 9 – Reference Lu, Pearson and Renker 12 ). There are many advantages with collecting data via the web compared with using traditional paper-based methods. It is easy for the study participants to access the questionnaire at any time and location, and time is saved when the participants enter their information themselves. In addition, there is no need of coding the data. The rapid improvements in advanced technology could potentially improve the quality of collected dietary data, and one major challenge lies in the development of methods that manage to minimise under-reporting of dietary intake. However, so far only a few web-based dietary assessment tools have been validated against objectively measured energy expenditure using the ‘gold standard’, doubly labelled water (DLW) technique.
Recently, two web-based dietary assessment methods have been developed for use in large-scale studies: the Riksmaten method, which is a web-based 4-d food record, and the more rapid food-frequency method MiniMeal-Q( Reference Christensen, Moller and Bonn 13 , Reference Christensen, Moller and Bonn 14 ). The Riksmaten method was developed for the national dietary surveys in Sweden and has so far only been validated on diet quality parameters( Reference Warensjo Lemming, Nalsen and Becker 15 , Reference Nybacka, Lindroos and Wirfält 16 ). MiniMeal-Q was developed for use in large-scale epidemiological studies and has previously been validated on energy, and macro- and micronutrients using truncated data from the longer-version Meal-Q. The validation process was performed in a relatively young (mean age 33 years), highly educated and predominantly female group and the objective validation with DLW showed a correlation on r 0·38 on energy intake (EI)( Reference Christensen, Moller and Bonn 13 ). Both methods are currently widely used in epidemiological research and there is a need to validate these two methods in a middle-aged population with participants living in areas with different socio-economic status (SES). Thus, the aim of this study was to validate these two methods by reported EI against objectively measured total energy expenditure (TEE) using the DLW technique. A relative comparison of the two methods on reported energy and macronutrient intake was also performed.
Materials and methods
Study population
This study takes advantage of the extensive collection of clinical data, blood samples and dietary data assembled during 2012 within the pilot study of SCAPIS (Swedish CArdioPulmonary bioImage Study)( Reference Bergström, Berglund and Blomberg 17 ). Men and women aged 50–64 years from the Gothenburg general population were invited to participate in the SCAPIS pilot study. A computerised random selection was made from two different areas in Gothenburg, which were classified as either low or high SES, respectively. A total of 2243 men and women were invited and 1111 men and women gave informed consent to participate in the pilot study, which included comprehensive clinical measurements, anthropometry, bioimaging and blood sampling during the time period from February 2012 to December 2012. Participants who had finished all clinical examinations, and who were expected to be recruited within the time frame of 5 weeks from the baseline examinations of the SCAPIS pilot study, received a letter inviting them to take part in the SCAPIS diet substudy at the Department of Internal Medicine and Clinical Nutrition, Sahlgrenska Academy. No exclusion criteria were applied for the initial recruitment, but it was a prerequisite to understand written Swedish for the diet substudy. The SCAPIS diet substudy aimed to validate two dietary assessment methods used in the SCAPIS study, by recruiting 100 women and 100 men consecutively during April to December 2012. In total, 237 (42 %) out of 574 invited subjects agreed to participate in the SCAPIS diet substudy, of whom forty-three also agreed to measure TEE with DLW. Of all requested participants, more women than men (46 v. 36 %), as well as participants living in high-SES compared with low-SES areas (49 v. 32 %), agreed to participate. In the final analyses 200 participants were eligible, of whom forty subjects (twenty women and twenty men, 53 % of high SES) also measured TEE with DLW (Fig. 1).
Flow chart of recruitment of participants to the Swedish CArdioPulmonary bioImage Study (SCAPIS) diet substudy. TEE, total energy expenditure; DLW, doubly labelled water.
Study design
Participants enrolled in the diet substudy were invited to a 1 h group meeting with a dietitian. At the visit participants first completed MiniMeal-Q, and were thereafter given instructions on how to complete the Riksmaten method at home during the oncoming week. Participants who had agreed to take part in the DLW substudy were invited to a revisit 14 d later. The TEE was thus measured during the same time period as the food recording, while the FFQ reflected the period of the past few months before the measurement. Participants were told to maintain a ‘normal’ activity level and diet during the study period. All data regarding anthropometry and background characteristics (Table 1) were collected at the SCAPIS pilot study examinations, whereas the main focus of the diet substudy was to collect dietary data. This study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects were approved by the Gothenburg Regional Ethics Committee. Written informed consent was obtained from all subjects.
Characteristics of the study population in the Swedish CArdioPulmonary bioImage Study (SCAPIS) diet substudy*
(Mean values and standard deviations; numbers and percentages)
DLW, doubly labelled water; SES, socio-economic status.
* Data assembled within the SCAPIS pilot study.
† Missing data; smoking (n 1).
Doubly labelled water
TEE was determined by the DLW technique. In weight-stable individuals TEE is equal to total EI, and therefore DLW provides an objective measure of TEE in free-living individuals( Reference Schoeller 18 ). The DLW procedure has been described in detail elsewhere( Reference Slinde, Ellegard and Gronberg 19 ). In short, at the first visit body weight was measured and a spot urine sample was collected from each participant for determination of background isotope enrichment. Thereafter, an oral dose of DLW was administered of 1 g DLW/kg, corresponding to 0·05 g of 2H-labelled water (99·9 %) and 0·10 g of 18O-labelled water (10 %) per kg body weight. Because of the decreasing total body water content with increasing BMI, men with BMI >30 kg/m2 were given a dose of 0·6 g DLW/kg and women a dose of 0·5 g DLW/kg. The dose was flushed down the throat with a glass of tap water. A total of five 30 ml urine samples were collected; one prior to receiving the oral dose of DLW as reference, and four more at days 1, 3, 12 and 14. Participants were instructed to collect the second voiding of the day, to note down the exact time when the urine samples were collected and to seal the caps immediately after sampling. The last four samples were stored in the household freezer by each participant until the study end. Weight was also measured after the study period had ended to ensure weight maintenance. A weight difference of ±1 kg was considered to be acceptable as a reflection of normal biological variations in body weight. All analyses were made at Department of Internal Medicine and Clinical Nutrition in Gothenburg. Measurements of tap water, diluted administered dose, background enrichment and urine samples were performed in triplicate on a Finnigan MAT Delta Plus Isotope-Ratio Mass Spectrometer (ThermoFinnigan). Total daily energy expenditure was calculated by the multipoint method from the difference between elimination constants of hydrogen and oxygen, by linear regression, with the assumptions for fractionating as suggested by International Atomic Energy Agency( 20 ). All elimination curves were checked for major diverging residuals. The relationship between pool size 2H and pool size 18O was used as a quality measurement of the technique.
The Riksmaten method
The Riksmaten method is a web-based 4 d food record, developed by the Swedish National Food Agency (NFA) prior to the Swedish national dietary survey in adults, Riksmaten 2010–2011( 21 ). The food list in the web tool (version 04.1) consisted of 1909 different food items and dishes, which are linked to the Swedish food composition database (Livsmedelsdatabasen, version Riksmaten adults 2010–2011) at the NFA, which enables automatic estimation of energy and nutrient intake. A simplified version of the Riksmaten method is to be found in Swedish at the NFA website( 22 ). To estimate portion sizes a portion guide was used which consisted of twenty-four different food categories, with four to eight different reference sizes in each category. It was available in the web tool as well as a printed portion guide. Participants received a personalised login to enter the web tool and were told to record all food and drinks consumed, and to estimate a portion size for each item according to the previously described portion guide. Dietary supplements taken during the recording days were reported in a separate form on the website. It was optional to enter the food intake via the web (which they were encouraged to do continuously), or to report the intake by telephone to the study dietitian. The printed portion guide, a paper diary and an information folder on how to keep food records were given to the participants. To ensure a more equal distribution among weekdays registered, participants were told to begin their registration either on the next coming Tuesday, Wednesday or Saturday. At 2 d after the diet record had begun, all participants were contacted by the dietitian by telephone to enhance compliance and provide an opportunity to ask questions. Based on the recorded intake of food and drinks, the average energy and nutrient intake per d was calculated for the current analyses. Participants also completed two questions about their physical activity level during the past 12 months at work and leisure time separately, on a four-grade scale. After completion all data were examined, and to be considered as an approved record at least two energy-containing meals a day should have been recorded. After submitting their registrations, participants received an overview of their energy and macronutrient intake as well as intake of selected micronutrients. Participants who reported their food intake by telephone received the same information by regular mail.
MiniMeal-Q
The web-based FFQ MiniMeal-Q used in the study is a short form of Meal-Q( Reference Christensen, Moller and Bonn 13 ). The Meal-Q was developed at Institute of Medical Epidemiology and Biostatistics, Karolinska Institute, Sweden, and shortened to MiniMeal-Q for the LifeGene-project( Reference Almqvist, Adami and Franks 23 ). The questionnaire is self-administered, semi-quantitative and contains questions about meal patterns and portion sizes. It was developed to include follow-up questions only on food items that had been consumed at least once per month. The questionnaire consists of both single foods and mixed dishes and covers a time period of the past few months. Because of its dynamic structure, it includes between seventy-five to 126 food items. Most questions have an optional answering frequency in a nine-grade scale from ‘five times a day’ to ‘one-to-three times a month’. For the estimation of portion sizes on cooked dishes, five different photo-options are presented for: (1) meat, chicken, fish and vegetarian substitutes; (2) potatoes, rice and pasta; and (3) vegetables (both raw and cooked). Other foods are calculated by standard portion sizes. All dietary data were linked to the Swedish food composition database (Livsmedelsdatabasen, version 2012-01-06) and calculated as the average intake of unit/d.
Statistical analysis
Characteristics for the whole study population and the subgroup that underwent DLW analyses, as well as comparisons between participants living in low- and high-SES areas, were compared using two-sided t test for equal means for continuous, normally distributed variables, independent-samples Mann–Whitney U test for non-normally distributed variables and χ2 test for categorical variables. EI from the Riksmaten method and MiniMeal-Q was pairwise compared with TEE measured with DLW (TEEDLW), and presented as the mean of the absolute difference (EI – TEEDLW) and percentage of reporting accuracy (EI:TEEDLW × 100). Under-reporting of EI was based on the 95 % confidence limits of expected EI:TEE of 1( Reference Black and Cole 24 ). The 95 % confidence limits were calculated as:
$$\pm\! 2 \times \surd [{\rm C}{\rm V}^2_{{\rm TEE}} + ({\rm C}{\rm V}^2_{{\rm EI}} /d)]\comma$$
where CVTEE is the within-subject CV for TEE (8·4 %) based on a time span of 2 weeks( Reference Almqvist, Adami and Franks 23 ), d is the number of days from food record (4 d) and CVEI is the within-subject CV for EI from food record (20·6 %). This gives an interval where participants were considered as under-reporters of EI at EI:TEE <0·73, and over-reporters at EI:TEE >1·27 for the Riksmaten method. For FFQ the number of days is taken as infinite, whilst only CVTEE is taken into account. The interval for MiniMeal-Q was therefore set at EI:TEE <0·83 for under-reporting and EI:TEE >1·17 for over-reporting. Pearson correlations between TEEDLW and EI from both methods were calculated.
The mean and median intakes of total energy and nutrient intakes are presented for both sexes separately. The Wilcoxon signed-rank test was used to compare energy and nutrient intakes from both methods and Spearman correlation coefficients were calculated for the association between absolute energy and nutrient intake. Since the dietary variables were not normally distributed all variables were either log or square root transformed prior to further analyses. Pearson correlation coefficients were calculated on energy-adjusted nutrient intake variables, and the energy adjustment was performed by the residual model( Reference Willett 25 ). The absolute agreement between both methods was evaluated with Bland–Altman plots( Reference Bland and Altman 26 ). Here, both crude and energy-adjusted data were used, in this case expressed as the energy density (i.e. unit/MJ). The plot obtained illustrates the differences between the two measurements against the mean of both methods. A 95 % CI calculated as the mean difference ±1·96 sd allowed for the evaluation between the methods within the limits of agreement. The ability to rank individuals by energy and nutrient intakes (using energy-adjusted values) was examined by dividing the study population into tertiles for energy, and quartiles for nutrients. Through a cross-tabulation the Cohen's weighted κ (κ w) was obtained. All statistical analyses were two-sided with a significance level at α < 0·05. Statistical analyses were performed using SPSS Inc. (released 2009) PASW Statistics for Windows, version 18.0 (SPSS Inc. and IBM Corp.) and SAS 9.2 for Windows (SAS Institute, Inc.).
Results
The mean age of both women and men was 58 years (range 50–65 years) and 15 % of both women and men had a BMI above 30 kg/m2. A majority of the women (79 %) and men (77 %) were of native Swedish origin and approximately 40 % of the participants were living in an area categorised as low SES (Table 1). No statistically significant differences could be found between the whole study population (n 200) and the subgroup participating in DLW analyses (n 40) on the background characteristics evaluated. Stratification on low-/high-SES areas showed that participants from low-SES areas had a significantly higher BMI (27·8 v. 26·3 kg/m2, P = 0·008), were more likely to be smokers (15 v. 5 %; P < 0·001), born outside Sweden (49 v. 5 %; P < 0·001) and had a lower education level (17 v. 56 % with university/college degree; P < 0·001) than participants living in areas categorised as high SES (data not shown). Most participants (93 %) reported their 4-d food records by the web system, and there were no differences in reported EI between web-records or telephone-records (P = 0·23). Most participants evaluated both methods as easy to understand and to use.
Objective validation of energy intake
All participants who completed the DLW measurements (n 40) remained weight stable during the time frame of these measurements. The comparison of TEEDLW in relation to reported EI from the Riksmaten method and MiniMeal-Q are displayed in Table 2. Combining women and men, the measured mean TEEDLW was 10·8 (95 % CI 9·9, 11·6) MJ/d, which was significantly higher than reported EI from both the Riksmaten method and MiniMeal-Q (8·3 (95 % CI 7·5, 9·1) and 8·5 (95 % CI 7·4, 9·5) MJ, respectively; P < 0·001). Linear regression of TEEDLW v. reported EI showed a calibration coefficient of between 0·09 and 0·66 for the Riksmaten method, and between −0·04 and 0·72 for MiniMeal-Q. Mean reporting accuracy was 80 (sd 23) % for the Riksmaten method and 82 (sd 33) % for MiniMeal-Q. The correlation for measured TEEDLW and reported energy was r 0·40 for the Riksmaten method (P < 0·05) and r 0·28 for MiniMeal-Q (ns). Of the participants, sixteen (40 %) were considered as under-reporters and one (5 %) as an over-reporter in EI with the Riksmaten method. For MiniMeal-Q, 23 participants (57·5 %) were considered as under-reporters and six (15 %) as over-reporters.
Comparison of total energy expenditure measured with doubly labelled water (TEEDLW) in relation to reported energy intake (EI) from the Riksmaten method and MiniMeal-Q in a subgroup of twenty women and twenty men
* P < 0·05, ** P < 0·01, *** P < 0·001.
† Pearson correlation coefficient between measured TEE and reported EI.
‡ The calibration coefficient with 95 % CI corresponds to the slope of the regression of the measured TEE and estimated EI.
Bland–Altman plots with TEEDLW showed that both the Riksmaten method and MiniMeal-Q underestimated EI (Fig. 2). The limits of agreement were wider for MiniMeal-Q than for the Riksmaten method. The accuracy of reported energy seemed to be similar across the EI ranges for both methods (P for trend ns).
Bland–Altman plots of reported energy intake (EI) from (a) the Riksmaten method and (b) MiniMeal-Q, and total energy expenditure (TEE) measured by doubly labelled water (DLW) in the subgroup (n 40). Plots are presented with mean difference of the two methods together with 95 % limits of agreement (mean difference ±1·96 sd of the difference between the methods).
The ability to rank individuals according to EI values v. TEEDLW was also evaluated with cross-classification analyses. The proportion of participants categorised in the exact same tertile was 47·5 % for the Riksmaten method and 42·5 % for MiniMeal-Q, and the amount categorised in the extreme opposite tertile was 12·5 % for the Riksmaten method and 17·5 % for MiniMeal-Q. The weighted κ for energy was κ w = 0·26 for the Riksmaten method and κ w = 0·15 for MiniMeal-Q (Table 3).
Percentages of subjects classified in the same, adjacent and opposite tertiles of energy intake v. total energy expenditure (TEE), and relative comparison of energy-adjusted* nutrient intake (the Riksmaten method and MiniMeal-Q) and weighted κ (κ w)
DLW, doubly labelled water.
* Energy adjusted by the residual model.
† Subjects who had undergone measurements of TEE. Results of cross-classification analyses of study population divided into tertiles.
‡ Results of cross-classification analyses between the Riksmaten method and MiniMeal-Q, divided into quartiles.
Comparison of energy and macronutrients between the methods
Bland–Altman plots of absolute EI and energy-adjusted intakes of carbohydrate, protein and fat between the methods are displayed in Fig. 3(a)–Fig. 3(d). Reported EI was within the limits of agreement for most individuals; however, the differences between the methods seemed to be larger at higher intake levels (Fig. 3(a)). Energy-adjusted carbohydrate (Fig. 3(b)) and protein (Fig. 3(c)) intakes showed acceptable agreement, whereas the agreement for fat intake (Fig. 3(d)) was poorer between the methods (i.e. 18 % captured outside of 95 % limits of agreement).
Bland–Altman plots of (a) absolute energy intake and energy-adjusted intake of (b) carbohydrate, (c) protein and (d) fat in all participants (n 200) in the Swedish CArdioPulmonary bioImage Study (SCAPIS) diet substudy. Plots are presented with mean difference of the two methods together with 95 % limits of agreement (mean difference ±1·96 sd of the difference between the methods).
Reported intakes (mean values and standard deviations and median values with 25th and 75th percentiles) of energy, macronutrients and specific fatty acids, as well as crude and energy-adjusted correlations, are displayed in Tables 4 and 5 for women and men, respectively. In women, energy and macronutrients did not differ significantly between the two methods. However, reported intake of alcohol was significantly higher in the Riksmaten method than in MiniMeal-Q (P < 0·001). The average crude correlation was 0·41 (range 0·17–0·71). Pearson energy-adjusted correlations were somewhat higher, 0·44 on average (range 0·20–0·77). For men, reported energy and macronutrient intakes (except for carbohydrate) were significantly higher in the Riksmaten method than in MiniMeal-Q. The average crude correlation was 0·35 (range 0·10–0·67) and increased to 0·43 (range 0·14–0·69) for energy-adjusted values.
Average daily intake of energy, macronutrients and alcohol for women in the Swedish CArdioPulmonary bioImage Study (SCAPIS) diet substudy (n 102) (Riksmaten method and MiniMeal-Q)
(Mean values and standard deviations; medians and 25th and 75th percentiles; crude and energy-adjusted (EA) correlations between the methods)
* P < 0·05, ** P < 0·01.
† Wilcoxon signed-rank sum test between crude nutrient data.
‡ Spearman correlation coefficient.
§ Pearson correlation coefficient, energy-adjusted by the residual model.
Average daily intake of energy, macronutrients and alcohol for men in the Swedish CArdioPulmonary bioImage Study (SCAPIS) diet substudy (n 98) (Riksmaten method and MiniMeal-Q)
(Mean values and standard deviations; medians and 25th and 75th percentiles; crude and energy-adjusted (EA) correlations between the methods)
** P < 0·01.
† Wilcoxon signed-rank sum test between crude nutrient data.
‡ Spearman correlation coefficient.
§ Pearson correlation coefficient, energy-adjusted by the residual model.
The cross-classification analysis between the methods showed a weighted κ on energy κ w = 0·21. For macronutrients, the average κ w was 0·23 (range 0·17–0·27). On average 32 % of the participants were categorised in the exact same quartile, while 4·5 % were categorised in the extreme opposite quartile (Table 3).
Discussion
In this study we examined the ability of two web-based dietary assessment methods, the Riksmaten method and MiniMeal-Q, to assess EI in a middle-aged, population-based sample in relation to DLW. Also, a relative comparison of energy and macronutrients of the Riksmaten method and MiniMeal-Q was performed. The results showed that the mean reporting accuracy was similar for both methods. However, at individual level the correlation and cross-classification analyses suggested that MiniMeal-Q was less successful in ranking individuals correctly on EI, compared with the Riksmaten method.
One of the major strengths with this study is that reported EI has been validated against objectively measured energy expenditure using the ‘gold standard’ DLW. The subgroup that underwent DLW measurements did not differ from the study population in respect to any personal characteristics or by reported EI. We did see a trend that the validity was higher for men in high-SES areas for EI (but unchanged for women) and for BMI, where the reporting accuracy seemed to be better for those with a BMI <30 kg/m2. Unfortunately, the DLW method is expensive and only a subgroup of participants could be included in this part of the study. A larger sample size would have been desirable to be able to draw any conclusions from further subgroup analyses. A larger sample size would also have enabled us to calculate validity coefficients and CIs, as at least 100 observations would be preferred for these calculations( Reference Ocke and Kaaks 27 , Reference Ferrari, Kaaks and Riboli 28 ).
Another strength of this study is the large proportion of participants living in low-SES areas, which makes the study population more heterogeneous in respect to educational level, ethnicity and BMI, for instance. The characteristics of the study population were overall similar to the general population in Sweden( 29 ), suggesting that the results of this study could be generalised to a middle-aged Swedish population. This is in contrast to many DLW validation studies that use self-selected study participants with a relatively high educational level limiting the generalisability of the results to a broader population( Reference Freedman, Commins and Moler 30 ). Further, we see no reason to believe that our results would not also be valid for adult populations in other countries with similar socio-economic characteristics.
One limitation of this study is that we were unable to complete replicate measurements of the dietary assessments and the DLW measurements. Replicate measures would provide better data on habitual food intake when using the Riksmaten method, as we know that only 4 d of recording is insufficient for capturing intake of most nutrients( Reference Hartman, Brown and Palmgren 31 , Reference Basiotis, Welsh and Cronin 32 ). In as much as MiniMeal-Q is a retrospective method, it would have been preferable to repeat the questionnaire after the DLW measurement to be able to reflect the same time period. Still, we do not believe that the habitual diet would change dramatically during those 2 weeks.
Most of the participants managed to report their food intakes by the web, which demonstrate that using web-based dietary assessment methods is feasible in this age group. It is possible that prior computer knowledge affected the willingness to participate in the study, knowing that it included online tasks. Still, the study population was similar to the background population, indicating little effect of self-selection bias.
The measured energy expenditure with DLW was well in line with the age-specific means concluded by Black & Cole( Reference Black and Cole 24 ). The mean reported EI was around 80 % of measured energy expenditure in both methods, which is coherent with results from traditional paper-based diet records( Reference Seale and Rumpler 33 , Reference Tomoyasu, Toth and Poehlman 34 ), FFQ( Reference Kroke, Klipstein-Grobusch and Voss 35 ), a web-based record tool( Reference Hutchesson, Truby and Callister 36 ) and conclusions from reviews( Reference Freedman, Commins and Moler 30 , Reference Livingstone and Black 37 ). The fact that participants needed to register their dietary intake through the web did apparently not influence the degree of misreporting in either direction. While the average EI precision was similar for both methods, the ranking capacity on the individual level differed; only the Riksmaten method displayed statistically significant correlation on EI v. TEEDLW. Similar differences were seen for the weighted κ analyses that suggested a fair agreement for the Riksmaten method and a slight agreement for MiniMeal-Q on reported EI v. TEEDLW. Few validation studies report correlation coefficients and κ statistics, making comparisons difficult. High r (0·46–0·77) between reported EI and TEEDLW have been reported in small, highly selective study groups using food records( Reference Martin, Su and Jones 38 , Reference Goran and Poehlman 39 ) but also low r (0·13) have been reported( Reference Bathalon, Tucker and Hays 40 ). However, our results are in line with a recent review that pooled data and showed an average correlation of 0·21 between true intake determined by DLW and estimated EI by FFQ( Reference Freedman, Commins and Moler 30 ). For MiniMeal-Q the r was somewhat lower in this study than in the original validation study (r 0·28 v. r 0·38)( Reference Christensen, Moller and Bonn 13 ). The original validation study was performed on truncated data in a young, lean and highly educated group, which may explain the somewhat lower correlation in our study compared with the previous study. Reporting bias seems to be predicted by several variables, e.g. age, BMI and level of education, and these differences in characteristics between the two study populations are probably accountable for the different results.
The confidence limits of the Bland–Altman plots were larger for MiniMeal-Q compared with the Riksmaten method, suggesting a lower precision for MiniMeal-Q for assessing absolute EI at the individual level. The lower precision for the FFQ corresponds to the conclusions that were made in the Observing Protein and Energy Nutrition (OPEN) study( Reference Kipnis, Subar and Midthune 41 ) and in a study comparing different dietary assessment methodologies using the Portable Electronic Tape Recorded Automatic (PETRA) scales( Reference Bingham, Gill and Welch 42 ), where it was suggested that FFQ were not suitable for assessing absolute nutrient intakes as they would attenuate true diet–disease risk, but rather suggesting using energy-adjusted values. When adjusting for EI, correlation coefficients for macronutrients improved slightly for both women and men, suggesting that energy-adjusted variables are preferable.
In the present study we did not regard either of the two subjective dietary assessment methods as a reference method. Therefore, we performed relative comparisons between the two methods but did not calculate attenuation factors( Reference Liu, Stamler and Dyer 43 , Reference Beaton, Milner and Corey 44 ). Attenuation factors for MiniMeal-Q are, however, presented in the original validation study( Reference Christensen, Moller and Bonn 13 , Reference Christensen, Moller and Bonn 14 ). The relative comparison between the two subjective methods displayed similar intakes of energy and macronutrients at group level for women, although the variances were larger for MiniMeal-Q. In men, protein and fat intake was higher (and thus the EI) in the Riksmaten method than in MiniMeal-Q. For the agreement between the methods, the Bland–Altman plots illustrated a larger discrepancy when reported EI was higher (and hence, greater convergence on lower EI). This is to be expected, because some individuals consistently report low intakes regardless of method. When using energy-adjusted data for macronutrients, most subjects were predominantly within the 95 % limit of agreement. The cross-classification analysis places approximately on average a third in the exact same quartile and 4·5 % in the opposite quartile. These results correspond to other validation studies of FFQ, where cross-classification analyses against a reference method grossly misplaced on average 4–5·3 % of all macronutrients in opposite quartiles or quintiles( Reference Pakseresht and Sharma 45 , Reference Deschamps, de Lauzon-Guillain and Lafay 46 ).
In summary, both subjective methods validated in this study appear to function reasonably well regarding the mean reporting accuracy. The use of new technology to facilitate the collection of dietary data in large-scale studies seems to work well for middle-aged individuals, regardless of socio-economic status. Still, the degree of misreporting on EI is equal to that of traditional paper-based methods. The ranking capacity appeared to be better in the Riksmaten method, but then again MiniMeal-Q offers a relatively easy method for large data collection with low burden on study subjects. While the time burden is greater with the Riksmaten method, the advantage is that more detailed information is obtained about study participants’ food intake and the distribution of the meals during the day. More detailed data enable researchers to study more specific questions in relation to risk calculation( Reference Reinivuo, Hirvonen and Ovaskainen 47 ). When choosing the appropriate dietary assessment method for a survey, many aspects need to be taken into consideration: the precision of the intake data needed at the individual- or group level, the time burden of the study participant as well as the cost of managing the survey.
Conclusions
This study shows that web-based dietary assessment methods could be used for studying dietary intake in women and men of middle age. Nevertheless, the level of data required (i.e. at the individual- or group level) for the study purpose must carefully be considered. According to EI data validated with the DLW technique, both methods displayed similar precision on EI and, consequently, displayed a similar degree of under-reporting. However, MiniMeal-Q was less successful in ranking individuals compared with the Riksmaten method, suggesting that the FFQ should be used with caution if the aim is to assess EI at the individual level. This limitation may also influence ranking on macronutrients. Under-reporting of EI is a major concern in nutrition research with self-reported data, regardless of method. The development of dietary assessment methods to achieve a limited degree of under-reporting is therefore a major challenge for future research.
Acknowledgements
We thank Elisabeth Gramatkowski and Lars Ellegård for collecting and analysing the DLW measurements. Associate professor Katarina Bälter and co-workers at the Karolinska Institute in Stockholm are acknowledged for their swift assistance with the handling of MiniMeal-Q dietary data.
The present study was supported by Region Skåne and Albert Påhlsson Research Foundation. SCAPIS is supported by the Swedish Heart and Lung Foundation, the Knut and Alice Wallenberg Foundation, the Swedish Research Council and VINNOVA. The SCAPIS pilot study also received funding from Sahlgrenska Academy at Gothenburg University and strategic grants from ALF/LUA in Western Sweden. The National Food Agency supported the data collection by paying for the DLW analyses and parts of the staff's costs. No funder had any role in the design, analysis or writing of this article.
A. W., E. W., A. K. L., H. B. F. and I. L., designed the research; G. B. and B. H. provided essential databases; S. N. conducted research, analysed data and had primary responsibility for final content. S. N. wrote the manuscript and A. K. L. revised the paper. All authors read and approved the final manuscript.
There are no conflicts of interest.
Open access
