Hostname: page-component-848d4c4894-pftt2 Total loading time: 0 Render date: 2024-05-15T00:00:22.928Z Has data issue: false hasContentIssue false

Development and evaluation of image-series for portion size estimation in dietary assessment among adults

Published online by Cambridge University Press:  13 January 2021

Lorentz Salvesen*
Affiliation:
Department of Nutrition and Public Health, Faculty of Health and Sport Sciences, University of Agder, PO Box 422, Kristiansand4604, Norway
Dagrun Engeset
Affiliation:
Department of Nutrition and Public Health, Faculty of Health and Sport Sciences, University of Agder, PO Box 422, Kristiansand4604, Norway
Nina C. Øverby
Affiliation:
Department of Nutrition and Public Health, Faculty of Health and Sport Sciences, University of Agder, PO Box 422, Kristiansand4604, Norway
Anine C. Medin
Affiliation:
Department of Nutrition and Public Health, Faculty of Health and Sport Sciences, University of Agder, PO Box 422, Kristiansand4604, Norway
*
*Corresponding author: Lorentz Salvesen, email: lorentz.salvesen@uia.no

Abstract

Portion size images are advantageous in dietary assessment. The aim of the present study was to develop and validate new culturally specific image-series for portion size estimation to be used in a new Norwegian version of a British web-based dietary assessment tool (myfood24). Twenty-three image-series of different foods, each containing seven portion size images, were created and validated in a group of adults (n 41, 58 % female) aged 19–44 (median 23), out of which 63 % had higher (tertiary) education. The participants compared 46 portions of pre-weighed foods to the portion size images (1886 comparisons in total). Portion size estimations were either classified as correct, adjacent or misclassified. The weight discrepancy in percentage between the chosen and the correct portion size image was also calculated. Mann–Whitney U tests were used to explore if portion size estimation accuracy differed across sample characteristics, or if it depended on how the foods were presented. For thirty-eight of the forty-six presented food items, the participants selected the correct or adjacent portion size image 98 % on average. The remaining eight food items were on average misclassified by 27 % of the participants. Overall, a mean weight discrepancy of 2⋅5 % was observed between the chosen and the correct portion size images. Females estimated portion size more accurately than males (P = 0⋅019). No other significant differences in estimation accuracy were observed. In conclusion, the new image-series performed satisfactorily, except for the image-series depicting bread, caviar spread and marzipan cake, which will be altered. The present study demonstrates the importance of validating portion size estimation tools.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s), 2021. Published by Cambridge University Press on behalf of The Nutrition Society

Introduction

Improving diet quality could potentially prevent one in five deaths globally(Reference Afshin, Sur and Fay1). In Norway, diet is one of the modifiable risk factors that cause the most deaths, along with high blood pressure and smoking(Reference Knudsen, Vollset and Tollånes2). Clearly, there is a need for effective strategies to improve diet, which depend on accurate data on dietary intakes which require valid dietary assessment methods. Portion size estimates is a critical element in dietary assessment(Reference Subar, Freedman and Tooze3Reference Guthrie6). A recent systematic review by Amoutzopoulos et al. shows that there is a lack of validated portion size estimation tools, and consequently a pressing need for more validation studies(Reference Amoutzopoulos, Page and Roberts7).

Self-administered web-based dietary assessment methods represent a favourable option to the standard methods of assessing diet by paper or telephone. They are readily available for the participant at any time and place, and reduces the cost of conducting a dietary assessment and the burden for both the participants and the researchers(8,Reference Amoutzopoulos, Steer and Roberts9) .

An example of a digital version of the traditional 24-h recall method, is the self-administered web-based 24-h recall system myfood24, developed in Leeds, England(Reference Carter, Albar and Morris10). The myfood24-system has been validated in various settings(Reference Albar, Alwan and Evans11Reference Wark, Hardie and Frost13) and adapted to several country-specific versions (Australia, Denmark and Germany(Reference Koch, Conrad and Hierath14)). Norway lacks a self-administered web-based 24-h-recall-system for adults. Hence, we have recently adapted the British myfood24 for Norway, including the image-series for portion size estimations.

In terms of validity, the web-based dietary assessment tools and standard methods have been shown to be in close agreement(Reference Wark, Hardie and Frost13,Reference Cade15) . Along with the development of web-based dietary assessment tools over the last years, the traditional portion size estimation tools, e.g. food models and household measures, have been largely replaced by digital images of portion sizes. Importantly, food images have been shown to be more accurate compared with food models and household utensils in the review by Amoutzopoulos et al. (Reference Amoutzopoulos, Page and Roberts7) Further, two studies included in their review compared digital images and printed images, and reported no statistical difference in accuracy between these image types(Reference Hernández, Wilder and Kuehn16,Reference Liu, Chen and Lee17) . It is established that the number of images in an image-series affects the portion size estimation accuracy, favouring a high number of images(Reference Nelson, Atkinson and Darbyshire18,Reference Subar, Crafts and Zimmerman19) , which is more convenient when using a digital format v. printed images.

Reporting accuracy in dietary assessment is affected by a number of factors, such as demographics (sex, age, education and body mass index) and the dietary assessment method used. Previous research shows conflicting results regarding estimation accuracy between the sexes when using photographs or images to estimate portion size, where some found greater underestimation among male participants(Reference Nelson, Atkinson and Darbyshire18,Reference Ovaskainen, Paturi and Reinivuo20) , while others found no statistical difference(Reference Naska, Valanou and Peppa21,Reference Venter, MacIntyre and Vorster22) . Moreover, previous studies have not observed associations between the educational level and the perception of portion size(Reference Ovaskainen, Paturi and Reinivuo20,Reference Naska, Valanou and Peppa21) .

The overall aim of the present study was to develop new culturally specific image-series for portion size estimation and assess their validity. As part of validating the image-series, we explored whether portion size estimation accuracy differed by sex, level of education, and whether participants had studied food science or nutrition. Furthermore, we explored whether presenting the food items differently in relation to how the food was depicted in the image-series would affect how accurately the participants estimated the portion sizes.

Methods

The method section is divided into three parts: part one describes the myfood24-system; part two describes the development of image-series to aid portion size estimation in a Norwegian version of myfood24; part three describes the design of the validation study in which the new food portion image-series were assessed.

The myfood24-system

The dietary assessment tool myfood24, short for ‘Measure Your Food On One Day’, is a web-based 24-h recall system(Reference Carter, Albar and Morris10). The system is self-administered by the participant and is structured around pre-defined meals, and includes features such as searching the available database for food items, aids for portion size estimations with images and a recipe-builder.

In adapting myfood24 to a Norwegian setting, a food composition database tailored for the Norwegian population was compiled using the Norwegian Food Composition Database 2019(23) supplemented with food composition data for missing traditional Norwegian dishes from other sources. Portion size images for the Norwegian version were tailored to a Norwegian food culture.

Development of new food portion image-series for myfood24 for Norway

Deciding what food items to depict

The need to add new image-series for typical and frequently eaten Norwegian food to the Norwegian version of myfood24 was identified after a preliminary examination of the fifty-nine image-series from the British myfood24.

The choice of which foods to develop image-series for in this study was guided by the selection of image-series used in the national dietary survey, Norkost 3, conducted among adults in Norway(Reference Totland, Melnæs and Lundberg-Hallen24). In addition, first-hand experiences using these image-series in previous studies among adults(Reference Medin, Carlsen and Hambly25), and the portion size photo booklet ‘Matmallen’(Reference Amcoff and Barbieri26), a meal model tool developed by the Swedish National Food Administration, were looked at.

All food items selected to be included in the new image-series had to be listed in the Norwegian food composition table. Each image-series’ potential to be used for portion size estimation for more than one food item (a proxy for similar foods) were considered, favouring those suitable as a proxy for image-series development (e.g. muesli being a proxy for different types of breakfast cereals).

Dishes that may vary largely regarding the ingredient list (e.g. for tacos) were regarded as unsuitable to be included in the image-series.

Deciding the sizes of each portion

A high number of portion size images has shown to provide more accurate portion size estimation; for example, eight images presented simultaneously is shown to be more accurate compared to a single ‘average’ image(Reference Nelson, Atkinson and Darbyshire18) or four images(Reference Subar, Crafts and Zimmerman19) in previous studies. Hence, the newly developed image-series included seven images with increasing portion sizes, in line with the existing British image-series(Reference Foster, Hawkins and Barton27).

Four different criteria were used during the development of the portion sizes for the image-series. First, one of the three middle portion sizes (images 3–5) should be an approximate of the Norwegian or Swedish standard serving(Reference Dalane, Bergvatn and Kielland2830). Second, the portion size extremes were selected based on experiences as nutritionists and what was considered a plausible portion size. Third, when applicable, the food packaging or food container was taken into account (e.g. a can of beans). Finally, fixed percentage weight increments were applied to the image-series, in line with the image-series in the British myfood24 (e.g. for blueberries, we applied a fixed percentage weight increment of 50 %, resulting in the following portion sizes for blueberries in grams: 22, 33, 50, 74, 112, 168, 251). The rationale for using a fixed percentage increment is that it makes the difference between portion sizes clearly visible. In the present study, a fixed percentage increment was used for all but one of the image-series. The exception was the image-series for bread, in which a fixed increment in gram was used, to apply the Norwegian standard servings for a thin, medium and thick slice of bread as the middle portion size images (images 3–5)(Reference Dalane, Bergvatn and Kielland28).

Photographing and editing the image-series

An in-house professional photographer at the University of Agder (UiA) was engaged to photograph the food and create the image-series (Supplementary File S1, Table S1 and Supplementary File S2, Figs. S1 and S2). Photographing was done in two separate sessions. Food items that needed cooking or preparations (e.g. mince and stews) were prepared immediately before photographing. Two identical kitchen weights with 1-g increments (Swordfish SFKSW14E) were used to ensure correct weight. Food items were placed naturally on the plate, as done in real life, meaning that they were not arranged in an aesthetical manner. During the post-processing of the images, the background for each image-series was made transparent. To assist participants in identifying the different portion size images during the study, the letters A–G were embedded next to the food items on each image in the image-series (Fig. 1). In total, twenty-three image-series were developed (image-series not presented in the paper are available in Supplementary File S3, Figs. S1–S18).

Fig. 1. Examples of image-series with the letters A–G edited in to assist portion size image identification: (a) candy and (b) strawberry.

Validation of portion size image-series for the Norwegian version of myfood24

Design of the validation study

The perception approach was applied to evaluate the image-series(Reference Nelson, Atkinson and Darbyshire18). This entails presenting participants with pre-weighed food items in real time and having them estimate the portion sizes using the amounts depicted in images. This approach does not require the need for participants to conceptualise or rely on their memory.

The validation study was performed at four different time points, all in one day. The location was a large training kitchen at the university campus at UiA, in South of Norway. Each of the foods or dishes depicted in the twenty-three newly developed image-series were presented twice during the validation study, of which ten were presented with a different plate or bowl than depicted. The participants estimated the forty-six portion sizes in real time by observing the presented food items and choosing the portion size image they perceived as the same quantity. Participants were instructed not to discuss the portion size estimations with the other participants, nor to taste or eat the presented foods.

A digital questionnaire was developed in SurveyXact(31) to be used on handheld computers (Chromebook) or tablets (iPad) during the data collection. The questionnaire displayed the image-series corresponding to the presented food items as forty-six separate questions (example in Fig. 2). Portion size image weight was not shown. Successively, participants were asked questions covering demographic information: sex, age, level of education, and whether the participant had studied food science or nutrition.

Fig. 2. Example of an image-series used to estimate portion size in the digital questionnaire for ‘Dish 21. Liver-pâté’.

Recruitment

Forty-one participants were recruited at the university campus, using convenience sampling over a period of 14 d. A variety of different approaches was used in the recruitment phase, including social media and personal networks. Posters and flyers were placed and handed out on strategic places throughout the university campus (e.g. in the cafeteria, bulletin boards and classrooms). Recruitment was also carried out in lectures and among students, colleagues and employees at the university.

To be included in the study individuals had to be between the age of 18–45, speak Norwegian and be willing to be present at the university campus at one of four scheduled times. Individuals who had recorded their diet (e.g. using a food diary) during the last year were excluded from the study.

Participation in the study was voluntary. Written informed consent was obtained from all subjects. A gift card at a coffee shop, valued at 66 NOK (equivalent to approx. 7 Euros), was used as an incentive to recruit participants. Participants did not provide any person-identifying information during the study. All procedures involving research study participants were approved by the Norwegian Centre for Research Data (reference number: 637822) and the ethics committee of the Faculty for Health and Sport Sciences, University of Agder.

Preparations for the validation study

Each of the twenty-three food items depicted in the image-series were presented twice in the kitchen facility; hence, a total of forty-six servings of foods were presented for the participants in the present study. Each food item was presented once with identical weight relative to a portion size image, and once with an altered weight of 25 % of the differential to the adjacent portion size (e.g. two servings of brownies were presented: one weighing the exact same as a corresponding portion size image weight of 134 g, and the other weighed 148 g). The foods presented were numbered as an aid for the participants. The presentation of the portion sizes was randomised as follows: 50 % of the food items were presented as a middle portion size (images 3–5); 25 % as a smaller portion size (images 1–2) and 25 % as a larger portion size (images 6–7). Fourteen food items were presented with an increased weight relative to depicted. However, none of the presented portion sizes was smaller than image 1 or larger than image 7.

Food items that needed cooking were prepared the day before and stored in a cold storage room. Foods that could stay overnight were weighed and prepared the day before the study (e.g. candy and muesli). The same kitchen weights as used during the development of the image-series were used to ensure correct portion sizes (Swordfish SFKSW14E). All remaining dishes and spreads were weighed and prepared the morning of the study, but spreads were replaced before the last study round for visual reasons. Foods were plastic-covered and refrigerated between study rounds. Ten food items were presented with a different plate or bowl than depicted in the image-series to examine the effect of presentation method on estimation accuracy. No cutlery was presented with the food items.

Statistics

Descriptive analyses were conducted to explore the participants’ characteristics. Sex, level of education and participants having studied food science or nutrition are presented as frequency and percentage. Participants’ age and years of studying food science or nutrition are presented as median (25 %, 75 %), as these data were not considered as normally distributed.

Participants’ estimates of portion sizes assisted by the image-series were classified into correctly classified, adjacent, lightly misclassified or grossly misclassified. A portion size estimate classified as correct is defined as a perfect match between the portion size image chosen by the participant and the portion size of that same food or dish presented to the participant. A portion size estimate classified as adjacent is defined as a partially match, that is, when the participant selected the portion size image closest to the image corresponding to the presented portion size. A lightly misclassified estimate is defined as a partially mismatch, that is, when the participant chose an image of a portion size situated 2–3 images distant from the correct portion size image for the presented serving of food. A grossly misclassified estimate is defined as a complete mismatch, that is, when the participant selected a portion size image 4 or more images distant from the image corresponding to the presented portion size. For food items presented to the participants with an altered weight compared to the depicted in the image-series, the portion size image closest in weight was considered as its perfect match.

Participants’ estimates of portion sizes were also used to calculate the weight discrepancy in percentage between the chosen portion size image and the portion size presented to the participants. The following formula was used for each of the forty-six foods presented to the participants: [(mean estimated weight (g) – presented portion size (g))/presented portion size (g) × 100]. The weight of the nearest portion size image was used to calculate percent discrepancy for food items presented with altered weight.

Possible differences in portion size estimation accuracy were tested by comparing the mean proportion of correctly classified estimates (correctly classified, as defined above) for all presented food items per participant across sex, level of education (dichotomised into higher (tertiary) education (short, ≤4 years and long, >4 years) and all other), and whether participants had studied food science or nutrition. The non-parametric Mann–Whitney U tests were used as the mean proportion of correctly classified estimates per participant were not considered to be normally distributed.

Furthermore, we tested if differences in the food presentation resulted in differences in the accuracy of the portion size estimates. The accuracy of estimates for food items presented with identical v. altered weight relative to the portion size image was compared. Also, a similar comparison was made for food items presented as depicted in the image-series v. foods presented with a different plate or bowl. Mann–Whitney U tests were used comparing the mean proportion of correctly classified estimates made by the participants per food/dish, as data were not considered to be normally distributed.

Statistical analyses were performed using IBM SPSS Statistics for Windows, version 25 (IBM Corp., Armonk, NY, USA). Statistical significance level was set at P < 0⋅05.

Results

The distribution of sex in the sample was relatively balanced (58 % female). The median age was 23 years, ranging from 19 to 44. A majority of the participants (63 %) reported having higher (tertiary) education (short, <4 years or long, ≥4 years). About a quarter of the participants had studied food science or nutrition (median duration: 1¾ years; range: 0⋅5–10; Table 1). All 41 participants completed 46 portion size estimations each, resulting in a total of 1886 comparisons between the presented portion sizes of foods and portion size images.

Table 1. Self-reported characteristics of the study participants in the image-series validation study, the Norwegian version of myfood24

a Higher (tertiary) education, short, defined as ≤4 years.

b Higher (tertiary) education, long, defined as >4 years.

Across all foods, 55 % (range 7–95 %) of the participants’ portion size estimates were correct, meaning that they matched the portion sizes presented to them with the correct portion size image. Moreover, 38 % of the estimates were matched with the adjacent image, while 6 % were lightly misclassified and 0⋅5 % grossly misclassified by the participants. For thirty-eight of the forty-six presented food items, 90–100 % (mean of 98 %) of estimates were made with the correct or adjacent portion size image. The remaining eight food items were estimated as lightly or grossly misclassified by a mean of 27 % (Table 2 and examples in Fig. 3).

Fig. 3. Example of image-series that performed poorly in estimating portion size: (a) bread, (b) caviar spread and (c) marzipan cake.

Table 2. Proportion of participants’ portion size estimations using the image-series per presented food item in percent classified as correct or adjacent, adjacent, lightly misclassified or grossly misclassified in the image-series validation study, the Norwegian version of myfood24

Correct or adjacent defined as a perfect or partially match, in that participants chose the matching or the closest portion size image corresponding to the portion size of the same food or dish presented to them. Adjacent defined as a partially match, in that participants chose the closest portion size image corresponding to the presented portion size. Lightly misclassified defined as a partially mismatch, in that participants chose an image of a portion size situated 2–3 images distant from the correct portion size image for the presented serving of food. Grossly misclassified defined as a complete mismatch, that is when participants chose a portion size image 4 or more images distant from the image corresponding to the presented portion size.

a Presented portion weight increased by 25 % of the differential to the adjacent portion size image.

b Presented portion weight decreased by 25 % of the differential to the adjacent portion size image.

Table 3 shows the discrepancy in percentage between the portion sizes for foods presented to the participants and the mean of participants’ portion size estimations in gram. Moreover, Table 3 shows the changes in weight made to portion sizes presented with altered weight relative to depicted. The overall mean percent discrepancy between the presented portion sizes and the participants’ portion size estimations was 2⋅5 %, ranging from −33 % for marzipan cake and Mexican stew with beans (presented with decreased weight) to 105 % for caviar, spread (presented with increased weight). Sixteen food items had a percent discrepancy >20 % (Table 3). Food items presented with the weight of the smallest portion size image in an image-series (n 6) were all overestimated, with a mean of 43 %. Similarly, all food items presented with the largest portion size image weight (n 4) were all underestimated, with a mean of 21 %. The mid-images (images 2–6) had a mean discrepancy <7 % (range: −6 to 4 %), although individual food items show a greater degree of discrepancy (from 50 % for muesli to −33 % marzipan cake).

Table 3. Percentage discrepancy between the presented portion size image weight and the mean of participants’ portion size estimations in gram, and the weight alterations for portion sizes presented with altered weight relative to a portion size image in the image-series validation study, the Norwegian version of myfood24

Each food item was presented twice; once with identical weight relative to a portion size image, and once with portion size weight altered by ±25 % of the differential to an adjacent portion size image.Percentage discrepancy between the mean of participants’ portion size estimations and the presented portion size images calculated as [(mean estimated weight (g) – presented portion size (g))/presented portion size (g)  × 100] (food items presented with altered weight used the nearest portion size image to calculate percent discrepancy).

Portion size estimation accuracy differed across the sexes. Table 4 shows that female participants (n 24, median: 0⋅60) chose the correct portion size image more often than male participants (n 17, median: 0⋅52; P = 0⋅019). No statistically significant difference was observed either for participants with higher (tertiary) education (n 26, median: 0⋅57) or other education (n 15, median: 0⋅54) in choosing the correct portion size image (P = 0⋅613), nor for those that had studied food science or nutrition (n 10, median: 0⋅58) compared to those not having studied food science or nutrition (n 31, median: 0⋅54; P = 0⋅122) (Table 4).

Table 4. Comparison of portion size estimation accuracy across participant characteristics in the image-series validation study, the Norwegian version of myfood24

Mann–Whitney U test. Correct estimation referring to the mean proportion of correctly classified portion size image estimates by the participants for the forty-six presented food items, correctly classified defined as a perfect match between the portion size image chosen by the participant and the portion size of that same food or dish presented to the participant. Median represents the central tendency of the participants mean correct estimates, with interquartile range (IQR) representing the measure of variability.

a Higher (tertiary) education defined as short, ≤4 years or long, >4 years.

* P < 0⋅05.

The difference in portion size estimation accuracy per food item showed no statistically significant difference in choosing the correct portion size image for foods presented as depicted (n 36, median: 0⋅60) compared to those presented with a different plate or bowl (n 10, median: 0⋅63; P = 0⋅416), nor for food items presented with identical weight relative to a portion size image (n 23, median: 0⋅59) compared to those presented with an altered weight relative to depicted (n 23, median: 0⋅61; P = 0⋅597) (Table 5).

Table 5. Comparison of portion size estimation accuracy across the type of food presentation in the image-series validation study, the Norwegian version of myfood24

Mann–Whitney U test. Correct estimation referring to the participants’ mean proportion of correctly classified portion size image estimates per dish/food item, correctly classified defined as a perfect match between the portion size image chosen by the participant and the portion size of that same food or dish presented to the participant. Median represents the central tendency of the mean correct estimates per dish/food item, with interquartile range (IQR) representing the measure of variability.

a Presented with a different plate or bowl than depicted.

b Presented with ±25 % of the differential to an adjacent portion size image.

Discussion

We have recently adapted the British myfood24 for Norway, including the image-series for portion size estimations. During this process, we developed twenty-three image-series, each containing seven portion size images, for typical and frequently eaten Norwegian foods. The validity of the image-series was assessed through a comparison of pre-weighed portions of food to portion size images in the image-series in real time. We observed that most of the portion size estimates were satisfactory, as either the correct or adjacent portion size image was chosen by the participants. Overall, the mean weight discrepancy shows an overestimation of 2⋅5 % between the reported and correct portion size image (ranging from −33 to 105 %). Female participants estimated the correct portion size more often than male participants. The image-series developed for bread, caviar spread and marzipan cake performed poorly. All newly developed image-series, except bread, are included to aid portion size estimation in the Norwegian version of myfood24. New image-series are considered for those that performed poorly.

A few other researchers have published results from validation studies of portion size images that are compared to pre-weighed foods, and subsequently classified as correct, adjacent or misclassified. Findings from three of the studies are in line with the proportion of correct estimates observed in our study(Reference Ovaskainen, Paturi and Reinivuo20,Reference Naska, Valanou and Peppa21,Reference Lucas, Niravong and Villeminot32) . One study, among adults in an African population, reports a higher degree of correct estimates compared to our study(Reference Venter, MacIntyre and Vorster22), while estimates with the correct or adjacent portion size image in our study show similar results to what other have found (ranging from 70 to 95 % of estimates with either the correct or adjacent portion size image(Reference Naska, Valanou and Peppa21,Reference Lucas, Niravong and Villeminot32Reference Lillegaard, Overby and Andersen34) ). A Danish study found a somewhat lower accuracy when assessing self-served portion sizes in adults and children compared to our study, estimating pre-weighed foods(Reference Biltoft-Jensen, Holmgaard Nielsen and Hess Ygil35).

The flat-slope phenomenon, in which small portion sizes tend to be overestimated and large portions underestimated, was observed in the present study, which is in line with what others have found(Reference Nelson, Atkinson and Darbyshire18,Reference Naska, Valanou and Peppa21,Reference Venter, MacIntyre and Vorster22,Reference Faggiano, Vineis and Cravanzola36) . While the smallest portion sizes were overestimated and the largest portion sizes were underestimated, the remaining portion sizes (representing images 2–6) were on average underestimated by 2 %. The large degree of misestimations for the smallest and largest portion sizes may partly be attributed to the fact that there is only one possible direction for misestimation, compared to the remaining five mid-images with both smaller and larger adjacent images, allowing both over- and underestimation. The five mid-images show an overall tendency to be underestimated, rather than overestimated, although this is not true for all the foods presented. This implies that the mid-images provide an acceptable accuracy at a group level, but that they should be interpreted with caution at an individual level.

Despite the tendency of underestimation observed for the mid-images, an overall overestimation of 2⋅5 % was observed in our study, which is similar to Hernández et al. (Reference Hernández, Wilder and Kuehn16) Compared to Vereecken et al., who found an overall underestimation of 15 % when adolescents assessed pre-weighed foods(Reference Vereecken, Dohogne and Covents33), our results show a more accurate overall estimation, which may be explained by our study sample being older(Reference Livingstone, Robson and Wallace37). This is further supported by the study by Lillegaard et al. including children and adolescent showing a wider range in both under- and overestimation (0 to 142 %), compared to our results(Reference Lillegaard, Overby and Andersen34). Other studies validating food images in adults have found both greater and lesser degree of misestimation compared to our results(Reference Ovaskainen, Paturi and Reinivuo20,Reference Tueni, Mounayar and Birlouez-Aragon38) .

In the present study, we observed a statistically significant difference in choosing the correct portion size image for sex, but not for the level of education or whether they had studied food science or nutrition. Both Ovaskinen et al. and Nelson et al. found that male participants underestimated portion sizes compared to female participants(Reference Nelson, Atkinson and Darbyshire18,Reference Ovaskainen, Paturi and Reinivuo20) , while Naska et al. and Venter et al. found no significant difference for sex(Reference Naska, Valanou and Peppa21,Reference Venter, MacIntyre and Vorster22) . We did not observe any difference in the accuracy of portion size estimations for level of education (higher education (short, ≤4 years and long, >4 years) and all other), which corroborate findings from other studies(Reference Ovaskainen, Paturi and Reinivuo20,Reference Naska, Valanou and Peppa21) . We speculate that this may reflect that although the level of education is associated with knowledge and skills, the task of estimating food intake is not a skill taught through the educational system.

The image-series developed for bread performed poorly, similar to a previous study using natural size printed photographs of bread(Reference Ovaskainen, Paturi and Reinivuo20). One possible explanation for this result is that we used weight increments fixed in grams rather than percentage to include the Norwegian standard serving sizes for a thin, medium and thick piece of bread(Reference Dalane, Bergvatn and Kielland28). Using increments in gram rather than percentage makes distinguishing the difference between portion sizes challenging, as an increase from 20 to 30 g (150 % increase) is visually easier to detect than 60 to 70 g (116 % increase). Further, the image-series depicted two pieces of bread (to illustrate the same weight for different types of bread) placed on a wooden cutting board with a matchbox as a reference measure (Fig. 3). It is difficult to conclude what caused the poor performance, as the image-series differed from the others in multiple ways. Participants expressed difficulty in applying the image-series, as the two depicted pieces of bread were presented separately during the validation study.

Spreads represent six of the eight food items most often misclassified in our study, specifically: jam, liver-pâté, butter and caviar (Table 2). Other studies have also reported poor estimates(Reference Ovaskainen, Paturi and Reinivuo20) and high percentage of error(Reference Venter, MacIntyre and Vorster22) when assessing portion sizes of spreads. Image-series of spreads were depicted on a piece of bread with an equal amount alongside to illustrate the quantity. Caviar was depicted as squeezed out of the tube packaging (Fig. 3). Spreads had the smallest portion sizes and lowest percent weight increment relative to other image-series developed in this study. During the validation study, spreads were only presented as spread on a piece of bread (caviar included). The small weight increments used for spreads could explain the degree of misestimation. For butter, the three smallest portion size images are 3, 4 and 5 g, respectively. The differences are visually noticeable in the image-series, but in a real-time setting, without the amount of spread illustrated alongside, it may be difficult to estimate. Additionally, estimating spreads on a piece of bread is challenging to quantify compared to more tangible food items, such as pieces of candy. Some participants expressed difficulties estimating portions of spreads, as it was unclear whether they should consider both the spread depicted on the piece of bread and the amount alongside.

The image-series for marzipan cake also performed poorly, similar to other findings using digital pictures of pies to assess portion size(Reference Naska, Valanou and Peppa21). The three smallest images in our series differed from the remaining four (Fig. 3), in that the small portions were depicted lying on the side, while the larger portions were depicted as upright triangular pieces.

In the present study, bread, some spreads and marzipan cake performed poorly. What foods are most critical to assess accurately in dietary assessment will always depend on the research question of interest. Bread, and subsequently spreads, are frequently consumed in Norway(Reference Totland, Melnæs and Lundberg-Hallen24), emphasising the importance of developing accurate tools to estimate portion sizes for these foods.

Strengths and limitations

A strength in the present validation study is the use of pre-weight foods as the reference tool, which is in line with Amoutzopoulos et al. recommendations for validating portion size estimation tools(Reference Amoutzopoulos, Page and Roberts7).

Evaluating the validity of image-series is in several other studies conducted using the perception or conceptualisation and memory approach(Reference Nelson and Haraldsdóttir39). This study evaluated the newly developed image-series using the perception approach. The advantages of using this approach are that it excludes participant biases related to memory and recall and provides direct feedback on the image-series applicability to estimate portion sizes. Furthermore, as the participants were not assessing their own diet, but rather a selection of random portion sizes presented to them, one could hypothesise that this reduces the degree of social desirability.

We excluded individuals having recorded their diet during the last year, based on the assumption that people who had registered their diet would estimate portion size more accurately than the general public. Hence, we argue that there is no reason to believe that our results are better than in the general population. Moreover, our study had a relatively even distribution of sex and a fair representation of the age group (58 % female and age range of 19–44 years, respectively). Yet, the sample size and education level of participants limits the generalizability. Recruitment at the university can explain why a majority of the participants had higher (tertiary) education. Additionally, the proportion of highly educated participants may be under-reported, as an unclear phrasing of the said question may have caused participants to select a lower level of education. Using the perception approach to evaluate the image-series in this study may limit the generalizability of the results to a situation relying on participants memory and conceptualisation for dietary assessment. A potential study limitation is the unnatural setting in a large university kitchen, with other participants working their way through the presented food items. This may not reflect the same results as estimating portion sizes individually in a natural setting.

Conclusion, implication and further research

The newly developed image-series for traditional and frequently eaten Norwegian foods performed satisfactorily in estimating portions of pre-weighed foods using a perception approach, except for a few food items (bread, caviar spread and marzipan cake). The participants matched more than half of the forty-six presented portion sizes with the correct portion size image, and more than 90 % with either the correct or the adjacent portion size image. Overall, there was an overestimation of 2⋅5 % (ranging from −33 to 105 %). The ‘flat-slope’ phenomenon was observed for the largest and smallest portion sizes, and although the remaining five mid-images in the twenty-three image-series show an overall acceptable accuracy (<7 %), they mask a varying degree of misestimation. All newly developed image-series, except for bread, were included to aid portion size estimation in the Norwegian version of myfood24. This study adds to the importance of validating portion size estimation tools.

The finding that the image-series for bread and spreads performed poorly is of significant importance, as bread is a staple food in the Norwegian diet. The accuracy of portion size estimation in the present study is comparable to what others have found. By conducting this study, it was revealed which of our new image-series need to be modified and re-validated. New image-series are planned for those that performed poorly.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/jns.2020.58.

Acknowledgements

Erlend Larsen Valen contributed to the image-series development process, recruitment and preparing food items for the validation study. Morten Rosenvinge photographed the food items.

This work was supported by the University of Agder. The funders had no role in design, analysis or writing of this article.

L. S. and A. C. M. designed the study; L.S. planned and conducted the data collection, with assistance from A. C. M; L. S. carried out all data analyses and drafted the paper; A. C. M., D. E. and N. C. Ø. assisted in interpreting the data and revised drafts of the paper. All authors have read and approved the contents of the submitted manuscript.

The authors declare that they have no conflicts of interest.

References

Afshin, A, Sur, PJ, Fay, KA, et al. (2019) Health effects of dietary risks in 195 countries, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 393, 19581972.CrossRefGoogle Scholar
Knudsen, AK, Vollset, SE, Tollånes, MC, et al. (2017) Sykdomsbyrde i Norge 2015: Resultater fra global burden of diseases, injuries, and risk factors study 2015 (GBD 2015). Disease Burden in Norway 2015 Results From the Global Burden of Diseases, Injuries, and Risk Factors Study 2015 (GBD 2015) no. 978-82-8082-840-8. Oslo: Folkehelseinstituttet, Senter for sykdomsbyrde.Google Scholar
Subar, AF, Freedman, LS, Tooze, JA, et al. (2015) Addressing current criticism regarding the value of self-report dietary data. J Nutr 145, 26392645.CrossRefGoogle ScholarPubMed
Riboli, E, Elmståhl, S, Saracci, R, et al. (1997) The Malmö food study: Validity of two dietary assessment methods for measuring nutrient intake. Int J Epidemiol 26, S161S161.CrossRefGoogle ScholarPubMed
Blake, AJ, Guthrie, HA & Smiciklas-Wright, H (1989) Accuracy of food portion estimation by overweight and normal-weight subjects. J Am Diet Assoc 89, 962964.Google ScholarPubMed
Guthrie, HA (1984) Selection and quantification of typical food portions by young adults. J Am Diet Assoc 84, 14401444.Google ScholarPubMed
Amoutzopoulos, B, Page, P, Roberts, C, et al. (2020) Portion size estimation in dietary assessment: a systematic review of existing tools, their strengths and limitations. Nutr Rev 78, 885900.CrossRefGoogle ScholarPubMed
The Diet Anthropometry and Physical Activity (DAPA) Measurement Toolkit (s.a.). Technology assisted dietary assessment. https://www.dapa-toolkit.mrc.ac.uk/diet/subjective-methods/technology-assisted (accessed May 2020).Google Scholar
Amoutzopoulos, B, Steer, T, Roberts, C, et al. (2018) Traditional methods v. new technologies – dilemmas for dietary assessment in large-scale nutrition surveys and studies: a report following an international panel discussion at the 9th International Conference on Diet and Activity Methods (ICDAM9), Brisbane, 3 September 2015. J Nutr Sci 7, e11.CrossRefGoogle Scholar
Carter, MC, Albar, SA, Morris, MA, et al. (2015) Development of a UK online 24-h dietary assessment tool: myfood24. Nutrients 7, 40164032.CrossRefGoogle ScholarPubMed
Albar, SA, Alwan, NA, Evans, CE, et al. (2016) Agreement between an online dietary assessment tool (myfood24) and an interviewer-administered 24-h dietary recall in British adolescents aged 11–18 years. Br J Nutr 115, 16781686.CrossRefGoogle Scholar
Gianfrancesco, C, Darwin, Z, McGowan, L, et al. (2018) Exploring the feasibility of use of an online dietary assessment tool (myfood24) in women with gestational diabetes. Nutrients 10, 1147.CrossRefGoogle ScholarPubMed
Wark, PA, Hardie, LJ, Frost, GS, et al. (2018) Validity of an online 24-h recall tool (myfood24) for dietary assessment in population studies: comparison with biomarkers and standard interviews. BMC Med 16, 136.CrossRefGoogle ScholarPubMed
Koch, SAJ, Conrad, J, Hierath, L, et al. (2020) Adaptation and evaluation of myfood24-Germany: A web-based self-administered 24-h dietary recall for the German adult population. Nutrients 12, 160.CrossRefGoogle ScholarPubMed
Cade, JE (2017) Measuring diet in the 21st century: use of new technologies. Proc Nutr Soc 76, 276282.CrossRefGoogle ScholarPubMed
Hernández, T, Wilder, L, Kuehn, D, et al. (2006) Portion size estimation and expectation of accuracy. J Food Compost Anal 19, S14S21.CrossRefGoogle Scholar
Liu, Y-C, Chen, C-H, Lee, C-W, et al. (2016) Design and usability evaluation of user-centered and visual-based aids for dietary food measurement on mobile devices in a randomized controlled trial. J Biomed Inform 64, 122130.CrossRefGoogle Scholar
Nelson, M, Atkinson, M & Darbyshire, S (1994) Food photography. I: the perception of food portion size from photographs. Br J Nutr 72, 649663.CrossRefGoogle ScholarPubMed
Subar, AF, Crafts, J, Zimmerman, TP, et al. (2010) Assessment of the accuracy of portion size reports using computer-based food photographs aids in the development of an automated self-administered 24-hour recall. J Am Diet Assoc 110, 5564.CrossRefGoogle ScholarPubMed
Ovaskainen, ML, Paturi, M, Reinivuo, H, et al. (2008) Accuracy in the estimation of food servings against the portions in food photographs. Eur J Clin Nutr 62, 674681.CrossRefGoogle ScholarPubMed
Naska, A, Valanou, E, Peppa, E, et al. (2016) Evaluation of a digital food photography atlas used as portion size measurement aid in dietary surveys in Greece. Public Health Nutr 19, 23692376.CrossRefGoogle Scholar
Venter, CS, MacIntyre, UE & Vorster, HH (2000) The development and testing of a food portion photograph book for use in an African population. J Hum Nutr Diet 13, 205218.CrossRefGoogle Scholar
Norwegian Food Safety Authority, The Norwegian Directorate of Health, University of Oslo (2019) Norwegian Food Composition Database 2019. www.matvaretabellen.no (accessed December 2019).Google Scholar
Totland, TH, Melnæs, BK, Lundberg-Hallen, N, et al. (2012) Norkost 3. A Nationwide Dietary Survey among 18–70 Year Old Men and Women in Norway, 2010–11. Oslo, Norway: The Norwegian Directorate of Health.Google Scholar
Medin, AC, Carlsen, MH, Hambly, C, et al. (2017) The validity of a web-based FFQ assessed by doubly labelled water and multiple 24-h recalls. Br J Nutr 118, 11061117.CrossRefGoogle ScholarPubMed
Amcoff, E & Barbieri, HE (2008) Revidering av Matmallen. Uppsala: National Food Administration, Sweden.Google Scholar
Foster, E, Hawkins, A, Barton, KL, et al. (2017) Development of food photographs for use with children aged 18 months to 16 years: comparison against weighed food diaries - The Young Person's Food Atlas (UK). PLoS ONE 12, e0169084.CrossRefGoogle Scholar
Dalane, , Bergvatn, TAM, Kielland, E, et al. (2015) Weights, Measures and Portion Sizes for Foods. Oslo: Mattilsynet, Universitetet i Oslo, Helsedirektoratet.Google Scholar
Livsmedelsverket (2017) The Swedish Food Agency food database, version 2017-12-15. http://www7.slv.se/SokNaringsinnehall/ (accessed October 2019).Google Scholar
Norwegian Directorate of Health, Norwegian Food Safety Authority (2019) Kostholdsplanleggeren. https://www.kostholdsplanleggeren.no/ (accessed October 2019).Google Scholar
SurveyXact (n.d.) SurveyXact. https://www.surveyxact.com/ (accessed May 2018).Google Scholar
Lucas, F, Niravong, M, Villeminot, S, et al. (1995) Estimation of food portion size using photographs: validity, strengths, weaknesses and recommendations. J Hum Nutr Diet 8, 6574.CrossRefGoogle Scholar
Vereecken, C, Dohogne, S, Covents, M, et al. (2010) How accurate are adolescents in portion-size estimation using the computer tool Young Adolescents’ Nutrition Assessment on Computer (YANA-C)? Br J Nutr 103, 18441850.CrossRefGoogle ScholarPubMed
Lillegaard, IT, Overby, NC & Andersen, LF (2005) Can children and adolescents use photographs of food to estimate portion sizes? Eur J Clin Nutr 59, 611617.CrossRefGoogle ScholarPubMed
Biltoft-Jensen, A, Holmgaard Nielsen, T, Hess Ygil, K, et al. (2018) Accuracy of food photographs for quantifying food servings in a lunch meal setting among Danish children and adults. J Hum Nutr Diet 31, 131140.CrossRefGoogle Scholar
Faggiano, F, Vineis, P, Cravanzola, D, et al. (1992) Validation of a method for the estimation of food portion size. Epidemiology 3, 379382.CrossRefGoogle ScholarPubMed
Livingstone, MBE, Robson, PJ & Wallace, JMW (2004) Issues in dietary intake assessment of children and adolescents. Br J Nutr 92, S213S222.CrossRefGoogle ScholarPubMed
Tueni, M, Mounayar, A & Birlouez-Aragon, I (2012) Development and evaluation of a photographic atlas as a tool for dietary assessment studies in Middle East cultures. Public Health Nutr 15, 10231028.CrossRefGoogle Scholar
Nelson, M & Haraldsdóttir, J (1998) Food photographs: practical guidelines I. Design and analysis of studies to validate portion size estimates. Public Health Nutr 1, 219230.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1. Examples of image-series with the letters A–G edited in to assist portion size image identification: (a) candy and (b) strawberry.

Figure 1

Fig. 2. Example of an image-series used to estimate portion size in the digital questionnaire for ‘Dish 21. Liver-pâté’.

Figure 2

Table 1. Self-reported characteristics of the study participants in the image-series validation study, the Norwegian version of myfood24

Figure 3

Fig. 3. Example of image-series that performed poorly in estimating portion size: (a) bread, (b) caviar spread and (c) marzipan cake.

Figure 4

Table 2. Proportion of participants’ portion size estimations using the image-series per presented food item in percent classified as correct or adjacent, adjacent, lightly misclassified or grossly misclassified in the image-series validation study, the Norwegian version of myfood24

Figure 5

Table 3. Percentage discrepancy between the presented portion size image weight and the mean of participants’ portion size estimations in gram, and the weight alterations for portion sizes presented with altered weight relative to a portion size image in the image-series validation study, the Norwegian version of myfood24

Figure 6

Table 4. Comparison of portion size estimation accuracy across participant characteristics in the image-series validation study, the Norwegian version of myfood24

Figure 7

Table 5. Comparison of portion size estimation accuracy across the type of food presentation in the image-series validation study, the Norwegian version of myfood24

Supplementary material: File

Salvesen et al. supplementary material

Salvesen et al. supplementary material

Download Salvesen et al. supplementary material(File)
File 2.2 MB