Hostname: page-component-848d4c4894-pftt2 Total loading time: 0 Render date: 2024-05-14T23:42:46.731Z Has data issue: false hasContentIssue false

Assessing factorial and convergent validity and reliability of a food behaviour checklist for Spanish-speaking participants in US Department of Agriculture nutrition education programmes

Published online by Cambridge University Press:  22 February 2011

Jinan C Banna
Affiliation:
Department of Nutrition, University of California, One Shields Avenue, Davis, CA 95616-8669, USA
Marilyn S Townsend*
Affiliation:
Department of Nutrition, University of California, One Shields Avenue, Davis, CA 95616-8669, USA
*
*Corresponding author: Email mstownsend@ucdavis.edu
Rights & Permissions [Opens in a new window]

Abstract

Objective

To assess convergent validity, factorial validity, test–retest reliability and internal consistency of a diet quality food behaviour checklist (FBC) for low-literate, low-income Spanish speakers.

Design

Participants (n 90) completed three dietary recalls, the Spanish-language version of the US Department of Agriculture (USDA) Household Food Security Survey Module (HFSSM) and the Spanish-language FBC. Factor structure was examined using principal component analysis. Spearman correlation coefficients between FBC item responses and nutrient intakes from 24 h recalls were used to estimate convergent validity. Correlation coefficients were also calculated between FBC item responses at two time points in another group of participants (n 71) to examine test–retest reliability. Cronbach's α coefficient was determined for items within each sub-scale.

Setting

Non-profit community agencies serving low-income clients, migrant farm worker camps and low-income housing sites in four California counties.

Subjects

Spanish-speaking women (n 161) who met income eligibility for the SNAP-Ed (Supplemental Nutrition Assistance Program–Education).

Results

Factor analysis resulted in six sub-scales. Responses to nineteen food behaviour items were significantly correlated with hypothesized 24 h recall data (with a maximum correlation of 0·44 for drinking milk and calcium) or the USDA HFSSM (0·42 with the food security item). Coefficients for test–retest reliability ranged from 0·35 to 0·79. Cronbach's α ranged from 0·49 for the diet quality sub-scale to 0·80 for the fruit and vegetable sub-scale.

Conclusions

The twenty-two-item FBC and instruction guide will be used to evaluate USDA community nutrition education interventions with low-literate Spanish speakers. This research contributes to the body of knowledge about this at-risk population in California.

Type
Research paper
Copyright
Copyright © The Authors 2011

Latinos comprise over one-third of the population in California(1). Due to higher rates of hypertension, obesity, diabetes and metabolic syndrome in Latina women, this group is at higher risk for CVD than non-Latino whites(2). Nutrition education interventions promoting dietary change have been shown to have positive effects on behaviour, thereby reducing the chronic disease burden(Reference Jordan, Slater and Kottke3). Evaluation tools to assess these dietary behaviour changes are essential.

Several short dietary or behavioural assessment tools have previously been developed and reported in the nutrition literature. Their purposes include population monitoring, survey assessment and evaluation of nutrition education interventions. These tools include the National Cancer Institute's 5-a-Day for better health fruit and vegetable screener(Reference Thompson, Demark-Wahnefried and Taylor4), Kristal et al.'s Food Behavior Checklist at the University of Washington(Reference Kristal, Abrams and Thornquist5), Connor et al.'s Diet Habits Survey at Oregon Health Sciences University(Reference Connor, Gustafon and Sexton6), Wakimoto et al.'s brief dietary screeners at the University of California, Berkeley(Reference Wakimoto, Block and Mandel7) and Townsend et al.'s Food Behavior Checklist at the University of California, Davis(Reference Townsend, Sylva and Martin8Reference Murphy, Kaiser and Townsend10). This literature review found no rigorously validated Spanish-language food behaviour evaluation tools to assess diet quality. Tools for Spanish-speaking low-literacy populations are especially lacking, with only one study describing validation of a set of short FFQ in a low-literacy Spanish-speaking sample(Reference Wakimoto, Block and Mandel7). There is a need for tools for US Department of Agriculture (USDA) food assistance and education programmes with a low respondent burden that can be administered in a group setting to this audience(Reference Townsend, Sylva and Martin8, Reference Townsend, Kaiser and Allen9, Reference Townsend11, Reference Townsend and Kaiser12). Tools that have exhibited adequate validity and reliability in a particular population need to be re-evaluated for use in another population that differs in terms of education, income, cultural background, country of origin, language or literacy(Reference Townsend11, Reference Geisinger13). An ideal evaluation instrument for these federal programmes should exhibit adequate validity and reliability in the target population(Reference Townsend11, Reference Litwin14), be sufficiently brief to avoid detracting from the education portion of the intervention, and include behaviours presented in the education sessions(Reference Townsend, Kaiser and Allen9Reference Townsend11).

The current study sought to test a food behaviour checklist in a Spanish-speaking, low-income population in California. Face validity was previously assessed and reported(Reference Banna, Vera Becerra and Kaiser15). This assessment involved rigorous methods including a comparison of five translated versions and cognitive testing interviews with low-income clients to determine their preferred word choices, resulting in a tool with low reading difficulty. Developed using visual information processing theories, this tool consisted of sixteen behavioural items with each composed of simplified text and visual. Based on our previously reported findings with an English-speaking audience(Reference Townsend, Sylva and Martin8, Reference Townsend, Sylva and Martin16), the representative visuals were used as effective substitutes for text and/or as extralinguistic information to add clarity and facilitate understanding and hence learning for a low-literate audience. Also reported was that clients preferred colour photographs with realism, shape and colour cues compared with greyscale photographs with realism, shape cues or black/white line drawings, or abstract visuals with minimal realism(Reference Townsend, Sylva and Martin8, Reference Banna, Vera Becerra and Kaiser15). The present paper examines the Spanish-language food behaviour checklist (FBC) in terms of factorial and convergent validity, internal consistency and test–retest reliability with a low-literate Spanish-speaking audience.

Methods

Sample

The study was conducted at the University of California in four California counties. Selected participants (n 161) were female, over the age of 18 years, spoke Spanish as a first language, met income eligibility for SNAP-Ed (Supplemental Nutrition Assistance Program–Education; formerly known as Food Stamp Nutrition Education), and had at least one child/youth under the age of 19 years living at home. Interviews were obtained from clients at non-profit community agencies serving low-income clients, trailer parks, migrant farm worker camps, government-funded day-care centres serving low-income clients and low-income housing sites.

Design and protocol

The protocol involved three studies. In the first, the two samples were combined for analysis of factorial structure and internal consistency. In the second, test–retest reliability was assessed(Reference Litwin14), and the participants received $US 10 for completing the FBC on two occasions three weeks apart with no planned intervention during the interim. In the third, convergent validity of the items and sub-scales was examined with a sample of women different from those in the reliability sub-study. In the initial meeting, demographic information including acculturation was collected and one 24 h recall was conducted in Spanish. At two subsequent meetings, two additional recalls, the Spanish-language FBC, the USDA eighteen-item food security scale and anthropometric data were collected. All interviews took place in person. Participants received a total of $US 40 in gift cards to major chain stores for the convergent validity study. The protocol was approved by the Institutional Review Board of the University of California.

Staff training

Two staff persons were responsible for recruitment of eligible participants from the four counties. These staff members were female, familiar with each respective community and spoke Spanish as a first language. Staff travelled to a central site for two-day intensive training in recruitment and data collection procedures (agenda and training materials available from the first author). A Spanish-speaking project coordinator supervised the staff to ensure consistency of data collection procedures.

Data collection

Family record, acculturation and anthropometric data

Standard demographic data were collected. Acculturation level was determined by the Bidimensional Acculturation Scale for Hispanics (BAS)(Reference Marin and Gamba17). Measured height, weight and waist circumference were collected using standardized anthropometric equipment and procedures (training protocol available from the first author)(Reference Frisancho18).

Food behaviour checklist items

Food behaviour items (i.e. text and visuals) mirrored those included in the sixteen-item English-language version of the questionnaire(Reference Townsend, Sylva and Martin8Reference Murphy, Kaiser and Townsend10), with an additional four fat/cholesterol and three fruit and vegetable items. Face validity was established, with details described elsewhere(Reference Banna, Vera Becerra and Kaiser15). To provide consistency in administration of the tool and reduce random error, a 22-page instruction guide was developed and reviewed by eight professional and two paraprofessional staff(Reference Banna, Townsend and Vera Becerra19). Items were worded so that the desirable food behaviours did not always elicit the same type of response. Responses were re-coded during analyses so that a higher score indicated more favourable behaviour.

Dietary recalls

To assess convergent validity of the food behaviour items, the USDA five-pass method for 24 h recalls was used(Reference Moshfegh, Raper and Ingwersen20). All interviews were conducted in person using standardized probes and models to aid in estimation of portion size. After collection of dietary information, foods were entered into the Food Processor SQL software package version 10.3 (ESHA Research, Salem, OR, USA). Specific recipes and ingredients for Mexican foods consumed by clients were added for the present study.

Food security

Validity of the FBC food security item was determined by Harrison et al.'s Spanish-language version of the USDA Household Food Security Survey Module (HFSSM) using the past 12 months as the time frame(Reference Nord, Andrews and Carlson21, Reference Harrison, Stormer and Herman22).

Data analysis

Analyses were performed using the SAS for Windows statistical software package release 5.1.2600 (SAS Institute, Cary, NC, USA).

Item analysis

Mean responses and standard deviations were calculated for each item to determine capacity for change as a result of an intervention.

Factor validity

The factor structure of the FBC was examined in three stages. Principal component analysis with Varimax rotation was the data reduction technique of choice as our purpose was variable reduction or replacement of the original FBC items with sub-scale scores summarizing the data parsimoniously(Reference Nunnally and Bernstein23). Factors with eigenvalues >1·0 were included. Any item with a factor loading of >0·50 was considered to load on the given factor, in conjunction with review of the content of the individual items.

Internal consistency

Cronbach's α coefficients(Reference Litwin14) were calculated for sub-scales with three or more items to determine the consistency of responses to the final sub-scales. In our population of low-literate Spanish speakers, we considered α = 0·60 as acceptable. Spearman's correlation was determined for sub-scales with two items.

Test–retest reliability

Test–retest reliability of individual items on the FBC was indicated by the Spearman rank-order correlation between the scores for a given item at the two time points, as well as the intraclass correlation coefficient(Reference Litwin14, Reference DeVon, Moyle-Wright and Ernst24), two methods that are commonly used together in assessing test–retest reliability(Reference Maruti, Feskanich and Colditz25, Reference Fernández-Ballart, Lluís Piñol and Zazpe26). Reliability of the sub-scales and total FBC was indicated by the Spearman rank-order correlation and intraclass correlation coefficient between the scores for a given sub-scale or the total FBC at the two time points. Items asking about ‘yesterday’ or ‘during the past week’ were excluded from this analysis.

Convergent validity

Using hypothesized relationships of nutrient intakes and food behaviours, convergent validity was examined using the mean of three 24 h dietary recalls. Given that many of the variables were not normally distributed, Spearman correlation coefficients were calculated to evaluate associations of FBC items and sub-scales with hypothesized dietary recall variables. Correlation coefficients were considered statistically significant if a relationship was hypothesized (i.e. milk consumption and calcium intake) and the P value was less than 0·05. For dichotomous items (yes/no responses), t tests were used. In addition, t tests were also used to compare the means of items expected to yield the same results, in the same units, in lieu of the method used by Bland and Altman(Reference Bland and Altman27).

Results

Sample and characteristics

A group of seventy-one participants provided data for the reliability study. Of the ninety women recruited for the validation study, eight did not complete all three days of dietary data collection or did not supply all of the necessary data, generating a final sample of eighty-two. Data for 153 participants were included in the factor analysis.

On average, the women in the validation study were 36 years old and had spent 12 years in the USA. Administration of the BAS(Reference Marin and Gamba17) yielded a mean score of 15·2 on the Hispanic scale and 4·7 on the non-Hispanic, with a score of ≥12 indicating a high level of adherence to the cultural domain. Average household size was 4·5 (sd 1·3) members. Participants had a mean BMI of 31·1 (sd 6·7) kg/m2 and an average waist circumference of 93·6 (sd 16·8) cm. Participants recruited for the reliability study were not asked to provide demographic information. Because they were recruited at the same sites as participants in the validation study, we have no reason to suspect they possess different demographic characteristics.

Table 1 shows the mean consumption of food groups or nutrients from the three 24 h recalls for these low-income Spanish-speaking women.

Table 1 Mean consumption of food groups and nutrients from 24 h recalls for low-income Spanish-speaking women in California (n 82)

AI, Adequate Intake; N/A, not applicable.

Food security

Food security of household adults was classified into one of four ranges on the continuum of food security using the USDA HFSSM(Reference Nord, Andrews and Carlson21). The mean result was 3·0, indicating the presence of marginal food security. Approximately 55 % of participants were classified as having high food security, 35 % as having marginal food security, 9 % as having low food security and 1 % as having very low food security(28).

Food behaviour checklist

Item analysis

The mean and standard deviation of the responses for each item on the FBC are shown in Table 2.

Table 2 Factor validity and item analysis for twenty-three items in the food behaviour checklist for low-income Spanish-speaking women in California (n 154)

veg, vegetables; svgs, servings; N/A, not applicable.

†All items were re-coded on a 4-point scale, with a higher score indicating more favourable behaviour. Dichotomous items with mean >2·6 and all other items with mean >3 were considered to have little potential to reflect behaviour change.

‡English translation not included in questionnaire; provided here for the reader's convenience.

§Every day = 4, often = 3, sometimes = 2, no = 1.

∥Open-ended question: 0 servings = 1, 1 serving = 2, 2 servings = 3, >2 servings = 4.

¶Almost always = 4, often = 3, sometimes = 2, no = 1.

††3 cups or more = 4, 2·5 cups = 3·5, 2 cups = 3, 1·5 cups = 2·5, 1 cup = 2, 0·5 cup = 1·5, none = 1.

‡‡Administered to a subset of the sample only (n 76).

§§Yes = 3, no = 1.

∥∥Almost always = 1, often = 2, sometimes = 3, no = 4.

¶¶Excellent = 4, poor = 1.

†††Yes = 1, no = 3.

‡‡‡Every day = 1, often = 2, sometimes = 3, no = 4.

Factor validity

For use in the community, our goal was to have sub-scales that made logical sense to the health educator administering the FBC and the low-income client participating in the nutrition education programmes. For example, the fruit and vegetable sub-scale should contain only fruit and vegetable items, even though fat-related items performed well as surrogates of fruit and vegetable behaviours in our earlier study with low-literate English speakers(Reference Townsend, Kaiser and Allen9, Reference Murphy, Kaiser and Townsend10). Correspondingly, the fat sub-scales should only contain fat items. Our initial step was a factor analysis of the ten fruit and vegetable items. Nine of the ten items met the criteria for loading on two factors. Six items loaded on the first factor and included both fruit and vegetable items. Three vegetable items load on the second factor. The citrus item was retained by itself, as it did not load on either factor at >0·50. As this interpretation would be confusing for USDA programme participants and the educators, we repeated the analysis with one factor. Nine items loaded on the one factor (Table 2). Again, the citrus item did not meet the loading criterion. Conceptually, the latter analysis made more sense and was preferred by educators and clients.

Second, we segregated the two milk/dairy items (milk/dairy sub-scale) and the one food security item (food security sub-scale). Third, the remaining ten items were factor analysed. The principal component analysis produced three factors. Four items loaded on the first factor, labelled the ‘Diet Quality’ sub-scale. Three items loaded on the second factor, labelled ‘Fast Food’. Two items loaded on the third factor, labelled ‘Sweetened Beverages’. One item about eating red meat did not meet the criterion of >0·50 for any of the three factors. The red meat item was retained separately (Table 2).

Internal consistency

The internal consistency of the fruit and vegetable sub-scale was excellent (α = 0·80), while that for the diet quality sub-scale was understandably lower (α = 0·49) given the few items in the sub-scale (Table 3). It is important to note that, in general, the coefficient increases as the number of items in the scale increases. The optimal number of items for a scale is often ten to fifteen; the dietary quality sub-scale includes only four, as the tool is intended to be brief for use in the community. For the two-item dairy sub-scale, the Spearman's correlation coefficient was 0·42. While this is a relatively low correlation in comparison to α for the fruit and vegetable sub-scale, this finding is desirable given that there are only two questions assessing milk/dairy behaviours. If we were to discover a high correlation between the two items, we would assume measurement of the same behaviour associated with the construct and would eliminate one item, as our goal is a parsimonious tool. The moderate correlation indicates that the two items reflect different behaviours within the dairy domain construct, which is desirable in terms of capturing important behaviours related to dairy consumption. A correlation of 0·26 was found for the two sweetened beverage items (Table 3).

Table 3 Internal consistency, test–retest reliability and convergent validity for food behaviour checklist sub-scales for a sample of low-income Spanish-speaking women in California

r, Spearman's correlation coefficient; ICC, intraclass correlation coefficient; N/A, not applicable; RE, retinol equivalents; USDA, US Department of Agriculture; oz-eq, ounce-equivalents; CHO, carbohydrate; sat, saturated.

*P < 0·05, **P < 0·01, ***P < 0·001, ****P < 0·0001. NS: P > 0·05.

†Questions re-coded on 4-point scale with higher scores reflecting a healthier diet.

‡Cronbach's α for sub-scales with three or more items; Spearman's r for sub-scales with two items. Validity and reliability databases combined for a total sample size of 154.

§Test–retest reliability analysis excludes items that refer to the past week or yesterday.

IIScale excludes citrus item.

¶Test–retest reliability includes only one item: drink milk.

††Food security item validated using the USDA Household Food Security Survey Module.

‡‡Scale includes the following items: eat fish in the past week, take skin off chicken, use food label when shopping and rate eating habits.

§§Scale includes the following items: fried snacks yesterday, fried food yesterday and fast food yesterday.

∥∥Scale includes the following items: drink fruit drinks, sport drinks or punch and drink regular soda.

¶¶Total scale excludes citrus item.

Test–retest reliability

All fifteen items tested in the reliability portion of the study met the criterion (P < 0·05) for acceptability using Spearman's correlation coefficients (Table 4). Values ranged from 0·35 to 0·79 (mean 0·56). Intraclass correlation coefficients are also shown, and ranged from 0·34 to 0·81 (mean 0·55). The seven items that referred to ‘yesterday’ or ‘the past week’ were excluded from the analysis.

Table 4 Test–retest reliability, convergent validity coefficients and hypothesized relationships for food behaviour checklist items and sub-scales with dietary recall variables for a sample of low-income Spanish-speaking women in California

r, Spearman's correlation coefficient; ICC, intraclass correlation coefficient; RE, retinol equivalents; DFE, dietary folate equivalents; sat, saturated; veg, vegetables; svgs, servings; USDA, US Department of Agriculture; HFSSM, Household Food Security Survey Module; oz-eq, ounce-equivalents; CHO, carbohydrate; N/A, not applicable.

All questions re-coded on a 4-point scale.

*P < 0·05, **P < 0·01, ***P < 0·001, ****P < 0·0001.

†Correlations with dichotomous variables are t tests.

‡Every day = 4, often = 3, sometimes = 2, no = 1.

§English translation not included in questionnaire; provided here for the reader's convenience.

∥Open-ended question: 0 servings = 1, 1 serving = 2, 2 servings = 3, >2 servings = 4.

¶Almost always = 4, often = 3, sometimes = 2, no = 1.

†3 cups or more = 4, 2·5 cups = 3·5, 2 cups = 3, 1·5 cups = 2·5, 1 cup = 2, 0·5 cup = 1·5, none = 1.

‡‡Yes = 3, no = 1.

§§Almost always = 1, often = 2, sometimes = 3, no = 4.

∥∥Excellent = 4, poor = 1.

¶¶Yes = 1, no = 3.

†††Every day = 1, often = 2, sometimes = 3, no = 4.

‡‡‡Correlation marked as significant to reflect t test results. Values indicate mean intake (sd).

Convergent validity

A list of hypothesized correlations with dietary recall variables for each category or sub-scale of food behaviour items is shown in Table 4, with nineteen FBC items showing statistically significant correlations with hypothesized nutrient intake. For seven dichotomous items, t tests provided a comparison of means.

All items were re-coded so that higher scores reflect a healthier diet. Item 21 in Table 4, regular soda behaviour, may be used as an example of how to interpret table results. For this item, a negative correlation is indicated between item response and saturated fat. With re-coding, a higher score represents lower intake of regular soda; thus, those who consumed more regular soda had greater intakes of saturated fat (r = −0·26, 95 % CI −0·45, −0·04) and more total sugars (r = −0·33, 95 % CI −0·51, −0·12).

For the fruit, vegetable and dairy items, associations were positive for several relevant nutrients. People reporting more desirable behaviours related to these foods also reported diets of higher quality. Of these FBC items, six were significantly correlated with the corresponding MyPyramid cups from 24 h recalls. For the two items measured in the same units using both the FBC and recall, cups of fruit and cups of vegetables, we conducted paired t tests to determine similarity between the means(Reference Bland and Altman27). In both cases, the means from the recalls were significantly higher than the means resulting from the FBC (not shown). One fat and cholesterol item was significantly correlated with fat or cholesterol intake and MyPyramid ounce-equivalents of meat from the recalls (Table 4).

Use of the food label to choose foods was negatively associated with intakes of total fat (r = −0·35, 95 % CI −0·52, −0·14), saturated fat (r = −0·33, 95 % CI −0·51, −0·12) and trans fat (r = −0·35, 95 % CI −0·52, −0·14). Conversely, those who consumed fruit drinks, sport drinks or punch had higher intakes of saturated fat (r = −0·24, 95 % CI −0·44, −0·02), total sugars (r = −0·28, 95 % CI −0·47, −0·06) and net carbohydrate (r = −0·34, 95 % CI −0·52, −0·13), with re-coding so that a higher score represents lower intake. The food security item was significantly correlated with responses on the USDA eighteen-item HFSSM (r = 0·42, 95 % CI 0·22, 0·59; Table 4).

Several of the items examined did not meet the minimum requirement for significance as indicated by the confidence intervals. These items included eating two or more vegetables at the main meal, drinking milk, and having citrus fruit or juice in the past week (Table 4).

Total scores for each sub-scale were correlated with specific nutrient intakes from 24 h recalls, revealing a significant relationship between sub-scale scores and several relevant nutrients (Table 3).

Item reduction

Using factor analysis, correlation coefficients for test–retest reliability, correlation coefficients with nutrient intake from 24 h recalls and item analysis results, items were considered for deletion. One item, ‘citrus fruit or citrus juice during the past week’, was selected for deletion. This item showed little potential to reflect behaviour change based on its high mean response value, did not load with the other fruit and vegetable items in the factor analysis, and did not correlate with nutrient intake from 24 h recalls. Other marginal items were retained for further study. The final checklist contains twenty-two items.

Discussion

In the present study we examined factorial and convergent validity and reliability of a Spanish-language FBC. Our purpose was to assess the validity of items and sub-scales and to use those results to select well-performing items for the checklist.

The study explored ten food behaviours related to fruit and vegetable intake. Of these, nine items loaded on one factor and seven were significantly correlated with recall nutrient intake (Table 4). While the remaining three – ‘more than one kind of vegetable’, ‘servings of vegetables’ (i.e. from the Food Guide Pyramid guidelines) and ‘cups of vegetables’ (i.e. from the MyPyramid guidelines) – did not show hypothesized correlations with nutrient intake, they are retained for further study because they loaded with other items on the fruit/vegetable construct. As previously mentioned the citrus item was selected for deletion, as it did not load with other items in the factor analysis and did not show the hypothesized correlation with vitamin C intake. Although correlating weakly with folate intake and containing some folate, this was not the main hypothesized relationship and was not considered justification for item retention.

In addition to the Spearman's correlation coefficients calculated for the fruit/vegetable items, we also performed paired t tests for two items measured in the same units in the FBC and recalls, cups of fruit and cups of vegetables. This analysis was performed as an alternative to the Bland and Altman approach(Reference Bland and Altman27), as their method is most appropriate with continuous variables and these two items are able to take on a limited number of values. In both cases, values were significantly higher using the recalls. This result may indicate a need for further testing and development of appropriate visuals for these two items. The current items ask clients to estimate their consumption using visuals of liquid measuring cups filled with fruits and vegetables, while clients used actual dry measuring cups during the recall. Further testing may reveal a more appropriate way to represent the concept of ‘cups’ in the questionnaire.

Several FBC items were associated with fruit and vegetable intake, serving as surrogates of consumption of these foods. Three fast food items – ‘fried snacks yesterday’, ‘fried food yesterday’ and ‘fast food yesterday’ – and one diet quality item – ‘fish in the past week’ – showed significant correlations with vitamins A and K (Table 4), two micronutrients found predominantly in fruit and vegetables. It is not surprising that women choosing low-fat protein sources such as fish would also consume a diet rich in fruit and vegetables; conversely, those who regularly consume fried and fast food would presumably consume fewer fruit and vegetables. It is important to note that similar results were found in our FBC study with low-income English-speaking clients(Reference Townsend, Kaiser and Allen9, Reference Murphy, Kaiser and Townsend10).

A factor analysis identifies those items correlated with a latent variable representing a construct(Reference Litwin14). Such an analysis revealed that while fat-related items such as ‘fast food yesterday’ and ‘fried food yesterday’ showed strong loading on the same latent variable or factor, ‘fruit drinks, sport drinks or punch’ and ‘regular soda’ did not load with them. This result may seem surprising given that the two beverage items were correlated with fat intake. One explanation is that the amount of soda the participant drank was independent of the amount of fast food and fried food she consumed. Because many people drink soda and other sweetened beverages at home or work apart from at mealtimes, this result seems plausible.

This Spanish-language checklist(Reference Banna, Townsend and Sylva29) contained four items related to fat/cholesterol intake not found in the English version(Reference Sylva, Townsend and Martin30). Previous studies have reported differences in consumption of fat intake across ethnic groups(Reference Murtaugh, Herrick and Sweeney31, Reference Kristal, Shattuck and Patterson32). Murtaugh et al. reported that, compared with non-Hispanic whites, Hispanic women living in the south-west USA consumed a greater proportion of energy from fat(Reference Murtaugh, Herrick and Sweeney31). Kristal et al. found that Hispanics consumed more fat from fried vegetables and also consumed more fat from meat than whites(Reference Kristal, Shattuck and Patterson32). The additional questions were intended to capture differences between English and Spanish speakers, expand the sub-scale and identify behaviours that best reflected fat intake.

One of six original fat and cholesterol items, ‘eating red meat or pork yesterday’, showed significant correlations with fat, saturated fat and cholesterol intake, as well as MyPyramid ounce-equivalents of meat from 24 h recalls (selected correlations shown in Table 4). Surprisingly, ‘using the label when food shopping’, with a visual of a Latina reading a nutrition food label on a box of cereal in a supermarket, performed well in terms of reliability (r = 0·74) and validity against multiple measures of fat and sugar (Table 4). Likewise, a mediator of dietary behaviours, ‘rating your eating habits’, also performed well in terms of reliability (r = 0·79) and validity (i.e. calcium, pantothenic acid, vitamin A). Overall, however, the original fat and cholesterol items performed better as surrogates of fruit and vegetable behaviours, with inverse correlations with vitamins A and K, than as items for fat behaviours (Table 4). Several previous validation studies have also reported relatively low correlations between fat-related items and fat and cholesterol intake(Reference Coates, Serdula and Byers33). Researchers hypothesized that this may have resulted from omission of key fat-related behaviours, namely use of vegetable oil and lard in cooking, refried beans and tortillas. While our FBC measured fat behaviours in terms of red meat and fried sources, some other relevant behaviours may be lacking. An alternative explanation is that client perceptions of high-fat foods and high/low-fat diets may be inaccurate. Further research is recommended.

One particular finding to note is the correlation between the sweetened beverage sub-scale and net carbohydrate (Table 3) as well as each sweetened beverage item and net carbohydrate (Table 4). As hypothesized, this relationship indicates an increase in carbohydrate with an increase in consumption of regular soda and fruit drinks, sport drinks and punch. Given that the majority of carbohydrate in the diet likely comes from simple sugars in sweetened beverages in this population, this correlation is logical.

As hypothesized, there was a significant correlation between responses to the food security item and the food security level derived from the 18-item USDA scale. Contrary to our expectations, the food security item did not show any associations with nutrient intake, unlike the English version of the FBC(Reference Townsend, Kaiser and Allen9, Reference Murphy, Kaiser and Townsend10).

The present study examined the validity and reliability of a Spanish-language FBC that was based on an English-language version found previously to have adequate psychometric properties in an English-speaking population(Reference Townsend, Kaiser and Allen9, Reference Murphy, Kaiser and Townsend10). Using visual information processing theories the readability of the checklist was improved, increasing its ability to accurately capture existing changes in dietary behaviour(Reference Townsend, Sylva and Martin8, Reference Townsend, Sylva and Martin16). Readability of the text of the final twenty-two-item FBC was estimated to be 71 using the Fernández-Huerta formula(Reference Fernández-Huerta34), the equivalent of the Flesch Reading Ease for English text(Reference Kincaid, Fishburne and Rogers35). This score indicates a ‘fairly easy’ reading level. No formula calculates readability of text with visuals(Reference Banna, Vera Becerra and Kaiser15).

Members of the Network for a Healthy California, as well as nutrition education programmes in other states, are currently using the Spanish-language FBC(Reference Banna, Vera Becerra and Kaiser15) and instruction guide(Reference Banna, Townsend and Vera Becerra19) with Spanish speakers and the English-language FBC(Reference Townsend, Sylva and Martin8Reference Murphy, Kaiser and Townsend10, Reference Sylva, Townsend and Martin30) and instruction guide(Reference Townsend, Davidson and Leaven36) with English speakers. These instruments have a low respondent burden, are easy to administer in a group setting and assess eating behaviours that have known associations with risk of chronic disease contained within sub-scales(Reference Townsend, Sylva and Martin8, Reference Townsend, Kaiser and Allen9, Reference Townsend11, Reference Banna, Vera Becerra and Kaiser15).

As a result of the study reported herein, the current version of the Spanish tool contains twenty-two items and seven sub-scales composed of nine items on fruit and vegetables, four on diet quality, three on fast food, two on dairy/calcium, two on sweetened beverages, one on meat and one food on security.

Limitations

Use of a convenience sample reduced the external validity of these findings by limiting generalizability to other Spanish-speaking audiences(Reference Campbell and Stanley37). While collecting three recalls instead of one provides a more accurate representation of usual diet, this self-report method remains imperfect(Reference Sempos, Johnson and Smith38) and is subject to variations in respondents’ cognitive ability and other forms of bias(Reference Subar, Kipnis and Troiano39).

Applications

The new versions of the FBC (available from the second author) and instruction guide (available from the second author) will be used to evaluate nutrition education interventions among low-income Spanish speakers in community settings in California(Reference Banna, Townsend and Sylva29). Nutrition educators seeking to improve food behaviours of participants in the EFNEP (Expanded Food and Nutrition Education Program), WIC (Special Supplemental Nutrition Program for Women, Infants, and Children) and SNAP-Ed may be able to use the valid items and sub-scales when designing evaluation instruments for low-literate Spanish speakers. The FBC offers advantages over the 24 h recall as an evaluation tool as it is less time-intensive, focuses on specific behaviours presented in the intervention, can be administered to small and large groups, and does not require an interviewer trained in administering diet recalls. Evaluation of these nutrition education programmes will ensure programme integrity and continued funding. This research contributes to the growing body of knowledge regarding food behaviours among Spanish speakers in the USA and may be incorporated into future endeavours to educate at-risk populations.

Acknowledgements

Sources of funding: The study was supported by the USDA Food Stamp Program via the Network for a Healthy California; University of California Cooperative Extension; and the Gustavus and Louise Pfeiffer Research Foundation through the Program in International and Community Nutrition, UC Davis. Conflict of interest: Neither author has conflicts of interest to report. Author contributions: J.C.B. conducted the literature review, hiring and training of the data collection team, and management of data collection, data entry and analysis. M.S.T. was the principal investigator responsible for grant preparation, the research study and supervision of graduate student. Both authors participated in interpretation of data and preparation of the manuscript. Acknowledgments: The authors thank Sharon Sugerman for her contribution to the study protocol and budget calculations; Myriam Grajales-Hall, Gloria Espinosa-Hall and Luz Elvia Vera Becerra for their work on questionnaire translations; and Kathryn Sylva and Lynn-Kai Chao for their work on questionnaire photographs. They also thank Andy Fourney, Monica Perez, Carmen C. Heredia, Ignacio Romero, Virginia Chaidez and Joan Gonen for their assistance with the Spanish translations for the instruction guide, and Christine Davidson and Larissa Leavens for their review of the guide.

References

1.US Census Bureau (2005) US Population 2005, American Community Survey. http://factfinder.census.gov/home/saff/main.html?_lang=en (accessed December 2009).Google Scholar
2.American Heart Association Heart (2005) Disease and Stroke Statistics – 2005. http://www.americanheart.org/downloadable/heart/1265665152970DS-3241%20HeartStrokeUpdate_2010.pdf(accessed December 2009).Google Scholar
3.Jordan, C, Slater, M & Kottke, T (2008) Preventing chronic disease risk factors: rationale and feasibility. Medicina (Kaunas) 44, 745750.CrossRefGoogle ScholarPubMed
4.Thompson, B, Demark-Wahnefried, W, Taylor, G et al. (1999) Baseline fruit and vegetable intake among adults in seven 5 a Day study centers located in diverse geographic areas. J Am Diet Assoc 99, 12411248.CrossRefGoogle Scholar
5.Kristal, A, Abrams, B, Thornquist, M et al. (1990) Development and validation of a food use checklist for evaluation of community nutrition interventions. Am J Public Health 80, 13181322.CrossRefGoogle ScholarPubMed
6.Connor, S, Gustafon, J, Sexton, G et al. (1992) The Diet Habits Survey: a new method of dietary assessment that relates to plasma cholesterol changes. J Am Diet Assoc 92, 4147.CrossRefGoogle ScholarPubMed
7.Wakimoto, P, Block, G, Mandel, S et al. (2006) Development and reliability of brief dietary assessment tools for Hispanics. Prev Chronic Dis 3, 112.Google ScholarPubMed
8.Townsend, MS, Sylva, K, Martin, A et al. (2008) Improving readability for an evaluation tool for low-income clients using visual information processing theories. J Nutr Educ Behav 40, 181186.CrossRefGoogle ScholarPubMed
9.Townsend, MS, Kaiser, LL, Allen, LH et al. (2003) Selecting items for a food behavior checklist for a limited resource audience. J Nutr Educ Behav 35, 6982.CrossRefGoogle ScholarPubMed
10.Murphy, SP, Kaiser, LL, Townsend, MS et al. (2001) Evaluation of validity of items for a food behavior checklist. J Am Diet Assoc 101, 751756.CrossRefGoogle ScholarPubMed
11.Townsend, MS (2006) Evaluating food stamp nutrition education: process for development and validation of evaluation measures. J Nutr Educ Behav 38, 1824.CrossRefGoogle ScholarPubMed
12.Townsend, MS & Kaiser, LL (2007) Brief psychosocial fruit and vegetable tool is sensitive for United States Department of Agriculture's nutrition education programs. J Am Diet Assoc 107, 21202124.CrossRefGoogle ScholarPubMed
13.Geisinger, K (1994) Cross-cultural normative assessment: translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychol Assess 6, 304312.CrossRefGoogle Scholar
14.Litwin, M (1995) How to Measure Survey Reliability and Validity. Thousand Oaks, CA: Sage Publications.CrossRefGoogle Scholar
15.Banna, JC, Vera Becerra, LE, Kaiser, LL et al. (2010) Using qualitative methods to improve questionnaires for Spanish speakers: assessing face validity of a food behavior checklist. J Am Diet Assoc 110, 8090.CrossRefGoogle ScholarPubMed
16.Townsend, MS, Sylva, K, Martin, A et al. (2005) Visually enhanced evaluation for low-income clients. J Nutr Educ Behav 37, S49.Google Scholar
17.Marin, G & Gamba, R (1996) A new measurement of acculturation for Hispanics: the bidimensional acculturation scale for Hispanics (BAS). Hisp J Behav Sci 18, 297316.CrossRefGoogle Scholar
18.Frisancho, A (1990) Anthropometric Standards for the Assessment of Growth and Nutritional Status. Ann Arbor, MI: University of Michigan Press.CrossRefGoogle Scholar
19.Banna, JC, Townsend, MS, Vera Becerra, LE et al. (2007) Administering the Food Stamp Program food behavior checklist for Spanish speakers: instruction guide. Public Health Institute, California Department of Health Services; available at http://townsendlab.ucdavis.eduPDF_files/SPA/SPA_FBC_IG_6608.pdfGoogle Scholar
20.Moshfegh, A, Raper, N, Ingwersen, L et al. (2001) An improved approach to 24-hour dietary recall methodology. Ann Nutr Metab 45, Suppl. 1, 156.Google Scholar
21.Nord, M, Andrews, M & Carlson, S (2008) Household Food Security in the United States, 2008. Washington, DC: US Department of Agriculture, Economic Research Service; available at http://www.ers.usda.gov/Publications/err83/dbgen.htmGoogle Scholar
22.Harrison, G, Stormer, A, Herman, D et al. (2003) Development of a Spanish-language version of the US household food security survey module. J Nutr 133, 11921197.CrossRefGoogle ScholarPubMed
23.Nunnally, J & Bernstein, I (1994) Psychometric Theory, 3rd ed. New York: McGraw-Hill.Google Scholar
24.DeVon, HA, Moyle-Wright, P, Ernst, DM et al. (2007) A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh 39, 155164.CrossRefGoogle ScholarPubMed
25.Maruti, SS, Feskanich, D, Colditz, GA et al. (2005) Adult recall of adolescent diet: reproducibility and comparison with maternal reporting. Am J Epidemiol 161, 8997.CrossRefGoogle ScholarPubMed
26.Fernández-Ballart, JD, Lluís Piñol, J, Zazpe, I et al. (2010) Relative validity of a semi-quantitative food-frequency questionnaire in an elderly Mediterranean population of Spain. Br J Nutr 103, 18081816.CrossRefGoogle Scholar
27.Bland, JM & Altman, DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 8, 307310.CrossRefGoogle Scholar
28.National Research Council (2006) Food Insecurity and Hunger in the United States: An Assessment of the Measure. Washington, DC: National Academies Press; available at http://www7.nationalacademies.org/cnstat/Food%20Insecurity.htmlGoogle Scholar
29.Banna, JC, Townsend, MS & Sylva, K (2009) University of California Cooperative Extension lista de hábitos alimenticios (food behavior checklist) (Spanish, 22 items reflecting both MyPyramid & Food Guide Pyramid Food Guidance Systems and results of factorial & convergent validation study; Visually enhanced food behavior checklist in 6-page booklet designed for clients with limited literacy skills). Davis, CA: University of California Davis; available at http://townsendlab.ucdavis.eduPDF_files/SPA/SPA_FBC_booklet.pdfGoogle Scholar
30.Sylva, K, Townsend, MS, Martin, A et al. (2006) Food Stamp Program food behavior checklist (English, 16 items reflecting the Food Guide Pyramid guidelines; Visually enhanced food behavior checklist in 4 page booklet designed for clients with limited literacy skills). Oakland, CA: Public Health Institute, California Department of Health; available at http://townsendlab.ucdavis.eduPDF_files/FSP/FSP_FBC_booklet.pdfGoogle Scholar
31.Murtaugh, M, Herrick, J, Sweeney, C et al. (2007) Diet composition and risk of overweight and obesity in women living in the Southwestern United States. J Am Diet Assoc 107, 13111321.CrossRefGoogle ScholarPubMed
32.Kristal, A, Shattuck, AL & Patterson, R (1999) Differences in fat-related dietary patterns between black, Hispanic and white women: results from the Women's Health Trial Feasibility Study in minority populations. Public Health Nutr 2, 253262.CrossRefGoogle ScholarPubMed
33.Coates, R, Serdula, M, Byers, T et al. (1995) A brief, telephone-administered food frequency questionnaire can be useful for surveillance of dietary fat intakes. J Nutr 125, 14731483.Google ScholarPubMed
34.Fernández-Huerta, J (1959) Medidas sencillas de lecturabilidad. Consigna 214, 2932.Google Scholar
35.Kincaid, J, Fishburne, R, Rogers, R et al. (1975) Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel. Milington, TN: Naval Technical Training, US Naval Air Station.CrossRefGoogle Scholar
36.Townsend, MS, Davidson, C, Leaven, L et al. (2006) Administering the Food Stamp Program food behavior checklist: instruction guide. Oakland, CA: Public Health Institute, California Department of Health Services; available at http://townsendlab.ucdavis.eduPDF_files/FSP/FSP_FBC_InstructGuide.pdfGoogle Scholar
37.Campbell, D & Stanley, J (1966) Experimental and Quasi-experimental Designs for Research. Chicago, IL: Rand McNally.Google Scholar
38.Sempos, C, Johnson, N, Smith, E et al. (1985) Effects of intraindividual and interindividual variation in repeated dietary records. Am J Epidemiol 121, 120130.CrossRefGoogle ScholarPubMed
39.Subar, A, Kipnis, V, Troiano, R et al. (2003) Using intake biomarkers to evaluate the extent of dietary misreporting in a large sample of adults; the OPEN study. Am J Epidemiol 158, 113.CrossRefGoogle Scholar
Figure 0

Table 1 Mean consumption of food groups and nutrients from 24 h recalls for low-income Spanish-speaking women in California (n 82)

Figure 1

Table 2 Factor validity and item analysis for twenty-three items in the food behaviour checklist for low-income Spanish-speaking women in California (n 154)

Figure 2

Table 3 Internal consistency, test–retest reliability and convergent validity for food behaviour checklist sub-scales for a sample of low-income Spanish-speaking women in California

Figure 3

Table 4 Test–retest reliability, convergent validity coefficients and hypothesized relationships for food behaviour checklist items and sub-scales with dietary recall variables for a sample of low-income Spanish-speaking women in California