Coeliac disease (CD), a gluten-induced chronic enteropathy, is a very common condition characterised by increased mortality(Reference Biagi, Klersy and Balduzzi1, Reference Biagi and Corazza2). Although increased mortality is due to a combination of malignancy, infection and CVD(Reference Biagi and Corazza2, Reference Grainge, West and Card3), it was realised almost 30 years ago that mortality was mainly due to malignancies induced by poor adherence to a gluten-free diet (GFD)(Reference Leonard, Tucker and Fry4, Reference Holmes, Prior and Lane5); to date, it is not yet clear what is the best method to check whether patients are on a strict GFD(Reference Pietzak6). The ‘gold standard’ is currently represented by a time-consuming dietary interview performed by expert personnel(Reference Pietzak6).
We recently developed a score based on just four very simple questions that could be administered in less than 1 min even by non-expert personnel(Reference Biagi, Andrealli and Bianchi7). Since the impossibility of knowing exactly what and, above all, how much gluten a person eats has already been pointed out(Reference Hopman, Kiefte-de Jong and le Cessie8), our questionnaire is not based on the detection of how much gluten a coeliac patient consumes, but it is based on the analysis of the strategy performed by the patient to avoid gluten consumption. It is, therefore, a score that bypasses the problems linked not only to inadvertent gluten intake but also to cultural differences between patients and doctors and dietitians, which make it virtually impossible to compare GFD adherence in different groups of patients.
Our previous study had some limitations. First, the necessity that the patient has been appropriately instructed by an expert dietitian as to what a GFD really means and the fact, not always the case, that the patient is telling the truth. Second, it was based on a longitudinal retrospective study, which means that patients answered the questionnaire some time after the serological and histological tests had been carried out and were not blinded, as they knew the serological and histological results before the survey. This may have introduced an information bias as patients who were found to be positive either by serology or histology were likely to have been recalled about their compliance to the diet and were more likely to have realised that they had made errors. Finally, the study was performed in a single-referral centre. Although our previous study made it possible to show that there was a strong correlation between score results and persistence of villous atrophy and coeliac serology, it certainly cannot be considered to be representative of the use of the score in a ‘real-life’ clinical setting.
We organised the present study to verify the reliability of our compliance to a GFD score in a multicentre way. Since it is based on the histological and serological results obtained in each single centre, without centralising the assessments altogether, our final results are very close to everyday clinical practice.
Methods
The questionnaire
The questionnaire and the rationale on which it was based have been extensively described elsewhere (Fig. 1)(Reference Biagi, Andrealli and Bianchi7). Briefly, it consists of just a few questions that could be administered in a few minutes even by non-expert personnel. The numerical result makes it possible to monitor the strictness of GFD compliance over time and to compare it between different groups of patients, regardless of ethnic group. Although the questionnaire was drawn up in the form of an algorithm based on our clinical experience, the importance of the questions we asked has also been stressed by other authors(Reference Leffler, Dennis and Edwards George9–Reference Leffler, Edwards-George and Dennis11). The final score of the questionnaire is made up of five levels (0–4), which, from a clinical point of view, can be grouped into three levels. Patients with a score of 0 or 1 do not follow a strict GFD, whereas patients with a score of 2 follow a GFD but with important errors that require correction. Patients with a score of 3 or 4 follow a strict GFD. It should be noted that the final question, which in some countries cannot be asked because local coeliac societies do not provide lists of packaged gluten-free food, could be omitted without affecting the final result of the score.
Questionnaire and scoring system to assess compliance with a gluten-free diet in coeliac patients. ‘Often’: the patient consumes gluten so often that he/she cannot remember when and how many times that has happened. ‘Rarely’: the patient consumes gluten only occasionally. She/he can remember when and how many times that has happened.
Patients
Between March 2008 and January 2011, four centres participating in the project administered the questionnaire to 141 coeliac patients (108 females, mean age 34 (SD 15) years) on a GFD (median 27 months, 25th–75th percentile 15–73, range 6–298), who were undergoing clinical, histological and serological re-evaluation. All these patients had been found to be affected by CD on the basis of villous atrophy and positive tissue transglutaminase or endomysial antibodies (EMA). They all received a proper instruction on a GFD from an expert dietitian. Patients were not enrolled if they were found to be affected by CD on the basis of minimal intestinal lesions or in spite of negative coeliac antibodies, or known to be suffering from refractory or complicated CD. Patients with IgA deficiency were also excluded from the study.
After signing written informed consent, patients underwent upper gastrointestinal endoscopy with multiple duodenal biopsies and EMA testing. The study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects/patients were approved by the local review board. To avoid information bias, both at patient and doctor levels, we administered the questionnaire just before the clinical re-evaluation. The period to which the questionnaire is referred to is the same as that of the GFD of each patient. The validity of the questionnaire was assessed by measuring responsiveness to the clinical condition of the patients. First, the score was assessed against the persistence of positive EMA while on a GFD. The indirect immunofluorescence assay was used to detect IgA EMA on monkey oesophagus sections(Reference Biagi, Pezzimenti and Campanella12). Patients were classified as either EMA positive or none. The score was also assessed against persistence of villous atrophy at duodenal biopsy while on a GFD. According to O'Mahony et al. (Reference O'Mahony, Howdle and Losowsky13), we did not use complete intestinal healing as a proof of adherence to a GFD. A significant improvement in duodenal biopsy was considered to be satisfactory(Reference O'Mahony, Howdle and Losowsky13). Therefore, using either Marsh or any other morphological classification of coeliac intestinal lesions to distinguish the biopsies would have been pointless. Persistent atrophy of the duodenal mucosa was thus used to classify the patients.
Statistical analysis
The association of the score with patient characteristics was assessed by means of Fisher's exact test and the test for trend. Exact logistic regression was used to compute OR and 95 % CI. Positive and negative predictive values (and 95 % CI) were computed as a measure of suspicion of histological abnormalities or EMA positivity for a series of possible scenarios (two cut-offs for the score and four possible prevalences of the anomaly). Stata 11 (Stata Corporation) was used for computation. All tests were two-sided. A P value < 0·05 was considered to be statistically significant.
Results
Table 1 shows the association between the score and the persistence of villous atrophy and EMA positivity. OR and 95 % CI were consistent with a very strong association between the score and the outcome of villous atrophy or EMA persistence. In addition, lower scores were associated with a higher rate of adverse findings. Despite being on a GFD, thirty-eight patients were still EMA positive at the time of duodenal biopsy. Patients with the persistence of EMA positivity more frequently showed the lowest scores. Of the 141 patients, twenty presented persistence of villous atrophy at the time of duodenal biopsy despite being on a GFD. Patients with the persistence of villous atrophy more frequently showed the lowest scores.
Association of the grouped score with patient characteristics (Odds ratios and 95 % confidence intervals)
GFD, gluten-free diet; EMA, endomysial antibodies.
* Fisher's exact test.
† Trend test.
‡ Exact logistic regression, stratified by centre.
§ Model P = 0·002.
∥ Model P < 0·001.
Table 2 shows the positive and negative predictive values for not only the original data but also for the four different prevalences of the anomaly and for the two possible cut-offs of the score.
Positive and negative predictive values of the score to identify endomysial antibodies (EMA) positivity or villous atrophy under four different prevalences* of the anomaly and for two possible cut-offs of the score (Percentages and 95 % confidence intervals)
GFD, gluten-free diet; PPV, positive predictive value; NPV, negative predictive value.
* Prevalence from the data was 27 % for EMA positive and 14 % for villous atrophy.
The histological results were coherent with the score in the vast majority of patients, with scores 0–1 or scores 3–4 (126 out of 141, 89·3 %). Discrepancies were found in only fifteen patients scoring 0–1 or 3–4 (10·7 %). Of these fifteen patients, seven were found to have a restored duodenal mucosa despite a score of 0 or 1. It is possible that voluntary ingestion of gluten had occurred much earlier than the clinical re-evaluation, and so the mucosa had had time to recover (unfortunately, when we planned the present study, we did not think of recording when the gluten ingestion had occurred). The other eight patients were found to have a flat duodenal mucosa in spite of a score of 4. Since three of them also were found to be positive to EMA, it is possible that they did not report the entire truth during the interview. On the other hand, the last five patients with villous atrophy but negative EMA are currently under investigation to verify whether they are affected by either a slow-responder or a refractory form of CD. A patient scoring 0 died because of complicated CD. Finally, although a score of 2 indicates a poor compliance to a GFD that needs to be improved, only one patient showed persistence of villous atrophy. However, only seven patients scored 2, and so it is quite difficult to draw any conclusions on this score level.
Discussion
In order to validate compliance to a GFD score, similarly to our retrospective study(Reference Biagi, Andrealli and Bianchi7), we assessed its responsiveness against both histological and serological responses to a GFD. Histology is certainly the most valid method for evaluating compliance with a GFD(Reference Pietzak6, Reference Rubio-Tapia, Rahim and See14), and, although serology is not sensitive enough to detect occasional intake of gluten(Reference Troncone, Mayer and Spagnuolo15), it is certainly one of the most commonly used methods(Reference Pietzak6). On the other hand, we did not assess it against clinical response to a GFD. Apart from the fact that many patients are nowadays asymptomatic and are found to be affected by CD because of serological screening on relatives or associated autoimmune conditions, we and others(Reference Rubio-Tapia, Rahim and See14, Reference Biagi, Campanella and Martucci16) have shown that clinical response to a GFD is not invariably associated with mucosal recovery, and we have recently shown that clinical response to a GFD can occur even in non-coeliac patients(Reference Campanella, Biagi and Bianchi17). One could argue that our system simply reflects a subjective evaluation. In our initial retrospective evaluation, we showed that there was a considerable discrepancy between score and subjective evaluation(Reference Biagi, Andrealli and Bianchi7). Finally, we were unable to make a comparison with a classic dietary interview, as this would have included an information bias in the study: patients will know the result of the first interview and this will inevitably influence his/her answers to the second one.
In the present study, we showed that our system does indeed verify adherence to a GFD in coeliac patients. We were very impressed to see that the present results are even better than those we obtained in our preliminary, retrospective and single-centre study(Reference Biagi, Andrealli and Bianchi7). Moreover, it should be noted that the results we showed here are the sum of all the results obtained independently by the four centres. Moreover, patient education about CD, level of education and socio-economic status were not uniform and were not standardised. So, the present results can certainly be considered to be representative of what happens in real clinical life. Having found good negative predictive values further supports that our system does really identify patients without the persistence of EMA positivity and villous atrophy.
All this evidence clearly shows that our score is a reliable tool to check GFD adherence in coeliac patients. It is extremely rapid and simple and can also be administered even by personnel without specific experience in CD. However, this does not reduce the importance of expert dietitians who have the initial role of educating new coeliac patients regarding a GFD(Reference Case18). We underline that our score can be applied only to patients who have been well instructed on what a GFD means and on how to follow it.
The numerical result would thus make it possible to monitor the patient's compliance with the GFD over time and to make comparisons between different groups of patients. This possibility of comparing different groups of patients is made even easier by the fact that our score is not based on an assessment of what the patient eats, which would make it very difficult to compare patients from different countries or with different cultural backgrounds, but on the strategies that the patient uses to avoid eating gluten, regardless of the actual food eaten.
Finally, in the initial retrospective validation, we assessed our score against the survival of patients(Reference Biagi, Andrealli and Bianchi7). In the present study, this was not possible because, fortunately, only one patient died. The patient was a 63-year-old lady who developed intestinal lymphoma shortly after the diagnosis of CD. She never followed a strict GFD and scored 0 at our questionnaire.
In conclusion, our score is an extremely rapid, simple and reliable tool to check GFD compliance in CD patients. It can also be administered by personnel without specific experience in CD.
Acknowledgements
We are grateful to Susan West for reading and correcting the manuscript. This study received no funding. F. B. designed the study, interpreted the results and wrote the manuscript. P. I. B., A. M., L. T., C. V. and D. B. administered the questionnaire to the patients in Pavia and acquired the clinical, serological and histological data. G. B. administered the questionnaire to the patients in Voghera and acquired the clinical, serological and histological data. A. A., F. C. and M. A. administered the questionnaire to the patients in Turin and acquired the clinical, serological and histological data. S. P. and G. M. administered the questionnaire to the patients in Messina and acquired the clinical, serological and histological data. C. K. performed the statistical analysis. G. R. C. participated in the design of the study and in the critical revision of the manuscript. The authors declare that they have no conflicts of interest.
