Cambridge
View basketHelp
    Home > ELT > Criterion-referenced Language Testing > Chapter 4
Criterion-Referenced Language Testing Homepage
Chapter 4: Summary
Chapter 4: Key Terms
Chapter 4: Review Questions
Chapter 4: Application Exercises

Application exercises

A. Examine the data set presented in Table 4.11 and use it to calculate all of the statistics needed to fill in the results in Table 4.12.

TABLE 4.11: SCORES ON PRETEST B

STUDENT IDSCORES (B)
72113PREB41
72417PREB40
72111PREB38
72109PREB37
72403PREB36
72415PREB36
72413PREB35
72114PREB35
72103PREB34
72410PREB34
72430PREB33
72112PREB33
72404PREB32
72425PREB32
72440PREB31
72106PREB31
72414PREB31
72104PREB30
72110PREB28
72409PREB28
72420PREB28
72422PREB27
72402PREB26
72412PREB26
72101PREB26
72423PREB25
72427PREB24
72102PREB23
72429PREB16

TABLE 4.12: PRETEST RESULTS FOR FORM B

STATISTIC        PRETEST B

N
k
M
S
LOW
HIGH
RANGE

B. Examine the results shown in Table 4.13. Which test has the largest number of students? Which test has the highest central tendency? Which test has the most dispersion? Which test appears to be normally distributed? Which one is negatively skewed? Which one is positively skewed?

TABLE 4.13: IMAGINARY RESULTS FOR THREE FORMS OF A CRT

STATISTICTEST ATEST BTEST C
  N1089957
  k100100 100
  M50.5215.1185.25
  S15.1614.1013.95
  LOW8 141
  HIGH826099
  RANGE756059

C. Next, examine Table 4.14. You will note that it is exactly the same as Table 4.8 except that the cut-point for passing or failing the test has been changed to 80 percent. Recalculate the B-index, agreement statistic, and item phi for each item. Be sure to carry out and round all operations to three places to the right of the decimal point instead of the two places that we have been using in the examples. Record your answers in the spaces provided in Table 4.15. How would you interpret these new indexes? And, how do they compare to the results that were obtained when the cut-point was 70 percent (see Table 4.9)?

TABLE 4.14: ITEM ANALYSIS DATA (FIRST 10 ITEMS ONLY) FOR APPLICATIONS EXERCISE

STUDENTSITEMSTOTAL 
 1 2 3 4 5 6 7 8 9 10 etcPERCENT 
Shira1 1 1 1 1 0 1 1 0 196  
Diana0 1 1 1 1 0 1 0 0 195  
Kathy0 0 1 1 1 0 1 0 0 192 
Kate1 0 1 1 1 0 0 0 0 191 
Carolyn1 1 1 1 0 0 1 0 0 190  
Marsha1 0 1 1 0 1 1 1 0 190  
Gabi0 1 1 1 1 0 1 0 0 188 
Sasha1 0 1 1 0 0 1 0 0 180 
Robert0 1 1 1 0 1 1 0 0 179 
Eric0 1 1 1 0 1 0 0 0 1 72  
Michael1 0 0 1 1 1 1 1 0 167 
Thom1 0 0 1 0 1 0 1 0 166  
Graham1 1 0 1 0 1 0 0 0 164  
James0 0 0 1 0 1 0 1 0 164  
Byron0 0 0 1 0 1 1 0 0 061 

TABLE 4.15: ANSWERS FOR APPLICATION EXERCISE C

ITEM                    ITEMS
STATISTIC      1 2 3 4 5 6 7 8 9 10

IFtotal
IFpassed
IFfailed
B
A
Ø