Hostname: page-component-5db58dd55d-qmkzp Total loading time: 0 Render date: 2026-05-31T00:27:52.276Z Has data issue: false hasContentIssue false

A Novel Method for Detecting Intersectional DIF: Multilevel Random Item Effects Model with Regularized Gaussian Variational Estimation

Published online by Cambridge University Press:  15 September 2025

He Ren
Affiliation:
College of Education, University of Washington , Seattle, WA, USA
Weicong Lyu
Affiliation:
Faculty of Education, University of Macau , Macau, China
Chun Wang*
Affiliation:
College of Education, University of Washington , Seattle, WA, USA
Gongjun Xu*
Affiliation:
Department of Statistics, University of Michigan , Ann Arbor, MI, USA
*
Corresponding authors: Chun Wang and Gongjun Xu; Email: wang4066@uw.edu, gongjun@umich.edu
Corresponding authors: Chun Wang and Gongjun Xu; Email: wang4066@uw.edu, gongjun@umich.edu
Rights & Permissions [Opens in a new window]

Abstract

Differential item functioning (DIF) screening has long been suggested to ensure assessment fairness. Traditional DIF methods typically focus on the main effects of demographic variables on item parameters, overlooking the interactions among multiple identities. Drawing on the intersectionality framework, we define intersectional DIF as deviations in item parameters that arise from the interactions among demographic variables beyond their main effects and propose a novel item response theory (IRT) approach for detecting intersectional DIF. Under our framework, fixed effects are used to account for traditional DIF, while random item effects are introduced to capture intersectional DIF. We further introduce the concept of intersectional impact, which refers to interaction effects on group-level mean ability. Depending on which item parameters are affected and whether intersectional impact is considered, we propose four models, which aim to detect intersectional uniform DIF (UDIF), intersectional UDIF with intersectional impact, intersectional non-uniform DIF (NUDIF), and intersectional NUDIF with intersectional impact, respectively. For efficient model estimation, a regularized Gaussian variational expectation-maximization algorithm is developed. Simulation studies demonstrate that our methods can effectively detect intersectional UDIF, although their detection of intersectional NUDIF is more limited.

Information

Type
Theory and Methods
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of Psychometric Society
Figure 0

Table 1 Proposed IRT models in this study

Figure 1

Table 2 True fixed item parameters for the simulation studies

Figure 2

Table 3 Illustration of simulation designs

Figure 3

Figure 1 Simulation I results.

Figure 4

Figure 2 Simulation II results.

Figure 5

Figure 3 Simulation III results.

Figure 6

Figure 4 Simulation IV results.

Figure 7

Table 4 Sample size for each group in the empirical study

Figure 8

Figure 5 Relationship between the number of items exhibiting intersectional DIF and c.

Figure 9

Table 5 DIF detection results of the empirical study