Local independence is a central assumption of commonly used item response theory models. Violations of this assumption are usually tested using test statistics based on item pairs. This study presents two quasi-exact tests based on the statistic for testing the hypothesis of local independence in the Rasch model. The proposed tests do not require the estimation of item parameters and can also be applied to small data sets. The authors evaluate the tests with three simulation studies. Their results indicate that the quasi-exact tests hold their alpha level under the Rasch model and have higher power against different forms of local dependence than several alternative parametric and nonparametric model tests for local independence.
AndrichD.KreinerS. (2010). Quantifying response dependence between two dichotomous items using the Rasch model. Applied Psychological Measurement, 34, 181-192. doi:10.1177/0146621609360202
2.
BechgerT. M.MarisG. (2015). A statistical test for differential item pair functioning. Psychometrika, 80, 317-340. doi:10.1007/s11336-014-9408-y
3.
BirnbaumA. (1968). Some latent trait models and their use in inferring an examinee’s ability. In LordF. M.NovickM. R. (Eds.), Statistical theories of mental test scores (pp. 392-479). Reading, MA: Addison-Wesley.
4.
ChenW.-H.ThissenD. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265-289. doi:10.2307/1165285
5.
ChristensenK. B.MakranskyG.HortonM. (2017). Critical values for Yen’s Q3: Identification of local dependence in the Rasch model using residual correlations. Applied Psychological Measurement, 41, 178-194. doi:10.1177/0146621616677520
6.
CressieN.ReadT. R. (1984). Multinomial goodness-of-fit tests. Journal of the Royal Statistical Society: Series B (Methodological), 46, 440-464.
7.
De AyalaR. (2009). The theory and practice of item response theory. New York, NY: Guilford Press.
8.
EdwardsM. C.HoutsC. R.CaiL. (2018). A diagnostic procedure to detect departures from local independence in item response theory models. Psychological Methods, 23, 138-149. doi:10.1037/met0000121
GlasC. A. W. (1988). The derivation of some tests for the Rasch model from the multinomial distribution. Psychometrika, 53, 525-546.
11.
GlasC. A. W.Suárez-FalcónJ. C. (2003). A comparison of item-fit statistics for the three-parameter logistic model. Applied Psychological Measurement, 27, 87-106. doi:10.1177/0146621602250530
12.
HabingB.RoussosL. A. (2003). On the need for negative local item dependence. Psychometrika, 68, 435-451. doi:10.1007/BF02294736
13.
HolmS. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65-70.
14.
IpH.-S. (2001). Testing for local dependency in dichotomous and polytomous item response models. Psychometrika, 66, 109-132. doi:10.1007/BF02295736
15.
KeldermanH. (2007). Loglinear multivariate and mixture Rasch models. In von DavierM.CarstensenC. H. (Eds.), Multivariate and mixture distribution Rasch models (pp. 77-97). New York, NY: Springer.
16.
KimD.De AyalaR.FerdousA. A.NeringM. L. (2011). The comparative performance of conditional independence indices. Applied Psychological Measurement, 35, 447-471. doi:10.1177/0146621611407909
17.
KollerI.AlexandrowiczR. W. (2010). Eine psychometrische Analyse der ZAREKI-R mittels Rasch-Modellen [A psychometric analysis of the ZAREKI-R by the means of Rasch models]. Diagnostica, 56, 57-67. doi:10.1026/0012-1924/a000003
18.
KollerI.AlexandrowiczR. W.HatzingerR. (2012). Das Rasch Modell in der Praxis: Eine Einführung mit eRm [The Rasch model in practical applications: An introduction with eRm]. Vienna, Austria: facultas.wuv, UTB.
KollerI.MaierM. J.HatzingerR. (2015). An empirical power analysis of quasi-exact tests for the Rasch model: Measurement invariance in small samples. Methodology, 11, 45-54. doi:10.1027/1614-2241/a000090
21.
KollerI.WiedermannW.GlückJ. (2015). Item response models for dependent data: Quasi-exact tests for the investigation of some preconditions for measuring change. In StemmlerM.von EyeA.WiedermannW. (Eds.), Dependent data in social sciences research (pp. 263-279). Cham, Switzerland: Springer.
22.
LevyR.MislevyR. J.SinharayS. (2009). Posterior predictive model checking for multidimensionality in item response theory. Applied Psychological Measurement, 33, 519-537. doi:10.1177/0146621608329504
23.
LiuY.Maydeu-OlivaresA. (2013). Local dependence diagnostics in irt modeling of binary data. Educational and Psychological Measurement, 73, 254-274. doi:10.1177/0013164412453841
MaraisI.AndrichD. (2008). Formalizing dimension and response violations of local independence in the unidimensional Rasch model. Journal of Applied Measurement, 9, 200-215.
Maydeu-OlivaresA.MontañoR. (2013). How should we assess the fit of Rasch-type models? Approximating the power of goodness-of-fit statistics in categorical data analysis. Psychometrika, 78, 116-133. doi:10.1007/s11336-012-9293-1
28.
PonocnyI. (2001). Nonparametric goodness-of-fit tests for the Rasch model. Psychometrika, 66, 437-459. doi:10.1007/BF02294444
29.
RaschG. (1960). Probabilistic models for some intelligence and achievement tests. Copenhagen, Denmark: Danish Institute for Educational Research.
30.
R Core Team. (2017). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria. Available from https://www.R-project.org/
31.
RobitzschA.KieferT.WuM. (2018). TAM: Test analysis modules (R package version 2.12-18) [Computer software manual]. Available from https://CRAN.R-project.org/package=TAM
32.
SinharayS. (2005). Assessing fit of unidimensional item response theory models using a Bayesian approach. Journal of Educational Measurement, 42, 375-394. doi:10.1111/j.1745-3984.2005.00021.x
33.
Suárez-FalcónJ. C.GlasC. A. (2003). Evaluation of global testing procedures for item fit to the Rasch model. British Journal of Mathematical and Statistical Psychology, 56, 127-143. doi:10.1348/000711003321645395
34.
van den WollenbergA. L. (1982). Two new test statistics for the Rasch model. Psychometrika, 47, 123-140. doi:10.1007/BF02296270
35.
VerhelstN. D. (2008). An efficient MCMC algorithm to sample binary matrices with fixed marginals. Psychometrika, 73, 705-728. doi:10.1007/s11336-008-9062-3
36.
von AsterM.ZulaufM. W.HornR. (2006). Neuropsychologische Testbatterie für Zahlenverarbeitung und Rechnen bei Kindern (ZAREKI-R) [Neuropsychological Test Battery for Number Processing and Calculation in Children]. Frankfurt, Germany: Harcourt Test Services.
37.
WainerH.BradlowE. T.WangX. (2007). Testlet response theory and its applications. Cambridge, UK: Cambridge University Press.
WarmT. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54, 427-450. doi:10.1007/BF02294627
40.
WeiT.SimkoV. (2017). R package “corrplot”: Visualization of a correlation matrix (Version 0.84) [Computer software manual]. Retrieved from https://github.com/taiyun/corrplot
41.
YenW. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8, 125-145. doi:10.1177/014662168400800201
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
