A Bayesian model formulation of the deterministic inputs, noisy “and” gate (DINA) model is presented. Gibbs sampling is employed to simulate from the joint posterior distribution of item guessing and slipping parameters, subject attribute parameters, and latent class probabilities. The procedure extends concepts in Béguin and Glas, Culpepper, and Sahu for estimating the guessing and slipping parameters in the three- and four-parameter normal-ogive models. The ability of the model to recover parameters is demonstrated in a simulation study. The technique is applied to a mental rotation test. The algorithm and vignettes are freely available to researchers as the “dina” R package.
BéguinA. A.GlasC. A. (2001). MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika, 66, 541–561.
2.
BrooksS. P.GelmanA. (1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics, 7, 434–455.
3.
ChenY.LiuJ.XuG.YingZ. (2015). Statistical analysis of Q-matrix based diagnostic classification models. Journal of the American Statistical Association, 110, 850–866.
4.
ChiuC. (2013). Statistical refinement of the Q-matrix in cognitive diagnosis. Applied Psychological Measurement, 37, 598–618.
5.
CowlesM. K. (1996). Accelerating Monte Carlo Markov chain convergence for cumulative-link generalized linear models. Statistics and Computing, 6, 101–111.
6.
CulpepperS. A. (in press). Revisiting the 4-parameter item response model: Bayesian estimation and application. Psychometrika.
7.
DeCarloL. T. (2012). Recognizing uncertainty in the Q-matrix via a Bayesian extension of the DINA model. Applied Psychological Measurement, 36, 447–468.
8.
de la TorreJ. (2008). An empirically based method of Q-matrix validation for the DINA model: Development and applications. Journal of Educational Measurement, 45, 343–362.
9.
de la TorreJ. (2009a). DINA model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34, 115–130.
10.
de la TorreJ. (2009b). Estimation code for the G-DINA model. Paper presented at the meeting of the American Educational Research Association, San Diego, CA.
11.
de la TorreJ. (2011). The generalized DINA model framework. Psychometrika, 76, 179–199.
12.
de la TorreJ.DouglasJ. A. (2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69, 333–353.
13.
de la TorreJ.DouglasJ. A. (2008). Model evaluation and multiple strategies in cognitive diagnosis: An analysis of fraction subtraction data. Psychometrika, 73, 595–624.
HaertelE. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 301–321.
19.
HartzS. (2002). A Bayesian framework for the unified model for assessing cognitive abilities: Blending theory with practicality (Unpublished doctoral dissertation). University of Illinois at Urbana-Champaign, Champaign.
20.
HensonR. A.TemplinJ. L.WillseJ. T. (2009). Defining a family of cognitive diagnosis models using log-linear models with latent variables. Psychometrika, 74, 191–210.
21.
HuebnerA.WangC. (2011). A note on comparing examinee classification methods for cognitive diagnosis models. Educational and Psychological Measurement, 71, 407–419.
22.
JunkerB. W.SijtsmaK. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258–272.
23.
LiF. (2008). A modified higher-order DINA model for detecting differential item functioning and differential attribute functioning (Unpublished doctoral dissertation). University of Georgia, Athens.
LiuJ.XuG.YingZ. (2013). Theory of the self-learning Q-matrix. Bernoulli, 19, 1790.
26.
MacreadyG. B.DaytonC. M. (1977). The use of probabilistic models in the assessment of mastery. Journal of Educational and Behavioral Statistics, 2, 99–120.
27.
MaedaY.YoonS. (2013). A meta-analysis on gender differences in mental rotation ability measured by the Purdue Spatial Visualization Tests: Visualization of rotations (PSVT:R). Educational Psychology Review, 25, 69–94.
28.
MaedaY.YoonS. Y.Kim-KangG.ImbrieP. (2013). Psychometric properties of the revised PSVT:R for measuring first year engineering students’ spatial ability. International Journal of Engineering Education, 29, 763–776.
Pham-GiaT.TurkkanN. (1998). Distribution of the linear combination of two general beta variables and applications. Communications in Statistics-Theory and Methods, 27, 1851–1869.
31.
PlummerM.BestN.CowlesK.VinesK. (2006). CODA: Convergence diagnosis and output analysis for MCMC. R News, 6, 7–11. Retrieved fromhttp://CRAN.R-project.org/doc/Rnews/
32.
RobertC.CasellaG. (2009). Introducing Monte Carlo methods with R. New York, NY: Springer.
33.
RoussosL. A.DiBelloL. V.StoutW.HartzS. M.HensonR. A.TemplinJ. L. (2007). The fusion model skills diagnosis system. In LeightonJ. P.GierlM. J. (Eds.), Cognitive diagnostic assessment for education: Theory and applications (pp. 275–318). Cambridge, England: Cambridge University Press.
34.
RoussosL. A.TemplinJ. L.HensonR. A. (2007). Skills diagnosis using IRT-based latent class models. Journal of Educational Measurement, 44, 293–311.
35.
RuppA. A. (2009). Software for calibrating diagnostic classification models: An overview of the current state-of-the-art. Symposium conducted at the meeting of the American Educational Research Association, San Diego, CA.
36.
RuppA. A.TemplinJ. L. (2008). The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model. Educational and Psychological Measurement, 68, 78–96.
37.
RuppA. A.TemplinJ. L.HensonR. A. (2010). Diagnostic measurement: Theory, methods, and applications. New York, NY: Guilford Press.
38.
SahuS. K. (2002). Bayesian estimation and model choice in item response models. Journal of Statistical Computation and Simulation, 72, 217–232.
39.
TemplinJ. L. (2004). Generalized linear mixed proficiency models (Unpublished doctoral dissertation). University of Illinois at Urbana-Champaign, Champaign.
40.
TemplinJ. L.HensonR. A. (2006a). A Bayesian method for incorporating uncertainty into Q-matrix estimation in skills assessment. Symposium conducted at the meeting of the American Educational Research Association, San Diego, CA.
41.
TemplinJ. L.HensonR. A. (2006b). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11, 287.
42.
UttalD. H.MeadowN. G.TiptonE.HandL. L.AldenA. R.WarrenC.NewcombeN. S. (2013). The malleability of spatial skills: A meta-analysis of training studies. Psychological Bulletin, 139, 352.
43.
von DavierM. (2008). A general diagnostic model applied to language testing data. British Journal of Mathematical and Statistical Psychology, 61, 287–307.
44.
von DavierM. (2014). The DINA model as a constrained general diagnostic model: Two variants of a model equivalency. British Journal of Mathematical and Statistical Psychology, 67, 49–71.
45.
YoonS. Y. (2011). Psychometric properties of the revised Purdue Spatial Visualization Tests: Visualization of rotations (the revised PSVT-R)(Unpublished doctoral dissertation). Purdue University, West Lafayette.
