In the human sciences, ability tests or psychological inventories are often repeatedly conducted to measure growth. Standard item response models do not take into account possible autocorrelation in longitudinal data. In this study, the authors propose an item response model to account for autocorrelation. The proposed three-level model consists of multiple facets (e.g., person, item, and rater facets) and slope parameters. Level 1 is an item response (within-occasion) model; Level 2 is a between-occasion and within-person model; and Level 3 is a between-person model. Parameters can be estimated using the computer software WinBUGS, which uses Markov Chain Monte Carlo (MCMC) algorithms. Through a series of simulations, it was found that the parameters in the proposed model can be recovered fairly well. Real data of job performance judged by raters at various time points were analyzed to illustrate the implications and application of the proposed model.
AdamsR. J.WilsonM.WuM. (1997). Multilevel item response models: An approach to errors in variables regression. Journal of Educational and Behavioral Statistics, 22, 47–76.
2.
AlbertJ. H.ChibS. (1993). Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association, 88, 669–679.
3.
AndersenE. B. (2004). Latent regression analysis based on the rating scale model. Psychology Science, 46, 209–226.
4.
AndrichD. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.
5.
BakerF. B. (1998). An investigation of the item parameter recovery characteristics of a Gibbs sampling approach. Applied Psychological Measurement, 22, 153–169.
6.
BartholomewD. J. (1981). Posterior analysis of the factor model. British Journal of Mathematical and Statistical Psychology, 34, 93–99.
7.
BéguinA. A.GlasC. A. W. (2001). MCMC estimation of multidimensional IRT models. Psychometrika, 66, 541–561.
8.
ChristensenK. B.BjornerJ.KreinerS.PetersenJ. H. (2004). Latent regression in log linear Rasch models. Communications in Statistics, 33, 1295–1314.
9.
CongdonP. (2003). Applied Bayesian modeling. New York, NY: Wiley.
10.
FoxJ. P. (2005). Multilevel IRT using dichotomous and polytomous items. British Journal of Mathematical and Statistical Psychology, 58, 145–172.
11.
FoxJ. P.GlasC. A. W. (2001). Bayesian estimation of a multilevel IRT model using Gibbs sampling. Psychometrika, 66, 271–288.
12.
GeisserS.EddyW. (1979). A predictive approach to model selection. Journal of the American Statistical Association, 74, 153–160.
13.
GelfandA. E. (1996). Model determination using sampling-based methods. In GilksW. R.RichardsonS.SpiegelhalterD. J. (Eds.), Markov Chain Monte Carlo in practice (pp. 145–161). London: Chapman-Hall.
14.
GelmanA. (2006). Prior distributions for variance parameters in hierarchical models. Bayesian Analysis, 3, 515–534.
15.
GemanS.GemanD. (1984). Stochastic relaxation, Gibbs distribution and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis an Machine Intelligence, PAMI-6, 721–741.
16.
HastingsW. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57, 97–109.
17.
18.
KamataA. (2001). Item analysis by the hierarchical generalized linear model. Journal of Educational Measurement, 38, 79–93.
19.
LeeS. (1981). A Bayesian approach to confirmatory factor analysis. Psychometrika, 46, 153–160.
20.
LinacreJ. M. (1989). Many-facet Rasch measurement. Chicago, IL: MESA Press.
21.
LinacreJ. M. (2002). Judging debacle in pairs figure skating. Rasch Measurement Transactions, 15, 839–840.
22.
LiuJ. S.SabattiC. (2000). Generalized Gibbs sampler and multigrid Monte Carlo for Bayesian computation. Biometrika, 87, 353–369.
23.
LunzM. E.WrightB. D.LinacreJ. M. (1990). Measuring the impact of judge severity on examination scores. Applied Measurement in Education, 3, 331–345.
24.
MaierK. S. (2001). A Rasch hierarchical measurement model. Journal of Educational and Behavioral Statistics, 26, 307–330.
25.
MastersG. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149–174.
26.
MetropolisN.RosenbluthA. W.RosenbluthM. N.TellerA. H.TellerE. (1953). Equation of state calculations by fast computing machines. The Journal of Chemical Physics, 21, 1087–1092.
27.
MislevyR. J. (1985). Estimation of latent group effects. Journal of the American Statistical Association, 80, 993–997.
28.
MurakiE. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159–176.
29.
PatzR. J.JunkerB. W. (1999a). Applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics, 24, 342–366.
30.
PatzR. J.JunkerB. W. (1999b). A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24, 146–178.
31.
RafteryA. E. (1996). Approximate Bayes factor and accounting for model uncertainty in generalized linear models. Biometrika, 83, 251–266.
32.
33.
RobertsG. O.SmithA. F. M. (1993). Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods. Journal of the Royal Statistical Society, Series B, 55, 3–23.
34.
ScheinesR.HoijtinkH.BoomsmaA. (1999). Bayesian estimation and testing of structural equation models. Psychometrika, 64, 37–52.
35.
SegawaE. (2005). A growth model for multilevel ordinal data. Journal of Educational and Behavioral Statistics, 30, 369–396.
36.
SpiegelhalterD. J.BestN. G.CarlinB. P.LindeA. V. D. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society: Series B, 64, 583–639.
37.
38.
TannerM. A. (1993). Tools for statistical inference: Observed data and data augmentation. 2nd ed.Berlin: Springer-Verlag.
39.
TannerM. A.WongW. H. (1987). The calculation of posterior distributions by data augmentation. Journal of the American Statistical Association, 82, 528–550.
40.
WangW. C.LiuC. Y. (2007). Formulation and application of the generalized multilevel facets model. Educational and Psychological Measurement, 67, 583–605.
41.
WangW. -C.WilsonM. R. (2005). Exploring local item dependence using a random-effects facet model. Applied Psychological Measurement, 29, 296–318.
42.
WollackJ. A.BoltD. M.CohenA. S.LeeY. S. (2002). Recovery of item parameters in the nominal response model: A comparison of marginal maximum likelihood and Markov chain Monte Carlo estimation. Applied Psychological Measurement, 26, 337–350.
43.
ZhangZ.HamagamiF.WangL.GrimmK. J.NesselroadeJ. R. (2007). Bayesian analysis of longitudinal data using growth curve models. International Journal of Behavioral Development, 31, 374–383.
44.
ZhangZ.NesselroadeJ. R. (2007). Bayesian estimation of categorical dynamic factor models. Multivariate Behavioral Research, 42, 729–756.
45.
ZwindermanA. H. (1991). A generalized Rasch model for manifest predictors. Psychometrika, 56, 589–600.
