This article proposes a multilevel model for the assessment of school effectiveness where the intake achievement is a predictor and the response variable is the achievement in the subsequent periods. The achievement is a latent variable that can be estimated on the basis of an item response theory model and hence subject to measurement error. Ignoring covariate measurement error leads to biased parameter estimates. To address this problem, a likelihood-based measurement error adjustment for multilevel models is proposed. In particular, the method deals with a covariate measured with error that has a random coefficient. An application to educational data from the Italian region of Lombardy illustrates the method.
Manuscript received January 21, 2009 Revision received November 24, 2009 Accepted January 17, 2010
Aitkin M.,Longford N..Statistical modelling issues in school effectiveness studies (with discussion).Journal of the Royal Statistical Society, Series A. 1986;149:1-42
Ballou D.,Sanders W.,Wright P..Controlling for student background in value-added assessment of teachers.Journal of Educational and Behavioral Statistics. 2004;29:37-66
4.
Bartholomew D. J.,Knott M.Latent variable models and factor analysis. London, England: Edward Arnold Publishers Ltd; 1999:
5.
Browne W. J.,Goldstein H.,Woodhouse G.,Yang M..An MCMC algorithm for adjusting for errors in variables in random slopes multilevel models.Multilevel Modelling Newsletter. 2001;13:4-10
6.
Buonaccorsi J.,Demidenko E.,Tosteson T..Estimation in longitudinal random effects models with measurement error.Statistica Sinica. 2000;10:885-903
7.
Carroll R. J.,Ruppert D.,Stefanski L. A.,Crainiceanu C. M.Measurement error in nonlinear models. London, England: Chapman and Hall; 2006:
8.
Coleman J.,Campbell E.,Hobson C.,McPartland J.,Mood A.,Weinfield F.,York R.Equality of educational opportunity. Washington, DC: U.S. Government Printing Office; 1966:
9.
Cook J.,Stefanski L. A..A simulation extrapolation method for parametric measurement error models.Journal of the American Statistical Association. 1995;89:1314-1328
10.
Dempster A. P.,Laird N. M.,Rubin D. B..Maximum likelihood from incomplete data via the EM algorithm (with discussion).Journal of the Royal Statistical Society, Series B. 1977;39:1-22
11.
Fox J.-P.,Glas C. A. W..Bayesian modeling of measurement error in predictor variables using item response theory.Psychometrika. 2003;68:169-191
12.
Fuller W. A.Measurement error models. New York, NY: John Wiley; 1987:
13.
Goldstein H.Multilevel statistical models. 3rd ed.New York, NY: Edward Arnold; 2003:
14.
Goldstein H.,Kounali D.,Robinson A..Modelling measurement errors and category misclassification in multilevel models.Statistical Modelling. 2008;8:243-261
15.
Hoijtink H.,Boomsma A.Rasch models: Foundations, recent developments, and applications. Fischer G. H.Molenaar I. W., ed. New York, NY: Springer; 1995:53-68.
16.
Jank W..Quasi-Monte Carlo sampling to improve the efficiency of Monte Carlo EM.Computational Statistics & Data Analysis. 2005;48:685-701
17.
Liao J. G..Variance reduction in Gibbs sampler using quasi random numbers.Journal of Computational and Graphical Statistics. 1998;7:253-266
18.
Longford N. T..Regression analysis of multilevel data with measurement error.British Journal of Mathematical and Statistical Psychology. 1993;46:301-312
19.
McCaffrey D.,Lockwood J.,Koretz D.,Louis T. A.,Hamilton L..Models for value-added modeling of teacher effects.Journal of Educational and Behavioral Statistics. 2004;29:67-102
20.
McLachlan G. J.,Krishnan T.The EM algorithm and extensions. New York, NY: John Wiley; 1997:
21.
Meijer R. R.,Sijtsma K..Computerized adaptive testing: Overview and introduction.Applied Psychological Measurement. 1999;23:187-194
22.
Meng X.-L.,Rubin D. B..Using EM to obtain asymptotic variance-covariance matrices: The SEM algorithm.Journal of the American Statistical Association. 1991;86:899-909
23.
Molenaar I. W.Rasch models: Foundations, recent developments, and applications. Fischer G. H.Molenaar I. W., ed. New York, NY: Springer; 1995a:39-51.
24.
Molenaar I. W.Rasch models: Foundations, recent developments, and applications. Fischer G. H.Molenaar I. W., ed. New York, NY: Springer; 1995b:
25.
R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2009:
26.
Raudenbush S. W.,Bryk A. S.Hierarchical linear models: Applications and data analysis methods. 2nd ed.Newbury Park, CA: Sage; 2002:
27.
Robert C. P.,Casella G.Monte Carlo statistical methods. New York, NY: Springer-Verlag; 1999:
28.
Robinson G. K..That BLUP is a good thing: The estimation of random effects (with discussion).Statistical Science. 1991;6:15-32
29.
Rowan B.,Correnti R.,Miller R. J..What large-scale, survey research tells us about teacher effects on student achievement: Insights from the Prospects study of elementary schools.Teachers College Record. 2002;104:1525-1567
30.
Scheerens J.Improving school effectiveness (Fundamentals of Educational Planning Series, no. 68). Paris: UNESCO: International Institute for Educational Planning; 2000:
31.
Snijders T. A. B.,Bosker R. J.Multilevel analysis: An introduction to basic and advanced multilevel modeling. London, England: Sage; 1999:
32.
Tekwe C.,Carter R. L.,Ma C.,Algina J.,Lucas M. E.,Roth J.,… Resnick M..An empirical comparison of statistical models for value-added assessment of school performance.Journal of Educational and Behavioral Statistics. 2004;29:11-36
33.
Tribble S. D.,Owen A. B..Construction of weakly CUD sequences for MCMC sampling.Electronic Journal of Statistics. 2008;2:634-660
34.
Verbeke G.,Molenberghs G.Linear mixed models for longitudinal data. New York, NY: Springer-Verlag; 2000:
35.
Wang N.,Lin X.,Gutierrez R. G.,Carroll R..Bias analysis and SIMEX approach in generalized linear mixed measurement error models.Journal of the American Statistical Association. 1998;93:249-261
36.
Wei G. C. G.,Tanner M. A..A Monte Carlo implementation of the EM algorithm and the poor man’s data augmentation algorithms.Journal of the American Statistical Association. 1990;85:699-704
37.
Woodhouse G.,Yang M.,Goldstein H.,Rasbash J..Adjusting for measurement error in multilevel analysis.Journal of the Royal Statistical Society Series A. 1996;159:201-212
38.
Zhong X.,Fung W.,Wei B..Estimation in linear models with random effects and errors-in-variables.Annals of the Institute of Statistical Mathematics. 2002;54:595-606
