We define a class of generalized log-linear models with random effects. For a vector
of Poisson or multinomial means m and matrices of constants C and
A, the model has the form C log Aμ = Xβ + Zu, where β are fixed effects and u
are random effects. The model contains most standard models currently used for
categorical data analysis. We suggest some new models that are special cases of this
model and are useful for applications such as smoothing large contingency tables and
modeling heterogeneity in odds ratios. We present examples of its use for such
applications. In many cases, maximum likelihood model fitting can be handled with
existing methods and software. We outline extensions of model fitting methods for
other cases. We also summarize several challenges for future research, such as
fitting the model in its most general form and deriving properties of estimates used
in smoothing contingency tables.
Aitkin M
(1996)
A general maximum likelihood analysis of overdispersion in generalized
linear models
. Statistics and Computing, 6,
251-262
.
2.
Bergsma WP
,
Rudas T
(2002)
Marginal models for categorical data
. Annals of Statistics, 30,
140-159
.
3.
Booth JG
,
Hobert JP
(1999)
Maximizing generalized linear mixed model likelihoods with an automated
Monte Carlo EM algorithm
. Journal of the Royal Statistical Society, Series B,
61,
265-285
.
4.
Breslow NE
,
Clayton DG
(1993)
Approximate inference in generalized linear mixed models
. Journal of the American Statistical Association,
88,
9-25
.
5.
Brumback BA
,
Ruppert D
,
Wand MP
(1999)
Comment to ‘Variable selection and function estimation in
additive nonparametric regression using a data-based prior’
. Journal of the American Statistical Association,
94,
794-797
.
6.
Bustami R
,
Lesaffre E
,
Molenberghs G
,
Loos R
,
Danckaerts M
,
Vlietinck, R
(2001)
Modelling bivariate ordinal responses smoothly with examples from
ophthalmology and genetics
. Statistics in Medicine, 20,
1825-1842
.
7.
Chan KS
,
Ledolter J
(1995)
Monte Carlo EM estimation for time series models involving counts
. Journal of the American Statistical Association,
90,
242-252
.
8.
Clogg CC
(1982)
Some models for the analysis of association in multiway
cross-classifications having ordered categories
. Journal of the American Statistical Association,
77,
803-815
.
9.
Coull BA
,
Agresti A
(2000)
Random effects modeling of multiple binomial responses using the
multivariate binomial logit-normal distribution
. Biometrics, 56,
73-80
.
10.
Dale J
(1986)
Global cross-ratio models for bivariate, discrete, ordered responses
. Biometrics, 42,
909-917
.
11.
Fitzmaurice GM
,
Laird NM
(1993)
A likelihood-based method for analyzing longitudinal responses
. Biometrika, 80,
141-151
.
12.
Glonek GFV
,
McCullagh P
(1995)
Multivariate logistic models
. Journal of the Royal Statistical Society, Series B,
Methodological, 57,
533-546
.
13.
Glonek GFV
(1996)
A class of regression models for multivariate categorical responses
. Biometrika, 83,
15-28
.
14.
Goodman LA
(1979)
Simple models for the analysis of association in cross-classifications
having ordered categories
. Journal of the American Statistical Association,
74,
537-552
.
15.
Green PJ
(1987)
Penalized likelihood for general semi-parametric regression models
. International Statistical Review, 55,
245-259
.
16.
Grizzle JE
,
Starmer CF
,
Koch GG
(1969)
Analysis of categorical data by linear models
. Biometrics, 25,
489-504
.
17.
Haber M
(1985a)
Maximum likelihood methods for linear and log-linear models in categorical data
. Computational Statistics and Data Analysis, 3,
1-10
.
18.
Haber M
(1985b)
Log-linear models for correlated marginal totals of a contingency table
. Communications in Statistics, Part A - Theory and Methods,
14,
2845-2856
.
19.
Hartzel J
,
Agresti A
,
Caffo B
(2001a)
Multinomial logit random effects models
. Statistical Modelling, 1,
81-102
.
20.
Hartzel J
,
Liu I
,
Agresti A
(2001b)
Describing heterogeneous effects in stratified ordinal contingency tables,
with application to multi-center clinical trials
. Computational Statistics and Data Analysis, 35,
429-449
.
21.
Hedeker D
,
Gibbons RD
(1994)
A random-effects ordinal regression model for multilevel analysis
. Biometrics, 50,
933-944
.
22.
Hobert JP
,
Wand MP
(2000) Automatic generalized nonparametric regression via
maximum likelihood. Technical Report,
Department of Biostatistics, Harvard School of Public Health
.
23.
Lang JB
,
Agresti A
(1994)
Simultaneously modeling joint and marginal distributions of multivariate
categorical responses
. Journal of the American Statistical Association,
89,
625-632
.
24.
Lang JB
,
McDonald JW
,
Smith PWF
(1994)
Association-marginal modelling of multivariate categorical responses: a
maximum likelihood approach
. Journal of the American Statistical Association,
94,
1161-1171
.
25.
Liu Q
,
Pierce DA
(1994)
A note on Gauss-Hermite quadrature
. Biometrika, 81,
624-629
.
26.
McCulloch CE
(1997)
Maximum likelihood algorithms for generalized linear mixed models
. Journal of the American Statistical Association,
92,
162-170
.
27.
Molenberghs G
,
Lesaffre E
(1994)
Marginal modeling of correlated ordinal data using a multivariate Plackett distribution
. Journal of the American Statistical Association,
89,
633-644
.
28.
Molenberghs G
,
Lesaffre E
(1999)
Marginal modelling of multivariate categorical data
. Statistics in Medicine, 18,
2237-2255
.
29.
Plackett RL
(1965)
A class of bivariate distributions
. Journal of the American Statistical Association,
60,
516-522
.
30.
Quintana FA
,
Liu JS
,
del Pino GE
(1999)
Monte Carlo EM with importance reweighting and its applications in random
effects models
. Computational Statistics & Data Analysis,
29,
429-444
.
31.
Self SG
,
Liang K-Y
(1987)
Asymptotic properties of maximum likelihood estimators and likelihood ratio
tests under nonstandard conditions
. Journal of the American Statistical Association,
82,
605-610
.
32.
Simonoff JS
(1983)
A penalty function approach to smoothing large sparse contingency tables
. Annals of Statistics, 11,
208-218
.
33.
Simonoff JS
(1987)
Probability estimation via smoothing in sparse contingency tables with
ordered categories
. Statistics & Probability Letters, 5,
55-63
.
34.
Simonoff JS
(1996) Smoothing Methods in Statistics.
New York: Springer
.
35.
Simonoff JS
(1998)
Three sides of smoothing: categorical data smoothing, non-parametric
regression, and density estimation
. International Statistical Review, 66,
137-156
.
36.
Steele BM
(1996)
A modified EM algorithm for estimation in generalized mixed models
. Biometrics, 52,
1295-1310
.
37.
Ten Have TR
,
Morabia A
(1999)
Mixed effects models with bivariate and univariate association parameters
for longitudinal bivariate binary response data
. Biometrics, 55,
85-93
.
38.
Tutz G
,
Hennevogl W
(1996)
Random effects in ordinal regression models
. Computational Statistics and Data Analysis, 22,
537-557
.
39.
Wager CG
,
Coull BA
,
Lange N
(2003)
Modelling spatial intensity for replicated inhomogeneous point patterns in
brain imaging
. Journal of the Royal Statistical Society, Series B, in press.
40.
Williams OD
,
Grizzle JE
(1972)
Analysis of contingency tables having ordered response categories
. Journal of the American Statistical Association,
67,
55-63
.
