Sage Journals: Discover world-class research

Abstract

Parallel analysis has been considered one of the most accurate methods for determining the number of factors in factor analysis. One major advantage of parallel analysis over traditional factor retention methods (e.g., Kaiser’s rule) is that it addresses the sampling variability of eigenvalues obtained from the identity matrix, representing the correlation matrix for a zero-factor model. This study argues that we should also address the sampling variability of eigenvalues obtained from the observed data, such that the results would inform practitioners of the variability of the number of factors across random samples. Thus, this study proposes to revise the parallel analysis to provide the proportion of random samples that suggest k factors (k = 0, 1, 2, . . .) rather than a single suggested number. Simulation results support the use of the proposed strategy, especially for research scenarios with limited sample sizes where sampling fluctuation is concerning.

Keywords

parallel analysis dimensionality assessment factor analysis sample size

Get full access to this article

View all access options for this article.

References

Achim

(2021). Determining the number of factors using parallel analysis and its recent variants: Comment on Lim and Jahng (2019). Psychological Methods, 26(1), 69–73. https://doi.org/10.1037/met0000269

Auerswald

Moshagen

(2019). How to determine the number of factors to retain in exploratory factor analysis: A comparison of extraction methods under realistic conditions. Psychological Methods, 24(4), 468–491. https://doi.org/10.1037/met0000200

Bandalos

D. L.

Finney

S. J.

(2018). Factor analysis: Exploratory and confirmatory. In Hancock

G. R.

Mueller

R. O.

Stapleton

L. M.

(Eds.). The reviewer’s guide to quantitative methods in the social sciences (2nd ed., pp. 98–122). Routledge.

Christensen

A. P.

Golino

(2021). Estimating the stability of psychological dimensions via bootstrap exploratory graph analysis: A Monte Carlo simulation and tutorial. Psych, 3(3), 479–500. https://doi.org/10.3390/psych3030032

Cota

A. A.

Longman

R. S.

Holden

R. R.

Fekken

G. C.

Xinaris

(1993). Interpolating 95th percentile eigenvalues from random data: An empirical example. Educational and Psychological Measurement, 53(3), 585–596. https://doi.org/10.1177/0013164493053003001

Crawford

Green

S. B.

Levy

W.-J.

Scott

Svetina

D. S.

Thompson

M. S.

(2010). Evaluation of parallel analysis methods for determining the number of factors. Educational and Psychological Measurement, 70(6), 885–901. https://doi.org/10.1177/0013164410379332

Dinno

(2018). Paran: Horn’s test of principal components/factors (R Package Version 1.5.2). https://CRAN.R-project.org/package=paran

Fabrigar

L. R.

Wegener

D. T.

MacCallum

R. C.

Strahan

E. J.

(1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272

Ford

J. K.

MacCallum

R. C.

Tait

(1986). The application of exploratory factor analysis in applied psychology: A critical review and analysis. Personnel Psychology, 39(2), 291–314. https://doi.org/10.1111/j.1744-6570.1986.tb00583.x

10.

Golino

H. F.

Epskamp

(2017). Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research. PLOS ONE, 12 (6), Article e0174035. https://doi.org/10.1371/journal.pone.0174035

11.

Gorsuch

R. L.

(1983). Factor analysis (2nd ed.). Lawrence Erlbaum.

12.

Green

S. B.

Levy

Thompson

M. S.

W. J.

(2012). A proposed solution to the problem with using completely random data to assess the number of factors with parallel analysis. Educational and Psychological Measurement, 72(3), 357–374. https://doi.org/10.1177/0013164411422252

13.

Green

S. B.

Redell

Thompson

M. S.

Levy

(2016). Accuracy of revised and traditional parallel analyses for assessing dimensionality with binary data. Educational and Psychological Measurement, 76(1), 5–21. https://doi.org/10.1177/0013164415581898

14.

Green

S. B.

Thompson

M. S.

Levy

W. J.

(2015). Type I and type II error rates and overall accuracy of the revised parallel analysis method for determining the number of factors. Educational and Psychological Measurement, 75(3), 428–457. https://doi.org/10.1177/0013164414546566

15.

Horn

J. L.

(1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/BF02289447

16.

Humphreys

L. G.

Ilgen

D. R.

(1969). Note on a criterion for the number of common factors. Educational and Psychological Measurement, 29(3), 571–578. https://doi.org/10.1177/001316446902900303

17.

Kaiser

H. F.

(1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141–151. https://doi.org/10.1177/001316446002000116

18.

Karim

Weisz

Bibi

ur Rehman

(2015). Validation of the eight-item center for epidemiologic studies depression scale (CES-D) among older adults. Current Psychology, 34, 681–692. https://doi.org/10.1007/s12144-014-9281-y

19.

Levy

Xia

Green

S. B.

(2021). Incorporating uncertainty into parallel analysis for choosing the number of factors via bayesian methods. Educational and Psychological Measurement, 81(3), 466–490. https://doi.org/10.1177/0013164420942806

20.

Lim

Jahng

(2019). Determining the number of factors using parallel analysis and its recent variants. Psychological Methods, 24(4), 452–467. https://doi.org/10.1037/met0000230

21.

Lubbe

(2019). Parallel analysis with categorical variables: Impact of category probability proportions on dimensionality assessment accuracy. Psychological Methods, 24(3), 339–351. https://doi.org/10.1037/met0000171

22.

Muthén

L. K.

Muthén

B. O.

(1998–2017). Mplus user’s guide (8th ed.).

23.

Preacher

K. J.

MacCallum

R. C.

(2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics: Statistical Issues in Psychology, Education, and the Social Sciences, 2(1), 13–43. https://doi.org/10.1207/S15328031US0201_02

24.

R Core Team. (2023). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

25.

Ruscio

Roche

(2012). Determining the number of factors to retain in an exploratory factor analysis using comparison data of known factorial structure. Psychological Assessment, 24(2), 282–292. https://doi.org/10.1037/a0025697

26.

SAS Institute Inc. (2018). SAS/STAT 15.1 user’s guide: High-performance procedures. SAS Institute Inc.

27.

Schmitt

T. A.

(2011). Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment, 29(4), 304–321. https://doi.org/10.1177/0734282911406653

28.

Swann

Driscoll

Goddard

S. G.

Willis

Schweickle

M. J.

Ribeiro

I. A. F.

Gatt

Jackman

P. C.

Vella

S. A.

(2022). The Flow-Clutch Scale: Development and preliminary validation in sport and exercise. Psychology of Sport and Exercise, 58, 102066. https://doi.org/10.1016/j.psychsport.2021.102066

29.

Timmerman

M. E.

Lorenzo-Seva

(2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods, 16(2), 209–220. https://doi.org/10.1037/a0023353

30.

Turner

N. E.

(1998). The effect of common variance and structure pattern on random data eigenvalues: Implications for the accuracy of parallel analysis. Educational and Psychological Measurement, 58(4), 541–568. https://doi.org/10.1177/0013164498058004001

31.

Velicer

W. F.

(1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321–327. https://doi.org/10.1007/BF02293557

32.

Velicer

W. F.

Eaton

C. A.

Fava

J. L.

(2000). Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In Goffin

R. D.

Helmes

(Eds.), Problems and solutions in human assessment: Honoring Douglas Jackson at seventy (pp. 41–71). Kluwer Academic. https://doi.org/10.1007/978-1-4615-4397-8_3

33.

Venables

W. N.

Ripley

B. D.

(2002). Modern applied statistics with S (4th ed.). Springer.

34.

Wiebe

S. A.

Espy

K. A.

Charak

(2008). Using confirmatory factor analysis to understand executive control in preschool children: I. Latent structure. Developmental Psychology, 44(2), 575–587. https://doi.org/10.1037/0012-1649.44.2.575

35.

Xia

(2021). Determining the number of factors when population models can be closely approximated by parsimonious models. Educational and Psychological Measurement, 81(6), 1143–1171. https://doi.org/10.1177/0013164421992836

36.

Zwick

W. R.

Velicer

W. F.

(1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442. https://doi.org/10.1037/0033-2909.99.3.432

Improving the Use of Parallel Analysis by Accounting for Sampling Variability of the Observed Correlation Matrix

Abstract

Keywords

Get full access to this article

References