We review contemporary best practice for developing and validating measures of constructs in the organizational sciences. The three basic steps in scale development are: (a) construct definition, (b) choosing operationalizations that match the construct definition, and (c) obtaining empirical evidence to confirm construct validity. While summarizing this 3-step process [i.e., Define-Operationalize-Confirm], we address many issues in establishing construct validity and provide a checklist for journal reviewers and authors when evaluating the validity of measures used in organizational research. Among other points, we pay special attention to construct conceptualization, acknowledging existing constructs, improving existing measures, multidimensional constructs, macro-level constructs, and the need for independent samples to confirm construct validity and measurement equivalence across subpopulations.
AckermanP. L.BeierM. E.BoyleM. O. (2005). Working memory and intelligence: The same or different constructs?Psychological Bulletin, 131(1), 30-60. Retrieved from https://doi.org/10.1037/0033-2909.131.1.30
2.
AguinisH.VandenbergR. J. (2014). An ounce of prevention is worth a pound of cure: Improving research quality before data collection. Annual Review of Organizational Psychology and Organizational Behavior, 1, 569-595.
3.
AlwinD. F.KrosnickJ. A. (1991). The reliability of survey attitude measurement: The influence of question and respondent attitudes. Sociological Methods and Research, 20(1), 139-181. https://doi.org10.1177_0049124191020001005
4.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education, & Joint Committee on Standards for Educational and Psychological Testing (2014). Standards for educational and psychological testing. AERA.
AndersonJ. C.GerbingD. W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3), 411-423. https://doi.org/10.1037/0033-2909.103.3.411
7.
AndersonJ. C.GerbingD. W. (1991). Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. Journal of Applied Psychology, 76(5), 732-740. Retrieved from https://doi.org/10.1037/0021-9010.76.5.732
BagozziR. P. (1981). Evaluating structural equation models with unobservable variables and measurement error: A comment. Journal of Marketing Research (pre-1986), 18(000003), 375. Retrieved from https://doi.org/10.1177/002224378101800312
10.
BandalosD. L. (2002). The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling. Structural Equation Modeling, 9(1), 78-102. Retrieved from https://doi.org/10.1207/S15328007SEM0901_5
11.
BennettR. J.RobinsonS. L. (2000). Development of a measure of workplace deviance. Journal of Applied Psychology, 85(3), 349-360. Retrieved from https://doi.org/10.1037/0021-9010.85.3.349
12.
BerghD. D.FairbankJ. F. (2002). Measuring and testing change in strategic management research. Strategic Management Journal, 23(4), 359-365. https://doi.org/10.1002/smj.232
13.
BlieseP. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349-381). Jossey-Bass.
14.
BollenK. A.DiamantopoulosA. (2017). In defense of causal–formative indicators: A minority report. Psychological Methods, 22(3), 581-596. Retrieved from https://doi.org/10.1037/met0000056
15.
BoydB. K. (1994). Board control and ceo compensation. Strategic Management Journal, 15(5), 335-344. Retrieved from https://doi.org/10.1002/smj.4250150502
16.
BoydB. K.GoveS.HittM. A. (2005). Construct measurement in strategic management research: Illusion or reality?Strategic Management Journal, 26(3), 239-257. Retrieved from https://doi.org/10.1002/smj.444
17.
BozemanD. P.PerrewéP. L. (2001). The effect of item content overlap on organizational commitment questionnaire–turnover cognitions relationships. Journal of Applied Psychology, 86(1), 161-173. Retrieved from https://doi.org/10.1037/0021-9010.86.1.161
18.
BradburnN.SudmanS.WansinkB. (2004). Asking questions: The definitive guide to questionnaire design – for market research, political polls, and social and health questionnaires (First edition ed.). Jossey-Bass.
19.
BradyD. L.BrownD. J.LiangL. H. (2017). Moving beyond assumptions of deviance: The reconceptualization and measurement of workplace gossip. Journal of Applied Psychology, 102(1), 1-25. Retrieved from https://doi.org/10.1037/apl0000164
20.
BrannickM. T.SpectorP. E. (1990). Estimation problems in the block-diagonal model of the multitrait-multimethod matrix. Applied Psychological Measurement, 14(4), 325-339. Retrieved from https://doi.org/10.1177/014662169001400401
21.
BrayfieldA. H.RotheH. F. (1951). An index of job satisfaction. Journal of Applied Psychology, 35(5), 307-311. Retrieved from https://doi.org/10.1037/h0055617
22.
BromileyP.RauD.ZhangY. (2017). Is R&D risky?Strategic Management Journal, 38(4), 876-891. Retrieved from https://doi.org/10.1002/smj.2520
23.
BrownA.Maydeu-OlivaresA. (2013). How IRT can solve problems of ipsative data in forced-choice questionnaires. Psychological Methods, 18(1), 36-52. Retrieved from https://doi.org/10.1037/a0030641
24.
BrownT. A. (2015). Confirmatory factor analysis for applied research. Guilford Press.
25.
CampbellD. T.FiskeD. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81-105. https://doi.org/10.1037/h0046016
26.
CampbellJ. P.GasserM. B.OswaldF. (1996). The substantive nature of job performance variability. In K. Murphy (ed.), Individual differences and behavior in organizations (1st ed, pp. 258–299).
27.
CardinalL. B.SitkinS. B.LongC. P. (2010). A configurational theory of control. Organizational Control, 51, 79, 85-100.
28.
CarpenterN. C.SonJ.HarrisT. B.AlexanderA. L.HornerM. T. (2016). Don’t forget the items:Item-level meta-analytic and substantive validity techniques for reexamining scale validation. Organizational Research Methods, 19(4), 616-650. https://doi.org/10.1177/1094428116639132
29.
CattellR. B. (1947). Confirmation and clarification of primary personality factors. Psychometrika, 12, 197-220. https://doi.org/10.1007/BF02289253
30.
CertoS. T.BusenbarkJ. R.KalmM.LePineJ. A. (2020). Divided we fall: How ratios undermine research in strategic management. Organizational Research Methods, 23(2), 211-237. https://doi.org/10.1177/1094428118773455
31.
ChanD. (1998a). The conceptualization and analysis of change over time: An integrative approach incorporating longitudinal mean and covariance structures analysis (LMACS) and multiple indivator latent growth modeling (MLGM). Organizational Research Methods, 2(4), 421-483 Retreived from 10.1177/109442819814004.
32.
ChanD. (1998b). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83(2), 234-246. Retrieved from doi.org/10.1037/0021-9010.83.2.234
33.
ChangC.-H.FerrisD. L.JohnsonR. E.RosenC. C.TanJ. A. (2012). Core self-evaluations:A review and evaluation of the literature. Journal of Management, 38(1), 81-128. https://doi.org/10.1177/0149206311419661
34.
ChenG.BlieseP. D.MathieuJ. E. (2005). Conceptual framework and statistical procedures for delineating and testing multilevel theories of homology. Organizational Research Methods, 8(4), 375-409. Retrevied from https://doi.org//10.1177/1094428105280056
35.
ChoE. (2016). Making reliability reliable: A systematic approach to reliability coefficients. Organizational Research Methods, 19(4), 651-682. https://doi.org/10.1177/1094428116656239
36.
ChoE.KimS. (2015). Cronbach’s coefficient alpha: Well known but poorly understood. Organizational Research Methods, 18(2), 207-230. https://doi.org/10.1177/1094428114555994
ClarkL. A.WatsonD. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412-1427. https://doi.org/10.1037/pas0000626
39.
ColeD. A.CieslaJ. A.SteigerJ. H. (2007). The insidious effects of failing to include design-driven correlated residuals in latent-variable covariance structure analysis. Psychological Methods, 12(4), 381-398. https://doi.org/10.1037/1082-989x.12.4.381
40.
ColquittJ. A. (2001). On the dimensionality of organizational justice: A construct validation of a measure. Journal of Applied Psychology, 86(3), 386-400. Retrieved from 10.1037/0021-9010.86.3.386
41.
ColquittJ. A.SabeyT. B.RodellJ. B.HillE. T. (2019). Content validation guidelines: Evaluation criteria for definitional correspondence and definitional distinctiveness. Journal of Applied Psychology, 104(10), 1243-1265. https://doi.org/10.1037/apl0000406.10.1037/apl0000406.supp (Supplemental)
42.
ConwayJ. M.HuffcuttA. I. (2003). A review and evaluation of exploratory factor analysis practices in organizational research. Organizational Research Methods, 6(2), 147-168. https://doi.org/10.1177/1094428103251541
43.
CornwellJ. M.DunlapW. P. (1994). On the questionable soundness of factoring ipsative data: A response to Saville & Willson (1991). Journal of Occupational & Organizational Psychology, 67(2), 89-100. https://doi.org/10.1111/j.2044-8325.1994.tb00553.x
44.
CortinaJ. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98-104. https://doi.org/10.1037/0021-9010.78.1.98
45.
CortinaJ. M.GreenJ. P.KeelerK. R.VandenbergR. J. (2016). Degrees of freedom in SEM: Are we testing the models that we claim to test?Organizational Research Methods, 20(3), 350-378. https://doi.org/10.1177/1094428116676345
46.
CortinaJ. M.ShengZ.KeenerS. K.KeelerK. R.GrubbL.SchmittN.TonidandelS.SummervilleK. M.HeggestadE. D.BanksG. (2020). From alpha and omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the journal of applied psychology. Journal of Applied Psychology, 105(12), 1351-1381. https://doi.org/10.1037/apl0000815
47.
CredéM.TynanM. C.HarmsP. D. (2017). Much ado about grit: A meta-analytic synthesis of the grit literature. Journal of Personality and Social Psychology, 113(3), 492-511. https://doi.org/10.1037/pspp0000102
48.
CronbachL. J. (1960). Essentials of psychological testing (2nd ed). Harper.
49.
CronbachL. J.GleserG. C.NandaH.RajaratnamN. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. John Wiley & Sons.
50.
CronbachL. J.MeehlP. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 4, 281-302. https://doi.org/10.1037/h0040957
51.
DanneelsE. (2016). Survey measures of first- and second-order competences. Strategic Management Journal, 37(10), 2174-2188. https://doi.org/10.1002/smj.2428
52.
DeShonR. P. (2002). Generalizability theory. In Measuring and analyzing behavior in organizations: Advances in measurement and data analysis (pp. 189-220). Jossey-Bass.
53.
DeVellisR. F. (2003). Scale development: Theory and applications (2 ed., Vol. 26). Sage Publications.
54.
DeVellisR. F. (2017). Scale development : theory and applications (Fourth edition. ed.). Thousand Oaks, CA: Sage.
55.
DrasgowF.KanferR. (1985). Equivalence of psychological measurement in heterogeneous populations. Journal of Applied Psychology, 70(4), 662-680. https://doi.org/10.1037/0021-9010.70.4.662
56.
EdwardsJ. R. (2001). Multidimensional constructs in organizational behavior research. Organizational Research Methods, 4(2), 144-192. https://doi.org/10.1177/109442810142004
57.
EdwardsJ. R. (2002). Alternatives to difference scores: Polynomial regression analysis and response surface methodology. In DrasgowF.SchmittN. (Eds.), Measuring and analyzing behavior in organizations: Advances in measurement and data analysis (pp. 350-400). Jossey-Bass.
58.
EdwardsJ. R. (2003). Construct validation in organizational behavior research. In GreenbergJ. (Ed.), Organizational behavior: the state of the science (2nd edition ed.). Erlbaum.
EdwardsJ. R.BerryJ. W. (2010). The presence of something or the absence of nothing: Increasing theoretical precision in management research. Organizational Research Methods, 13(4), 668-689. https://doi.org/10.1177/1094428110380467
62.
FabrigarL. R.WegenerD. T.MacCallumR. C.StrahanE. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272-299. https://doi.org/10.1037/1082-989X.4.3.272
63.
FanX.SivoS. A. (2007). Sensitivity of fit indices to model misspecification and model types. Multivariate Behavioral Research, 42(3), 509-529. https://doi.org/10.1080/00273170701382864
64.
FinkelS. E. (1995). Causal analysis with panel data. Sage Publications.
65.
FiskeD. W. (1949). Consistency of the factorial structures of personality ratings from different sources. Journal of Abnormal and Social Psychology, 44(3), 329-344. https://doi.org/10.1037/h0057198
66.
FordJ. K.MacCallumR. C.TaitM. (1986). The application of exploratory factor analysis in applied psychology: A critical review and analysis. Personnel Psychology, 39(2), 291-314. https://doi.org/10.1111/j.1744-6570.1986.tb00583.x
67.
FornellC.LarckerD. F. (1981). Structural equation models with unobservable variables and measurement error: Algebra and statistics. Journal of Marketing Research, 18(3), 382-388. https://doi.org/10.2307/3150980
68.
GerbingD. W.AndersonJ. C. (1985). The effects of sampling error and model characteristics on parameter estimation for maximum likelihood confirmatory factor analysis. Multivariate Behavioral Research, 20(3), 255-271. https://doi.org/10.1207/s15327906mbr2003_2
69.
GrégoireD. A.ShepherdD. A.Schurer LambertL. (2010). Measuring opportunity-recognition beliefs: Illustrating and validating an experimental approach. Organizational Research Methods, 13(1), 114-145. https://doi.org/10.1177/1094428109334369
70.
HeggestadE. D.ScheafD. J.BanksG. C.Monroe HausfeldM.TonidandelS.WilliamsE. B. (2019). Scale adaptation in organizational science research: A review and best-practice recommendations. Journal of Management, 45(6), 2596-2627. https://doi.org/10.1177/0149206319850280
71.
HelmJ. L.Castro-SchiloL.OraveczZ. (2017). Bayesian Versus maximum likelihood estimation of multitrait–multimethod confirmatory factor models. Structural Equation Modeling, 24(1), 17-30. https://doi.org/10.1080/10705511.2016.1236261
72.
HicksL. E. (1970). Some properties of ipsative, normative, and forced-choice normative measures. Psychological Bulletin, 74(3), 167-184. https://doi.org/10.1037/h0029780
73.
HinkinT. R. (1995). A review of scale development practices in the study of organizations. Journal of Management, 21(5), 967-988. https://doi.org/10.1177/014920639502100509
74.
HinkinT. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1(1), 104-121. https://doi.org/10.1177/109442819800100106
75.
HinkinT. R.TraceyJ. B. (1999). An analysis of variance approach to content validation. Organizational Research Methods, 2(2), 175-186. https://doi.org/10.1177/109442819922004
76.
HoelterJ. W. (1983). The analysis of covariance structures:Goodness-of-fit indices. Sociological Methods & Research, 11(3), 325-344. https://doi.org/10.1177/0049124183011003003
77.
HornJ. L.McArdleJ. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18(3-4), 117-144. https://doi.org/10.1080/03610739208253916
HuL. t.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
80.
IronsonG. H.SmithP. C.BrannickM. T.GibsonW. M.PaulK. B. (1989). Construction of a job in general scale: A comparison of global, composite, and specific measures. Journal of Applied Psychology, 74(2), 193-200. https://doi.org/10.1037/0021-9010.74.2.193
81.
JacksonD. L. (2001). Sample size and number of parameter estimates in maximum likelihood confirmatory factor analysis: A monte carlo investigation. Structural Equation Modeling, 8(2), 205–223. doi:10.1207/S15328007SEM0802_3
82.
JacksonD. L. (2003). Revisiting sample size and number of parameter estimates: Some support for the N:q hypothesis. Structural Equation Modeling: A Multidisciplinary Journal, 10(1), 128-141. https://doi.org/10.1207/S15328007SEM1001_6
83.
JacksonD. L. (2007). The effect of the number of observations per parameter in misspecified confirmatory factor analytic models. Structural Equation Modeling: A Multidisciplinary Journal, 14(1), 48-76. https://doi.org/10.1080/10705510709336736
84.
JacksonD. L.GillaspyJ. A.Jr.Purc-StephensonR. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6-23. https://doi.org/10.1037/a0014694
85.
JamesL. R.JonesA. P. (1974). Organizational climate: A review of theory and research. Psychological Bulletin, 81(12), 1096-1112. https://doi.org/10.1037/h0037511
86.
JexS. M.BlieseP. D. (1999). Efficacy beliefs as a moderator of the impact of work-related stressors: A multilevel study. Journal of Applied Psychology, 84(3), 349-361. https://doi.org/10.1037/0021-9010.84.3.349
87.
JudgeT. A.PiccoloR. F. (2004). Transformational and transactional leadership: A meta-analytic test of their relative validity. Journal of Applied Psychology, 89(5), 755-768. https://doi.org/10.1037/0021-9010.89.5.755
88.
KellermannsF. W.WalterJ.LechnerC.FloydS. W. (2005). The lack of consensus about strategic consensus: Advancing theory and research. Journal of Management, 31(5), 719-737. https://doi.org/10.1177/0149206305279114
89.
KelleyT. L. (1927). Interpretation of educational measurements. World Book.
90.
KetchenD. J.IrelandR. D.BakerL. T. (2013). The use of archival proxies in strategic management studies: Castles made of sand?Organizational Research Methods, 16(1), 32-42. https://doi.org/10.1177/1094428112459911
91.
KleinH. J.CooperJ. T.MolloyJ. C.SwansonJ. A. (2014). The assessment of commitment: Advantages of a unidimensional, target-free approach. Journal of Applied Psychology, 99(2), 222-238. https://doi.org/10.1037/a0034751
92.
KleinH. J.MolloyJ. C.BrinsfieldC. T. (2012). Reconceptualizing workplace commitment to redress a stretched construct: Revisiting assumptions and removing confounds. Academy of Management Review, 37(1), 130-151. https://doi.org/10.5465/arma.2010.0018
93.
KleinK. J.KozlowskiS. W. J. (2000a). A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes. In KleinK. J.KozlowskiS. W. J. (Eds.), Multilevel theory, research, and methods in organizations; foundations, extensions, and new directions (pp. 3-90). Jossey-Bass.
94.
KleinK. J.KozlowskiS. W. J. (Eds.). (2000b). Multilevel theory, research, and methods in organizations; foundations, extensions, and new directions. Jossey-Bass.
95.
KronmalR. A. (1993). Spurious correlation and the fallacy of the ratio standard revisited. Journal of the Royal Statistical Society, 156(3), 379-392. https://doi.org/10.2307/2983064
96.
KrosnickJ. A.PresserS. (2010). Questions and questionanaire design. In WrightJ. D.MarsdenP. V. (Eds.), Handbook of survey research. Emerald Group.
97.
LanceC. E.VandenbergR. J. (2002). Confirmatory factor analysis. In DrasgowF.SchmittN. (Eds.), Measuring and analyzing behavior in organizations: Advances in measurement and data analysis (pp. 221-254). Jossey-Bass.
98.
LanceC. E.VandenbergR. J. (2009). Statistical and methodological myths and urban legends : Doctrine, verity and fable in the organizational and social sciences. Routledge.
LeH.SchmidtF. L.HarterJ. K.LauverK. J. (2010). The problem of empirical redundancy of constructs in organizational research: An empirical investigation. Organizational Behavior and Human Decision Processes, 112(2), 112-125. https://doi.org/10.1016/j.obhdp.2010.02.003
101.
LeBretonJ. M.SenterJ. L. (2008). Answers to 20 questions about interrater reliability and interrater agreement. Organizational Research Methods, 11(4), 815-852. https://doi.org/10.1177/1094428106296642
102.
LittleT. D.RhemtullaM.GibsonK.SchoemannA. M. (2013). Why the items versus parcels controversy needn’t be one. Psychological Methods, 18(3), 285-300. https://doi.org/10.1037/a0033266
LordF. M.NovickM. R. (1968). Statistical Theories of Mental Test Scores. Reading, MA: Addison-Wesley.
105.
MacCallumR. C.BrowneM. W.SugawaraH. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130-149. https://doi.org/10.1037/1082-989X.1.2.130
106.
MacCallumR. C.LeeT.BrowneM. W. (2010). The issue of isopower in power analysis for tests of structural equation models. Structural Equation Modeling, 17(1), 23-41. https://doi.org/10.1080/10705510903438906
107.
MacCallumR. C.RoznowskiM.NecowitzL. B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111(3), 490-504. https://doi.org/10.1037/0033-2909.111.3.490
108.
MacKenzieS. B.PodsakoffP. M.JarvisC. B. (2005). The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. Journal of Applied Psychology, 90(4), 710-730. https://doi.org/10.1037/0021-9010.90.4.710
MarshH. W.HauK.-T.WenZ. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling, 11(3), 320-342. https://doi.org/10.1207/s15328007sem1103_2
111.
MarshH. W.LüdtkeO.NagengastB.MorinA. J. S.Von DavierM. (2013). Why item parcels are (almost) never appropriate: Two wrongs do not make a right—camouflaging misspecification with item parcels in CFA models. Psychological Methods, 18(3), 257-284. https://doi.org/10.1037/a0032773.10.1037/a0032773.supp (Supplemental)
112.
MathieuJ. E.FarrJ. L. (1991). Further evidence for the discriminant validity of measures of organizational commitment, job involvement, and job satisfaction. Journal of Applied Psychology, 76(1), 127-133. https://doi.org/10.1037/0021-9010.76.1.127
McDonaldR. P.HoR. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7(1), 64-82. https://doi.org/10.1037/1082-989x.7.1.64
115.
McKennyA. F.AguinisH.ShortJ. C.AnglinA. H. (2018). What doesn’t get measured does exist: Improving the accuracy of computer-aided text analysis. Journal of Management, 44(7), 2909-2933. https://doi.org/10.1177/0149206316657594
116.
McNeishD. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412-433. https://doi.org/10.1037/met0000144
117.
MeadeA. W. (2004). Psychometric problems and issues involved with creating and using ipsative measures for selection. Journal of Occupational and Organizational Psychology, 77(4), 531-552. https://doi.org/10.1348/0963179042596504
118.
MeadeA. W.KroustalisC. M. (2006). Problems with item parceling for confirmatory factor analytic tests of measurement invariance. Organizational Research Methods, 9(3), 369-403. https://doi.org/10.1177/1094428105283384
119.
MessickS. (1981). Constructs and their vicissitudes in educational and psychological measurement. Psychological Bulletin, 89(3), 575-588. https://doi.org/10.1037/0033-2909.89.3.575
120.
MessickS. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741-749. https://doi.org/10.1037/0003-066X.50.9.741
121.
MillerC. C.WashburnN. T.GlickW. H. (2013). PERSPECTIVE—The myth of firm performance. Organization Science, 24(3), 948-964. https://doi.org/10.1287/orsc.1120.0762
122.
MorinA. J. S.ArensA. K.MarshH. W. (2016). A bifactor exploratory structural equation modeling framework for the identification of distinct sources of construct-relevant psychometric multidimensionality. Structural Equation Modeling: A Multidisciplinary Journal, 23(1), 116-139. https://doi.org/10.1080/10705511.2014.961800
123.
MowdayR. T.SteersR. M.PorterL. W. (1979). The measurement of organizational commitment. Journal of Vocational Behavior, 14(2), 224-247. https://doi.org/10.1016/0001-8791(79)90072-1
MuthénL. K.MuthénB. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9(4), 599-620. https://doi.org/10.1207/S15328007SEM0904_8
126.
NewmanD. A.HarrisonD. A.CarpenterN. C.RaridenS. M. (2016). Construct mixology: Forming new management constructs by combining old ones. Academy of Management Annals, 10(1), 943-995. https://doi.org/10.1080/19416520.2016.1161965
127.
NewmanD. A.JosephD. L.HulinC. L. (2010). Job attitudes and employee engagement: Considering the attitude “A-factor”. In Handbook of employee engagement: Perspectives, issues, research and practice (pp. 43-61). Edward Elgar Publishing.
128.
NewmanD. A.SinH.-P. (2020). Within-group agreement (rWG): Two theoretical parameters and their estimators. Organizational Research Methods, 23(1), 30-64. https://doi.org/10.1177/1094428118809504
129.
NormanW. T. (1963). Toward an adequate taxonomy of personality attributes: Replicated factor structure in peer nomination personality ratings. The Journal of Abnormal and Social Psychology, 66(6), 574-583. https://doi.org/10.1037/h0040291
130.
NunnallyJ. C. (1970). Introduction to psychological measurement. McGraw-Hill.
131.
NunnallyJ. C. (1978). Psychometric theory. New York: McGraw Hill.
132.
NunnallyJ. C.BernsteinI. H. (1994). Psychometric theory. McGraw-Hill Inc.
133.
O'BoyleE. H.Jr.WilliamsL. J. (2011). Decomposing model fit: Measurement vs. Theory in organizational research using latent variables. Journal of Applied Psychology, 96(1), 1-12. https://doi.org/10.1037/a0020539
134.
O'NeillO. A.RothbardN. (2017). Is love all you need? The effects of emotional culture, suppression, and work–family conflict on firefighter risk-taking and health. Academy of Management Journal, 60(1), 78-108. https://doi.org/10.5465/amj.2014.0952
135.
OnesD. S.ViswesvaranC.ReissA. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81(6), 660-679. https://doi.org/10.1037/0021-9010.81.6.660
136.
OstroffC. (1993). Comparing correlations based on individual-level and aggregated data. Journal of Applied Psychology, 78(4), 569-582. https://doi.org/10.1037/0021-9010.78.4.569
137.
PandeyS.PandeyS. K. (2019). Applying natural language processing capabilities in computerized textual analysis to measure organizational culture. Organizational Research Methods, 22(3), 765-797. https://doi.org/10.1177/1094428117745648
138.
PedhazurE. J.SchmelkinL. P. (1991). Measurement, design, and analysis: An integrated approach. Lawrence Erlbaum Associates, Publishers.
139.
PetrenkoO. V.AimeF.RidgeJ.HillA. (2016). Corporate social responsibility or CEO narcissism? CSR motivations and organizational performance. Strategic Management Journal, 37(2), 262-279. https://doi.org/10.1002/smj.2348
140.
PodsakoffP. M.MacKenzieS. B.LeeJ.-Y.PodsakoffN. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879. https://doi.org/10.1037/0021-9010.88.5.879
141.
PodsakoffP. M.MacKenzieS. B.PodsakoffN. P. (2016). Recommendations for creating better concept definitions in the organizational, behavioral, and social sciences. Organizational Research Methods, 19(2), 159-203. https://doi.org/10.1177/1094428115624965
142.
RichardsonH. A.SimmeringM. J.SturmanM. C. (2009). A tale of three perspectives: Examining post hoc statistical techniques for detection and correction of common method variance. Organizational Research Methods, 12(4), 762. https://doi.org/10.1177/1094428109332834
143.
RönkköM.ChoE. (2020). An updated guideline for assessing discriminant validity. Organizational Research Methods, 0(0), 1094428120968614. https://doi.org/10.1177/1094428120968614
144.
RousseauD. M. (1985). Issues of level in organizational research: Multi-level and cross-level perspectives. Research in Organizational Behavior, 7, 1-37.
SchmidtF. L.LeH.IliesR. (2003). Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual-differences constructs. Psychological Methods, 8(2), 206-224. https://doi.org/10.1037/1082-989X.8.2.206
147.
SchmittN. (1982). The use of analysis of covariance structures to assess beta and gamma change. Multivariate Behavioral Research, 17(3), 343-358. https://doi.org/10.1207/s15327906mbr1703_3
148.
SchriesheimC. A.CastroS. L.CogliserC. C. (1999). Leader–member exchange (LMX) research: A comprehensive review of theory, measurement, and data-analytic practices. The Leadership Quarterly, 10(1), 63–113. 10.1016/S1048-9843(99)80009-5
149.
SchriesheimC. A.HinkinT. R.PodsakoffP. M. (1991). Can ipsative and single-item measures produce erroneous results in field studies of French and Raven's (1959) five bases of power? An empirical investigation. Journal of Applied Psychology, 76(1), 106-114. https://doi.org/10.1037/0021-9010.76.1.106
150.
SchriesheimC. A.PowersK. J.ScanduraT. A.GardinerC. C.LankauM. J. (1993). Improving construct measurement in management research: Comments and a quantitative approach for assessing the theoretical content adequacy of paper-and-pencil survey-type instruments. Journal of Management, 19(2), 385-417. https://doi.org/10.1177/014920639301900208
151.
SchwabD. P. (1980). Construct validity in organizational behavior. Research in Organizational Behavior, 2, 03-43.
152.
SchwabD. P. (2005). Research methods for organizational studies (second ed.). Lawrence Erlbaum Associates.
153.
ShadishW. R.CookT. D.CampbellD. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin Company.
154.
ShafferJ. A.DeGeestD.LiA. (2016). Tackling the problem of construct proliferation: A guide to assessing the discriminant validity of conceptually related constructs. Organizational Research Methods, 19(1), 80-110. https://doi.org/10.1177/1094428115598239
155.
ShippA. J.EdwardsJ. R.LambertL. S. (2009). Conceptualization and measurement of temporal focus: The subjective experience of the past, present, and future. Organizational Behavior and Human Decision Processes, 110(1), 1-22. https://doi.org/10.1016/j.obhdp.2009.05.001
156.
TayL.JebbA. T. (2018). Establishing construct continua in construct validation: The process of continuum specification. Advances in Methods and Practices in Psychological Science, 1(3), 375-388. https://doi.org/10.1177/2515245918775707
157.
TayL.WooS. E.VermuntJ. K. (2014). A conceptual and methodological framework for psychometric isomorphism: Validation of multilevel construct measures. Organizational Research Methods, 17(1), 77-106. https://doi.org/10.1177/1094428113517008
158.
TepperB. J.DimotakisN.LambertL. S.KoopmanJ.MattaF. K.ParkH. M.GooW. (2018). Examining follower responses to transformational leadership from a dynamic, person–environment fit perspective. Academy of Management Journal, 61(4), 1343-1368. https://doi.org/10.5465/amj.2014.0163
159.
TourangeauR.ConradF. G.CouperM. P. (2013). The science of web surveys. Oxford University Press.
160.
TourangeauR.RipsL. J.RasinskiK. (2000). The psychology of survey response. Cambridge University Press.
161.
Van KnippenbergD.SitkinS. B. (2013). A critical assessment of charismatic—transformational leadership research: Back to the drawing board?Academy of Management Annals, 7(1). https://doi.org/10.1080/19416520.2013.759433
162.
VandenbergR. J.LanceC. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4-69.
163.
WidamanK. F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9(1), 1-26. https://doi.org/10.1177/014662168500900101
164.
WilliamsL. J.McGonagleA. (2016). Four research designs and a comprehensive analysis strategy for investigating common method variance with self-report measures using latent variables. Journal of Business & Psychology, 31(3), 339-359. https://doi.org/10.1007/s10869-015-9422-9
165.
WilliamsL. J.VandenbergR. J.EdwardsJ. R. (2009). Structural equation modeling in management research: A guide for improved analysis. The Academy of Management Annals, 3, 543-604. Retrieved from http://www.informaworld.com/10.1080/19416520903065683.
166.
WillisG. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Sage Publications.
167.
WisemanR. (2009). On the use and misuse of ratios in strategic management research. In Research methods in strategy and management (Vol. Vol. 5, pp. 75-110). Emerald Group Publishing Limited.
168.
WoehrD. J.PutkaD. J.BowlerM. C. (2012). An examination of G-theory methods for modeling multitrait–multimethod data: Clarifying links to construct validity and confirmatory factor analysis. Organizational Research Methods, 15(1), 134-161. https://doi.org/10.1177/1094428111408616
169.
WolfsonM. A.TannenbaumS. I.MathieuJ. E.MaynardM. T. (2018). A cross-level investigation of informal field-based learning and performance improvements. Journal of Applied Psychology, 103(1), 14-36. https://doi.org/10.1037/apl0000267
170.
ZhangB.SunT.DrasgowF.ChernyshenkoO. S.NyeC. D.StarkS.WhiteL. A. (2020). Though forced, still valid: Psychometric equivalence of forced-choice and single-statement measures. Organizational Research Methods, 23(3), 569-590. https://doi.org/10.1177/1094428119836486
