The appropriateness of a traditional correla tional measure of halo error (the difference between dimensional rating intercorrelations and dimensional true score intercorrelations) is reexamined in the context of three causal models of halo error. Mathematical derivations indicate that the traditional correlational measure typically will underestimate halo error in ratings and can suggest no halo error or even "negative" halo error when positive halo error actually occurs. A corrected correlational measure is derived that avoids these problems, and the traditional and corrected measures are compared empirically. Results suggest that use of the traditional correlational measure of halo error be dis continued.
Borman, W.C. (1975). Effects of instructions to avoid halo error on reliability and validity of performance evaluation ratings. Journal of Applied Psychology, 60, 556-560.
DeCotiis, T.A. (1977). An analysis of the external validity and applied relevance of three rating formats. Organizational Behavior and Human Performance, 19, 247-266.
6.
Feldman, J.M. (1986). A note on the statistical correction of halo error . Journal of Applied Psychology, 71, 173-176.
7.
Fisicaro, S.A. (1988). A reexamination of the relation between halo error and accuracy. Journal of Applied Psychology, 73, 239-244.
8.
James, L.R., Mulaik, S.A., & Brett, J.M. (1982). Causal analysis: Assumptions, models, and data . Beverly Hills CA: Sage Publications, Inc.
9.
King, L.M., Hunter, J.E., & Schmidt, F.L. (1980). Halo in a multidimensional forced-choice performance evaluation scale. Journal of Applied Psychology, 65, 507-516.
10.
Kozlowski, S.W.J., & Kirsch, M.P. (1987). The systematic distortion hypothesis, halo, and accuracy: An individual-level analysis. Journal of Applied Psychology, 72, 252-261.
11.
Kozlowski, S.W.J., Kirsch, M.P., & Chao, G.T. (1986). Job knowledge, ratee familiarity, conceptual similarity and halo error: An exploration. Journal of Applied Psychology , 71, 45-49.
12.
Lance, C.E., Fisicaro, S.A., & LaPointe, J.A. (in press). An examination of negative halo error in ratings. Educational and Psychological Measurement .
13.
Landy, F.J., Vance, R.J., Barnes-Farrell, J.L., & Steele, J.W. (1980). Statistical control of halo in performance ratings . Journal of Applied Psychology, 65, 501-506.
14.
McIntyre, R.M., Smith, D.E., & Hassett, C.E. (1984). Accuracy of performance ratings as affected by rater training and perceived purpose of rating. Journal of Applied Psychology, 69, 147-156.
15.
Murphy, K.R., Garcia, M., Kerkar, S., Martin, C., & Balzer, W.K. (1982). Relationship between observational accuracy and accuracy in evaluating performance. Journal of Applied Psychology , 67, 320-325.
16.
Murphy, K.R., & Reynolds, D.H. (1988). Does true halo affect observed halo? Journal of Applied Psychology, 73, 235-238.
17.
Nisbett, R.E., & Wilson, T.D. (1977). The halo effect : Evidence for unconscious alteration of judgments. Journal of Personality and Social Psychology , 35, 250-256.
18.
Pulakos, E.D. (1984). A comparison of rater training programs: Error training and accuracy training. Journal of Applied Psychology , 69, 581-588.
19.
Pulakos, E.D., Schmitt, N., & Ostroff, C. (1986). A warning about the use of a standard deviation across dimensions within ratees to measure halo. Journal of Applied Psychology, 71, 29-32.
Saal, F.E., Downey, R.G., & Lahey, M.A. (1980). Rating the ratings: Assessing the psychometric quality of rating data. Psychological Bulletin, 88, 413-428.
22.
Smither, J.W., Barry, S.R., & Reilly, R.R. (1989). An investigation of the validity of expert true score estimates in appraisal research. Journal of Applied Psychology, 74, 143-151.
23.
Sulsky, L.M., & Balzer, W.K. (1988). Meaning and measurement of performance rating accuracy: Some methodological and theoretical concerns. Journal of Applied Psychology, 73, 497-506.
24.
Thorndike, E.L. (1920). A constant error in psychological ratings. Journal of Applied Psychology, 4, 25-29.
25.
Vance, R.J., Winne, P.S., & Wright, E.S. (1983). A longitudinal examination of rater and ratee effects in performance ratings. Personnel Psychology, 36, 609-620.
