The Specific Affect Coding System (SPAFF) is a reliable system for coding observed affect but few studies have tested its generalizability and susceptibility to bias.
Methods:
The current study compared highly trained African American and Caucasian coders’ scores when coding the same videos of African American and Caucasian American couples.
Results:
While it was hypothesized that Caucasian Americans may code African America couples as being more aggressive and less positive based on stereotypes, results revealed a significant Ethnicity of Coder × Ethnicity of Couple interaction on the “neutral” code only. Both African American and Caucasian coders tended to rate out-group couples as being less neutral and showing less interest than in-group couples. No other emotion was identified as being over-coded in lieu of neutral, however.
Conclusion:
Results suggest a subtle bias in SPAFF coding. Adding a diversity component to the SPAFF training and recruiting diverse coders is recommended.
AlbrightL.MalloyT. E.DongQ.KennyD. A.FangX.WinqistL.YuD. (1997). Cross-cultural consensus in personality judgments. Journal of Personality and Social Psychology, 72, 558–569.
2.
ArcherD. (1997). Unspoken diversity: Cultural differences in gestures. Qualitative Sociology, 20, 79–105.
3.
BabcockJ. C.GrahamK.CanadyB.RossJ. M. (2011). A proximal change experiment testing two communication exercises with intimate partner violent men. Behavior Therapy, 42, 336–347. doi:0.1016/j.beth.2010.08.010
4.
BabcockJ. C.GreenC. E.WebbS. A.YeringtonT. P. (2005). Psychophysiological profiles of batterers: Autonomic emotional reactivity as it predicts the antisocial spectrum of behavior among intimate partner abusers. Journal of Abnormal Psychology, 11, 445–455. doi:10.1037/0021-843X.114.3.444
5.
BaileyW.NowickiS.JrColeS. P. (1998). The ability to decode nonverbal information in African American, African, and Afro-Caribbean, and European American adults. Journal of Black Psychology, 24, 418–431. doi:10.1177/00957984980244002
6.
BakemanR.GottmanJ. M. (1986). Observing interaction: An introduction to sequential analysis. New York, NY: Cambridge.
7.
BesnardT.PlusquellecP.ThibaultI. (2016). Coder gender bias on observed interaction of parent-child dyads. Journal of the American Academy of Child & Adolescent Psychiatry, 55, S157. doi:10.1016/j.jaac.2016.09.179
8.
CarstensenL. L.GottmanJ. M.LevensonR. W. (1995). Emotional behavior in long-term marriage. Psychology and Aging, 10, 140–149. doi:10.1037/0882-7974.10.1.140
9.
ChaseK. A.O’LearyK. D.HeymanR. E. (2001). Categorizing partner violent men within the reactive-proactive typology model. Journal of Consulting and Clinical Psychology, 69, 567–572. doi:10.1037/0022-006X.69.3.567
10.
CoanJ.GottmanJ. M. (2007). The specific affect coding system (SPAFF). In CoanJ. A.AllenJ. B. B. (Eds.), Handbook of emotion elicitation and assessment (pp. 267–285). New York, NY: Oxford University Press.
11.
EkmanP.FriesenW. (1971). Constants across cultures in the face and emotion. Journal of Personality and Social Psychology, 17, 124–129.
12.
ErdfelderE.FaulF.BuchnerA. (1996). GPOWER: A general power analysis program. Behavior Research Methods, Instruments, & Computers, 28, 1–11.
13.
FleissJ. L. (1981). Statistical methods for rates and proportions (2nd ed.). New York, NY: John Wiley.
14.
GonzalesN. A.CauceA. M.MasonC. A. (1996). Interobserver agreement in the assessment of parental behavior and parent-adolescent conflict: African American mothers, daughters, and independent observers. Child Development, 67, 1483–1498.
15.
GottmanJ. M.KrokoffL. J. (1989). Marital interaction and satisfaction: A longitudinal view. Journal of Consulting and Clinical Psychology, 57, 47–52.
16.
GottmanJ.McCoyK.CoanJ.CollierH. (1996). The specific affect coding system (SPAFF). In GottmanJ. (Ed.), What predicts divorce? The measures (pp. 1–169). Hillsdale, NJ: Erlbaum.
17.
HawesD.DaddsM.PasalichD. (2013). Observational coding strategies. In ComerJ. S.KendallP. C. (Eds.), The Oxford handbook of research strategies for clinical psychology (pp. 120–141). New York, NY: Oxford University Press. doi:10.1093/oxfordhb/9780199793549.013.0008
18.
HaydenL. C.SchillerM.SameroffA. J.MillerI.KeitnerG.RasmussenS. (1998). Levels of family assessment: Family, marital, and parent–child interactions. Journal of Family Psychology, 12, 7–22.
19.
HinesA. M. (1993). Linking qualitative and quantitative methods in cross-cultural survey research: Techniques from cognitive science. American Journal of Community Psychology, 21, 729–746.
20.
HoovenC.RusheR.GottmanJ. M. (1996). The play-by-play interview. In GottmanJ. M. (Ed.), What predicts divorce? The measures (pp. PPIM1–PPIM26). Mahwah, NJ: Lawrence Erlbaum.
21.
JacobsonN. S.GottmanJ. M.WaltzJ.RusheR.BabcockJ. C.Holtzworth-MunroeA. (1994). Affect, verbal content, and psychophysiology in the arguments of couples with a violent husband. Journal of Consulting and Clinical Psychology, 62, 982–988. doi:10.1037/0022-006X.62.5.982
22.
KochmanT. (1981). Black and White styles in conflict. Chicago, IL: The University of Chicago Press.
23.
Lewis-FernandezR.KleinmanA. (1994). Culture, personality, and psychopathology. Journal of Abnormal Psychology, 103, 67–71. doi:10.1037/0021-843X.103.1.67
24.
LongJ. (1998). Video coding system: Reference guide. Caroga Lake, NY: James Long Company.
25.
MattisC. C.BellJ. (2000). The importance of cultural competence in ministering to African American victims of domestic violence. Violence Against Women, 6, 515–533. doi:10.1177/10778010022182001
26.
MelbyJ. N.GeX.CongerR. D.WarnerT. D. (1995). The importance of task in evaluating positive marital interactions. Journal of Marriage and the Family, 57, 981–994.
27.
MelbyJ. N.HoytW. T.BryantC. M. (2003). A generalizability approach to assessing the effects of ethnicity and training on observer ratings of family interactions. Journal of Social and Personal Relationships, 20, 171–189. doi:10.1177/02654075030202003
28.
MorrisE. (2007). “Ladies” or “Loudies”? Perceptions and experiences of Black girls in classrooms. Youth & Society, 38, 490–515. doi:10.1177/0044118X06296778
29.
OkazakiS.SueS. (1995). Methodological issues in assessment research with ethnic minorities. Psychological Assessment, 7, 367–375.
30.
PhelpsR. E.MearaN. M.DavisK. L.PattonM. J. (1991). Blacks’ and Whites’ perceptions of verbal aggression. Journal of Counseling and Development, 69, 345–350.
31.
SagaH. A.SchofieldJ. W. (1980). Racial and behavioral cues in Black and White children’s perceptions of ambiguously aggressive acts. Journal of Personality and Social Psychology, 39, 590–598.
32.
SchererK. R.WallbottH. G.SummerfieldA. B. (1986). Experiencing emotion: A crosscultural study. Cambridge: Cambridge University Press.
33.
ShapiroA. F.GottmanJ. M. (2013). The specific affect coding system. In KerigP.BaucomD. (Eds.), Couple observational coding systems (pp. 191–207). New York, NY: Erlbaum.
34.
SmithG. (1978). Observer drift under monitored and unmonitored conditions. ProQuest Dissertations and Theses, Pennsylvania State University, Pennsylvania, USA.
35.
SpanierG. B. (1976). Measuring dyadic adjustment: New scales for assessing the quality of marriage and similar dyads. Journal of Marriage and the Family, 38, 15–28.
36.
StrausM. A.HambyS. L.Boney-McCoyS.SugarmanD. B. (1996). The revised Conflict Tactics Scales (CTS2): Development and preliminary psychometric data. Journal of Family Issues, 17, 283–316. doi:10.1177/019251396017003001
37.
WillisJ. T. (1990). Some destructive elements in African-American male-female relationships. Family Therapy: The Journal of the California Graduate School of Family Psychology, 17, 139–147.
