Emotional Perception as an Intersection of Face, Body, and Scene Skip to main content
Utah's Foremost Platform for Undergraduate Research Presentation
2020 Abstracts

Emotional Perception as an Intersection of Face, Body, and Scene

Reschke, Peter; Clayton, Colter; McLean, Ryan; Cordon, Hallie (Brigham Young University)

Faculty Advisor: Reschke, Peter (Family, Home, and Social Sciences; School of Family Life)

Recent research has demonstrated that context plays a significant role in categorizing facial expressions of emotion (Aviezer et al., 2008). However, it is unclear which aspects of "context" drive this phenomenon. The current study sought to tease apart two unique sources of context (posture and background scene) using a fully crossed design with 6 emotions (Anger, Disgust, Fear, Sadness, Joy, and Neutral) expressed using 3 modalities (Face, Posture, Background Scene) featuring 48 different actors from 4 racial/ethnic background (Asian, Black, Hispanic, White). Seventy-two participants (Mage = 20.28, SD = 2.18, 48 female, 30 male) each viewed 216 randomly selected Face-Posture-Scene composites and were asked to select from a list an emotion that best described what the person in the image was feeling. Participants' categorizations matching the face (i.e., accuracy) were analyzed using a full factorial repeated measures Generalized Linear Mixed Model with face emotion, posture emotion, and scene emotion as factors. There were significant main effects of face emotion, F(4, 9968) = 89.602, p < .001, and posture emotion, F(5, 11574) = 34.830, p < .001, as well as significant interactions of Face Emotion X Posture Emotion, F(20, 12380) = 41.454, p < .001, and Face Emotion X Scene Emotion, F(20, 13682) = 8.066, p < .001. Post hoc analyses of the Face Emotion X Posture Emotion interaction indicated that certain face-posture combinations, such as disgust-anger and joy-anger, resulted in complete changes in emotion perception, with categorizations overwhelmingly matching the posture instead of the face. Taken together, these results suggest that face and posture play individual and interactional roles in emotion perception. Implications for theories on emotion and emotion perception will be discussed.