From Social to Symbolic: Investigating the Neural Networks Involved in Emoji and Facial Expression Recognition

Comprehensive Summary

Proverbio et al. discuss how the human brain processes emotional information from human facial expressions in comparison to emojis, which are commonly used as social cues within digital communications. Researchers in the study used EEG and event-related potentials at the N170 stage, combined with swLORETA source reconstruction. 50 young adults completed an emotion recognition task involving both real faces and emojis. The behavioral data showed that participants were more accurate and quicker when identifying emotions from emojis as opposed to the real faces. The neuroimaging results showed that both types of stimuli activated the bilateral fusiform areas and the orbitofrontal cortex, which are regions of the brain involved in visual and emotional processing. However, only the facial expressions engaged the medial and superior frontal cortices associated with mentalization and Theory of Mind. Real faces also activated limbic structures such as the left uncus, which suggests deeper emotional processing as opposed to the emoji stimuli. Emojis primarily activated brain regions involved in symbolic and semantic processing, showing the neural differences between facial and digital emotional cues.

Outcomes and Implications

This research is substantial, as it clarifies how the brain can interpret emotional cues in a world becoming increasingly digital, and where emojis have begun to replace facial interactions. Understanding these differences in brain activation is relevant for conditions that impact social cognition, such as autism spectrum disorder, schizophrenia, or social anxiety. Since facial expressions activate limbic networks more strongly, struggles in this area can help explain why certain individuals struggle with real emotional interpretations and perform better with simplified cues such as emojis. These findings also suggest that emojis can be used as supportive communication for patients with impaired emotion recognition. Clinically, this could impact designs of digital therapies, communication aids, or training programs. Recognizing that emojis rely on symbolic and semantic processing may help clinicians modify patient interventions. Direct clinical applications from this research could still be developing, but this research still provides a core foundation for future studies that link digital communication to mental health and neurological disorder care.