The Visual Language Of Schematic Faces

in Brainy Stuff

visual language of facial expressions

Like many people, I’ve always had an aesthetic aversion to the yellow smiley face. Not only did I find it visually unappealing, but due to overuse I thought of the smiley as a trite visual cliché. But that was the old me. Now, the more I explore and decode smiley faces and their related family members, the more appreciation I have for the complexity of how two elliptical eyes and a mouth line can communicate emotion.

The fact that we understand the expressions depicted in schematic faces—from emoticons to smiley faces to simple cartoons—is a fascinating feature of the human brain. By schematic faces, I’m referring to simple line drawings or marks that depict the organizational pattern and basic features of a face. Using schematic faces in various types of visual communication is one way to leverage the human ability to interpret facial language quickly.

Schematic faces used in research

What’s special about faces?

People tend to pay more attention to faces than to other objects. Similar to how a bright color pops out at a viewer while looking at a graphic, a face will pop out when mixed in with a group of non-face objects. This doesn’t happen when animal faces are mixed with the same group of non-face objects; only with human faces.1

It’s safe to say that our brains are attuned to the human face, most likely because faces are loaded with information. When we perceive a face, we gather information about the person’s identity, emotional condition, direction of eye gaze, facial movements and head gestures. Faces are rich with information important to survival, such as identifying whether someone is familiar or a stranger. Faces are also rich sources of information relevant to social interaction, such as whether a person is approachable or wants to be left alone. Fortunately, we rapidly read and process emotional expressions.

It is fairly well agreed upon that each type of facial information processing occurs through different functional specializations and neural mechanisms in the brain.

The Facial Code

The conveyance of facial expressions are uncannily reflected in schematic faces. This is probably due to our competence at reading and interpreting what is known as the facial code, which many believe is universal to all people in all cultures. The facial code refers to the emotional messages that are expressed by movements of the facial muscles around the eyes, mouth and sometimes the nose. Thus, we decode emotional signals by perceiving the position or slant of a person’s eyebrows, the shape of the eyes and mouth, and the wrinkles around facial features. This constitutes the facial signal system that humans use to convey emotions.

There has been much research conducted on whether we have a limited number of distinct primary emotions. Paul Ekman, one of the most well-known researchers in this field, has proposed that there are six primary emotions: joy, sadness, surprise, fear, disgust and anger. Theoretically, as a person experiences one of these six emotions, the brain signals the facial muscles to contract or relax, which results in one of the prototypical facial codes. See the table below.3

Emotion Facial Expression Schematic
Happiness Eyebrows relaxed; cheeks raised, raising lower eyelid; corner of lips raised and lips drawn back
Sadness Inner corners of brows raised; inner corners of eyelids raised; corners of lips turned down
Surprise Eyebrows raised and curved; eyes open wide; jaw dropped; lips relaxed
Fear Eyebrows raised and inner corners drawn together; eyes wide open; mouth open but tense (may be asymmetrical)
Anger Eyebrows lowered and drawn together; vertical lines between eyebrows; lips pressed together
Disgust Inner corner of eyebrows lowered; nose wrinkled; eyelid raised; lower lip raised

Use in Visual Communication

There have been many attempts to use schematic faces in everything from infographics and data visualization to identity designs and communication aids. Some are more effective than others. Here are a few examples below.

Infographic Use: This infographic from Good Magazine (click graphic for the original) depicts the happiness quotient of people in 13 countries over a 30 year time span. The important facial element is the mouth, which serves as a line graph against four gray dotted lines that are placed behind the face. The bottom most gray line represents the least happiness and the top gray line represents the greatest happiness. The graph forms a facial expression that might correspond to the data. I’m not sure.

Communication Aid: The Wong-Baker Faces Pain Scale uses schematic faces to help people communicate about their level of pain during clinical exams. Originally developed for children, it is now used in many healthcare settings where language barriers or communicative disorders interfere with communication.

Logo Design: What happens when a schematic face is incorporated into a logo design? Although this approach would not work for most companies and organizations, it certainly adds a little personality to the brand. In particular, there is something playful and amusing when a schematic face is paired with an object as seen in the two logos on the right.

I think it’s valuable to understand the power that is conveyed in the face. And that we can take advantage of it with simple line drawings is a tribute to the human intellect.

Related Articles:
Why We Understand Caricature Drawings
Designing Symbols

References:

  1. Hershler, Orit and Hochstein, Shaul (2005). At first sight: A high-level pop out effect for faces. Vision Research:Volume 45, Issue 13, June 2005, 1707-1724.
  2. Flury, B., & Riedwyl. H. (1981). Graphical representation of multivariate data by means of asymmetrical faces, Journal of American Statistical Association, 76, 757-765.
  3. Worth Publishers. PsychSim: http://www.worthpublishers.com/catalog/static/worth/bloom/content/psychsim/17emotion/emotion1.htm#


{ 4 trackbacks }

Обзор свежих материалов, апрель-май 2011 « Юрий Ветров. Проектирование интерфейсов и управление проектами
July 2011 at 1:26 am
Обзор свежих материалов, апрель-май 2011 - Бламаблум
July 2011 at 1:13 pm
“how two elliptical eyes and a mouth line can communicate emotion.” | Life of a Sultana
November 2011 at 12:24 pm
Six Niche Visualization Blogs | eagereyes
December 2011 at 12:25 am

{ 2 comments… read them below or add one }

Ann Shea April 2012 at 6:18 pm

Ah, Connie, I feel better reading this post of yours. I had this guilty feeling that I might be a closet curmudgeon when I reflect on how much I disliked the original smiley face. I think that you and I both were bothered the insipid simplicity of it, the somewhat forced yet blank conveyance of purported happiness, and the sheer enormity of the armies of its appearance during its original emergence in popular culture. Also, in nature black on yellow hollers “warning!!” (a phenom known formally as “aposematism” (from apo- away, and sematic sign/meaning). The black-on-yellow warning symbolism in nature (like that seen on the honeybee or the poisonous banded sea krait) of course has been copied internationally on traffic signs, for yield and danger, etc., so we were perhaps guided by common sense, as much as anything else.

Now, though, with its disappearance for a few decades that ole’ smiley guy is so much more tolerable on his re-emergence. A bit of nostalgia at work perhaps. And we have so many other options, no? 🙂

Enjoyed seeing the nuances of the world happiness factor smiley faces…a visual worth double-clicking on for stats of world-wideness happiness around the world. Who knew there was an official World Database of Happiness??

cmalamed April 2012 at 8:10 pm

Hi Ann,
All I can say is your comment is fascinating. Great contribution. Thanks.
Connie

Leave a Comment

Previous post:

Next post: