Picture a tennis player in the moment he scores a critical point and wins a tournament. Now picture his opponent in the instant he loses the point that narrowly cost him the title. Can you tell one facial expression from the other, the look of defeat from the face of victory?
Try your hand at the images below, of professional tennis players at competitive tournaments. All were included in a new study that suggests that the more intense an emotion, the harder it is to distinguish it in a facial expression.
The researchers found that when overwhelming feelings set in, the subtle cues that convey emotion are lost, and facial expressions tend to blur. The face of joy and celebration often appears no different from the look of grief and devastation. Winning looks like losing. Pain resembles pleasure.
But that is not the case when it comes to body language. In fact, the new study found, people are better able to identify extreme emotions by reading body language than by looking solely at facial expressions. But even though we pick up on cues from the neck down to interpret emotion, we instinctively assume that it is the face that tells us everything, said Hillel Aviezer, a psychologist who carried out the new research with colleagues at Princeton University.
“When emotions run high, the face becomes more malleable: it’s not clear if there’s positivity or negativity going on there,” he said. “People have this illusion that they’re reading all this information in the face. We found that the face is ambiguous in these situations and the body is critical.”
Dr. Aviezer and his colleagues, who published their work in the journal Science, carried out four experiments in which subjects were asked to identify emotions by looking at photographs of people in various situations. In some cases, the subjects were shown facial expressions alone. In others, they looked at body language, either alone or in combination with faces. The researchers chose photographs taken in moments when emotions were running high – as professional tennis players celebrated or agonized, as loved ones grieved at funerals, as needles punctured skin during painful body piercings.
According to classic behavioral theories, facial expressions are universal indicators of mood and emotion. So the more intense a particular emotion, the easier it should be to identify in the face. But the study showed the exact opposite. As emotions peaked in intensity, expressions became distorted, similar to the way cranking up the volume on a stereo makes the music unrecognizable.
“When emotions are extremely high, it’s as if the speakers are blaring and the signal is degraded,” said Dr. Aviezer, who is now at Hebrew University in Jerusalem. “When the volume is that high, it’s hard to tell what song is playing.”
In one experiment, three groups of 15 people were shown photographs of professional tennis players winning and losing points in critical matches. When the subjects were shown the players’ expressions alone — separated from their bodies — they correctly identified their emotion only half of the time, which was no better than chance. When they looked at images of just the body with the face removed — or the body with the face intact — they were far more accurate at identifying emotions. Yet when asked, 80 percent said they were relying on the facial expressions alone. Twenty percent said they were going by body and facial cues together, and not a single one said they were looking only for gestures from the neck down.
Then, the researchers scrambled the photos, mixing faces and bodies together. The upset faces of players were randomly spliced onto the bodies of celebrating players, and vice versa.
When asked to judge the emotions, the subjects answered according to the body language. The facial expression did not seem to matter. If a losing face was spliced onto a celebrating body, the subjects tended to guess victory and jubilation. If they were looking at the face of an exuberant player placed on the body of an anguished player, the subjects guessed defeat and disappointment.
Although they were not aware of it, the subjects were clearly looking at body language, Dr. Aviezer said. Clenched fists, for example, suggested victory and celebration, while open or outstretched hands indicated a player’s disappointment.
In another experiment, the researchers looked at four other emotional “peaks.” For pain, they used the faces of men and women undergoing piercings. Grief was captured in images of mourners at a funeral. For joy, they used images of people on the reality television show “Extreme Makeover: Home Edition,” capturing their impassioned faces at the very moment they were shown their beautiful, brand new homes. And for pleasure, they went with a rather risqué option: images from an erotic Web site that showed faces at the height of orgasm.
Once again, the subjects could not correctly guess the emotions by looking at facial expressions alone. In fact, they were more likely to interpret “positive” faces as being “negative” more than the actual negative ones. When faces showing pleasure were spliced onto the body of someone in pain, for example, the subjects relied on body language and were often unaware that the facial expression was conveying the opposite emotion.
“There’s this point on ‘Extreme Makeover’ where people see their new house for the first time and the camera is on their face, so we have these wonderful photos of their expressions,” Dr. Aviezer said. “At that moment, they look like the most miserable people in the world. For a few seconds, it’s as if they are seeing their house burn down. They don’t look like you would expect.”
The researchers noted that they were not suggesting that facial expressions never indicate specific feelings – only that when the emotion is intense and at its peak, for those first few seconds, the expression is ambiguous. Dr. Aviezer said the facial musculature simply might not be suited for accurately conveying extremely intense feelings – in part because in the real world, so much of that is conveyed through situational context.
And this may not be limited to facial cues.
“Consider intense vocal expressions of grief versus joy or pleasure versus pain,” the researchers wrote in their paper. For example, imagine sitting in a coffee shop and hearing someone behind you shriek. Is it immediately obvious whether the emotion is a positive or negative one?
“When people are experiencing a very high level of excitation,” Dr. Aviezer said, “then we see this overlap in expressions.”
