- Medicine - 08:01 Novartis partners with Phase 4 Partners and institutional investors to help create Mereo BioPharma Group Ltd
- Business - 06:02 Secretary of State for Business announces investment boost for UK’s largest dynamic test facility
- Microtechnics - Jul 29 Making the new silicon
- Physics - Jul 29 Rogue wave theory to save ships »
- Social Sciences - Jul 28 Bruce Kidd: sprinter Dutee Chand’s historic win for right to compete "affirms women exactly as they are"
- Medicine - Jul 28 How stem cell research and regenerative medicine saved this man's life
- Pedagogy - Jul 28 'Redshirting' kids yields no advantage in higher education
- Physics - Jul 28 Physicists close in on world's most sensitive resonators
- Agronomy - Jul 28 More secondary schools serve healthier lunches
- Medicine - Jul 28 McGill gets $91.5 Mln in CIHR funding
- Life Sciences - Jul 28 Young Animal Welfare Scientist of the Year
- Mechanical Engineering - Jul 28 EPSRC rail consortium shows how to cut costs and reduce delays
- Agronomy - Jul 28 Chill- tolerant hybrid sugarcane also grows at lower temperatures
- Mechanical Engineering - Jul 28 CMU’s Software Engineering Institute Contract Renewed by Department of Defense for $1.73 Billion
Is that smile real or fake?
A computerized system developed at MIT can tell the difference between smiles of joy and smiles of frustration.
Can you tell which of these smiles is showing happiness? Or which one is the result of frustration? A computer system developed at MIT can. The answer: The smile on the right is the sign of frustration.
Images courtesy of Hoque et al.
Do you smile when you’re frustrated? Most people think they don’t -- but they actually do, a new study from MIT has found. What’s more, it turns out that computers programmed with the latest information from this research do a better job of differentiating smiles of delight and frustration than human observers do.
The research could pave the way for computers that better assess the emotional states of their users and respond accordingly. It could also help train those who have difficulty interpreting expressions, such as people with autism, to more accurately gauge the expressions they see.
"The goal is to help people with face-to-face communication," says Ehsan Hoque, a graduate student in the Affective Computing Group of MIT’s Media Lab who is lead author of a paper just published in the IEEE Transactions on Affective Computing. Hoque’s co-authors are Rosalind Picard, a professor of media arts and sciences, and Media Lab graduate student Daniel McDuff.
In experiments conducted at the Media Lab, people were first asked to act out expressions of delight or frustration, as webcams recorded their expressions. Then, they were either asked to fill out an online form designed to cause frustration or invited to watch a video designed to elicit a delighted response -- also while being recorded.
When asked to feign frustration, Hoque says, 90 percent of subjects did not smile. But when presented with a task that caused genuine frustration -- filling out a detailed online form, only to then find the information deleted after pressing the "submit" button -- 90 percent of them did smile, he says. Still images showed little difference between these frustrated smiles and the delighted smiles elicited by a video of a cute baby, but video analysis showed that the progression of the two kinds of smiles was quite different: Often, the happy smiles built up gradually, while frustrated smiles appeared quickly but faded fast.
Understanding the subtleties that reveal underlying emotions is a major goal of this research, Hoque says. "People with autism are taught that a smile means someone is happy," he says, but research shows that it’s not that simple.
While people may not know exactly what cues they are responding to, timing does have a lot to do with how people interpret expressions, he says, For example, former British prime minister Gordon Brown was widely seen as having a phony smile, largely because of the unnatural timing of his grin, Hoque says. Similarly, a campaign commercial for former presidential candidate Herman Cain featured a smile that developed so slowly -- it took nine seconds to appear -- that it was widely parodied, including a spoof by comedian Stephen Colbert. "Getting the timing right is very crucial if you want to be perceived as sincere and genuine with your smiles," Hoque says.
Jeffrey Cohn, a professor of psychology at the University of Pittsburgh who was not involved in this research, says this work "breaks new ground with its focus on frustration, a fundamental human experience. While pain researchers have identified smiling in the context of expressions of pain, the MIT group may be the first to implicate smiles in expressions of negative emotion."
Cohn adds, "This is very exciting work in computational behavioral science that integrates psychology, computer vision, speech processing and machine learning to generate new knowledge... with clinical implications." He says this "is an important reminder that not all smiles are positive. There has been a tendency to ’read’ enjoyment whenever smiles are found. For human-computer interaction, among other fields and applications, a more nuanced view is needed."
In addition to providing training for people who have difficulty with expressions, the findings may be of interest to marketers, Hoque says. "Just because a customer is smiling, that doesn’t necessarily mean they’re satisfied," he says. And knowing the difference could be important in gauging how best to respond to the customer, he says: "The underlying meaning behind the smile is crucial."
The analysis could also be useful in creating computers that respond in ways appropriate to the moods of their users. One goal of the research of Affective Computing Group is to "make a computer that’s more intelligent and respectful," Hoque says.
Written by: David L. Chandler
Last job offers
- Physics/Materials Science - 28.7
Faculty Position in Plasma Physics
- Civil Engineering - 28.7
Faculty Positions in Transportation Engineering and Transportation Systems
- Computer Science/Telecom - 24.7
4 Doctoral Student/Post-Doc Positions (Salary Scale 13 TV-L)
- Life Sciences - 22.7
Wissenschaftliche Assistenten und Assistentinnen in angewandter Forschung
- Pedagogy/Education Science - 21.7
Professeur-e ordinaire ou associé-e dans le domaine Intervention en situation scolaire
- Pedagogy/Education Science - 20.7
Projektleiter/in als Wissensch. Mitarbeiter/in (80−100 %) Arbeits- und Organisationspsychologie...
- Environmental Sciences - 28.7
Lecturer / Senior Lecturer / Associate Professor in Environmental Management
- Environmental Sciences - 27.7
Assistant Professor: Global Environmental Change (1, 0 FTE)
- Arts and Design - 15.7
Universitätsprofessorin / Universitätsprofessor für das Fach Musiktheater-Regie (BV gem. § 99 UG )
- Social Sciences - 13.7
Universitätsprofessorin / Universitätsprofessor für das Fach Instrumental- und Gesangspädagogik (BV gem....
- - 28.7
- - 28.7
- Microtechnics - 28.7
Associate Professor in Oceanic Engineering Science
- Mechanical Engineering - 28.7
Assistant Professor in Additive Manufacturing Operations Research
- Medicine/Pharmacology - 29.7
Family Medicine - MEDEX - Assistant or Associate or Full Professor WOT (AA12561)
- Pedagogy/Education Science - 29.7
AGRI Research Chair in Gambling Policy